01Entry
NVMe AI Inference
Embeddable C inference engine with no third-party runtime dependencies that streams activated weights from NVMe to run huge models like 2.78T Kimi K3 beyond RAM. Enables trillion-parameter frontier models on consumer hardware like 64GB.