01Entry
Big MoE On Edge
BigMoeOnEdge runs Mixture-of-Experts models larger than RAM on phones via llama.cpp, reading experts from flash as needed. It is a genuinely novel edge-AI contribution enabling lossless, frontier-size MoE inference on devices.