#llama-cpp

Pedro Cuenca runs MiMo 2.6 Flash across RTX 6000 and M5 laptop via llama.cpp

Pedro Cuenca demonstrated running MiMo 2.6 Flash with native mxfp4 weights across an RTX 6000 GPU and an M5 laptop over 10 GbE at 40 tokens per second, utilizing out-of-the-box support in llama.cpp.