Mu

Mu by Microsoft is a new ~330M on-device SLM that runs on the NPU in Copilot+ PCs. It powers the new agent in Windows Settings, delivering high speed and efficiency for local AI tasks.

**Mu by Microsoft** is a compact, on-device AI model designed for Copilot+ PCs, optimized to run efficiently on Neural Processing Units (NPUs). With just 330 million parameters, Mu delivers fast, local AI processing, achieving over 100 tokens per second. It powers the AI agent in Windows Settings, enabling natural language queries to seamlessly adjust system settings. Built with an encoder-decoder architecture, Mu reduces latency and boosts efficiency by decoupling input and output processing. Advanced optimizations, including 8-bit quantization and hardware-specific tuning, ensure smooth performance on NPUs. Despite its small size, Mu rivals larger models in accuracy for tasks like question-answering and code generation. Integrated into Windows Settings, Mu provides quick, context-aware responses, enhancing usability while maintaining privacy by processing data locally. Future refinements will expand its capabilities based on user feedback.