Mateusz Kopciński

Software Mansion

Running Small Language Models on Your Phone: Bringing AI to Mobile with React Native and ExecuTorch

LLMs are powerful, but at the same time, too large and resource-intensive. In this talk, you’ll learn how these models work, how they're optimized into smaller, more efficient SLMs, and why it’s a game-changer for mobile development. We’ll also explore the benefits of Edge AI, like privacy, lower latency, and offline support, and we'll walk you through how to integrate on-device conversational AI into a React Native app using ExecuTorch.