- Community aggregator
- Country: United States
Shipping a real on-device LLM app on Android: 5 LiteRT-LM production bugs nobody warns you about
We ship an offline-first LLM chat app on Google Play. Everything runs on-device with Google's LiteRT-LM runtime ( com.google.ai.edge.litertlm:litertlm-android ) — no server, no account, no data leaving the phone. Here's what actually broke in production and how we fixed it. 1. The GPU delegate will…