Key Takeaways
- The bottleneck: Shipping a separate full model per task balloons storage and RAM on iPhone.
- The architecture: One frozen ~3B foundation model stays in memory while LoRA adapters specialize it per task.
- The scale: Rank-16 adapters are tens of megabytes and can be loaded, cached, and swapped on demand.
