Models
On-Device AI Models for Mobile: What Actually Runs Offline
Which model sizes fit on a phone, what tasks they can handle offline, and where cloud fallback is still required.
#small models
2 articles2 articles on Model Drop tagged "small models."
2 articles
-
-
ModelsSmall Models That Run on One GPU, and What They Cost You
A quantized 27B model fits in 24 GB and handles most routine work. Throughput, not capability, is what actually limits it.