← All posts

Which AI models actually run on your iPhone

A model-by-model reference for on-device LLMs — download size, the RAM each one really needs, and context length. 34 open models, sorted by the phone that can hold them.

Most lists of "small models for phones" are copied from a Hugging Face trending page and never tested on hardware. This one is the shipping catalogue from Pocket AI: 34 open models, each with the exact GGUF we download, and the RAM tier the app enforces before it will let you install it.

The Needs column is not marketing. It is the smallest device RAM at which the model passes the memory gate described in How much RAM does an LLM really need on an iPhone?. Below that number the app blocks the download, because the alternative is a phone that restarts.

Quick answer by phone

Your iPhoneRAMPractical ceilingPick this
12, 12 mini, 13, 13 mini4 GB1.29 GBLlama 3.2 1B, Qwen3 1.7B
12–14 Pro, 14, 156 GB2.23 GBLlama 3.2 3B, Qwen2.5 3B
15 Pro, 16, 16e, 178 GB3.18 GBGemma 3 4B, Qwen3.5 4B
17 Pro, 17 Pro Max, Air12 GB5.07 GBGemma 4 E2B, Ministral 8B

Apple does not publish iPhone RAM, so those figures are the reported teardown numbers. The app reads your device's real value at runtime rather than guessing from the model name.

The full catalogue

Sorted by the RAM tier that can hold them, smallest first.

ModelDownloadNeedsContextQuant
SmolLM2 135M90 MB3 GB8kQ4_K_M
LFM2.5 350M219 MB3 GB125kQ4_K_M
SmolLM2 360M269 MB3 GB8kQ4_K_M
Gemma 3 270M278 MB3 GB32kQ8_0
Qwen2.5 0.5B379 MB3 GB32kQ4_K_M
Qwen3 0.6B462 MB3 GB32kQ4_K_M
Qwen3.5 0.8B560 MB3 GB32kQ4_K_M
LFM2.5 1.2B697 MB3 GB125kQ4_K_M
Gemma 3 1B718 MB3 GB32kQ4_K_M
LFM2 1.2B731 MB3 GB32kQ4_K_M
LFM2 1.2B Tool731 MB3 GB32kQ4_K_M
Llama 3.2 1B830 MB4 GB128kQ4_K_M
Qwen2.5 1.5B986 MB4 GB32kQ4_K_M
SmolLM2 1.7B1.1 GB4 GB8kQ4_K_M
DeepSeek R1 1.5B1.1 GB4 GB32kQ4_K_M
Qwen3 1.7B1.2 GB4 GB32kQ4_K_M
Qwen3.5 2B1.3 GB6 GB32kQ4_K_M
Granite 3.1 2B1.5 GB6 GB128kQ4_K_M
Granite 3.3 2B1.6 GB6 GB128kQ4_K_M
LFM2.5 2.6B1.6 GB6 GB128kQ4_K_M
Gemma 2 2B1.7 GB6 GB8kQ4_K_M
SmolLM3 3B1.8 GB6 GB64kQ4_K_M
Qwen2.5 3B1.9 GB6 GB32kQ4_K_M
Ministral 3B2.0 GB6 GB32kQ4_K_M
Llama 3.2 3B2.0 GB6 GB128kQ4_K_M
Phi-4 Mini2.3 GB8 GB128kQ4_K_M
Qwen3 4B2.3 GB8 GB32kQ4_K_M
Gemma 3 4B2.5 GB8 GB128kQ4_K_M
Gemma 3n E2B2.8 GB8 GB32kQ4_K_M
Qwen3.5 4B2.8 GB8 GB32kQ4_K_M
Gemma 4 E2B3.2 GB12 GB128kQ4_K_M
Gemma 3n E4B3.9 GB12 GB32kQ4_K_M
Ministral 8B4.5 GB12 GB32kQ4_K_M
Cogito v1 8B4.9 GB16 GB128kQ4_K_M

Everything is Q4_K_M except Gemma 3 270M, which ships Q8_0 — at 270M parameters the Q4 saving is about 37 MB while the quality loss is very much not negligible. See GGUF quantization explained for why that trade flips at small sizes.

What to actually pick

If you have 4 GB. You have one real choice and it is a 1B model. Llama 3.2 1B is the safe default — 128k context, and Meta's instruction tuning holds up better at 1B than most. Qwen3 1.7B is smarter but leaves you almost no headroom.

If you have 6 GB. This is the sweet spot for 3B models. Llama 3.2 3B for general chat with a huge context window. Qwen2.5 3B if you want coding and maths. SmolLM3 3B if you want visible reasoning traces at a size that still runs fast.

If you have 8 GB. Now the 4B tier opens up and the quality jump is real. Gemma 3 4B is the strongest all-rounder here — good reasoning, 128k context. Phi-4 Mini is noticeably better at maths and code than its size suggests. Qwen3.5 4B is the newest architecture with hybrid thinking.

If you have 12 GB or more. Ministral 8B and Cogito v1 8B are genuinely capable assistants rather than toys. Expect slower tokens per second — you are trading speed for quality, and on a phone that trade is felt.

Things the size column does not tell you

Context length costs RAM too. The KV cache grows linearly with context. A model advertising 128k context will not give you 128k on a phone; the engine clamps it, and the memory budget assumes the clamped value. Treat the context column as a ceiling on the architecture, not a promise about your device.

Parameter count is not quality. LFM2.5 350M at 219 MB is more useful than SmolLM2 360M at 269 MB, despite being smaller, because it is a newer architecture trained for edge inference. Generation matters more than size within the same tier.

"E2B" is not 2B. Gemma 3n E2B and Gemma 4 E2B are effective 2B — they use a larger parameter set with per-layer embeddings that stream selectively. Gemma 4 E2B downloads at 3.2 GB, not the ~1.5 GB a real 2B at Q4 would be. Size the download, not the name.

Thinking models spend tokens before answering. Qwen3, Qwen3.5, DeepSeek R1 and SmolLM3 emit a reasoning trace first. On a phone at 10–20 tokens/second that is a real wait before the first useful word appears. Worth it for hard questions, irritating for "what's a synonym for fast".

Where these come from

Every entry is a specific GGUF file from a specific repo — mostly bartowski and lmstudio-community. Sizes are read back from the Hugging Face API rather than estimated, and each download URL is fetched to confirm it resolves before it ships. If a number here disagrees with what your phone downloads, the number here is wrong and we want to know.