GPT-56T 861 —
MUSE-SPK 837 +0.2%
GPT-56SC 790 -4.6%
GLM-5 781 -0.4%
CL-OP55X 780 -5.1%
GROK-46H 780 -5.1%
QWEN-38X 748 -9.2%
GPT-6A 743 -9.4%
KIMI-K3X 742 —
CL-FAB5H 698 -6.1%
CL-OP5H 675 -6.2%
GEM-38FH 672 -0.7%
CL-OP5X 670 -5.5%
CL-OP55H 668 —
CL-OP46H 657 -5.9%
CL-OP47H 648 -6.1%
GPT-56S 618 -0.6%
GEM-37FH 610 -7.2%
GEM-36FH 593 —
CL-OP48H 588 —
CL-OP47 581 -0.2%
GEM-35FH 580 —
GPT-55H 541 -7%
INKL 531 —
GEM-31P 512 -0.2%
CL-OP46 498 +0.4%
GEM-3P 498 -0.2%
CL-OP48 492 +0.4%
GPT-52 464 —
GPT-55 423 —
GPT-56T 861 —
MUSE-SPK 837 +0.2%
GPT-56SC 790 -4.6%
GLM-5 781 -0.4%
CL-OP55X 780 -5.1%
GROK-46H 780 -5.1%
QWEN-38X 748 -9.2%
GPT-6A 743 -9.4%
KIMI-K3X 742 —
CL-FAB5H 698 -6.1%
CL-OP5H 675 -6.2%
GEM-38FH 672 -0.7%
CL-OP5X 670 -5.5%
CL-OP55H 668 —
CL-OP46H 657 -5.9%
CL-OP47H 648 -6.1%
GPT-56S 618 -0.6%
GEM-37FH 610 -7.2%
GEM-36FH 593 —
CL-OP48H 588 —
CL-OP47 581 -0.2%
GEM-35FH 580 —
GPT-55H 541 -7%
INKL 531 —
GEM-31P 512 -0.2%
CL-OP46 498 +0.4%
GEM-3P 498 -0.2%
CL-OP48 492 +0.4%
GPT-52 464 —
GPT-55 423 —
← Back to feed

Gemma 4's 2B Edge Model Runs Fully Offline on iPhone — 1.5 GB, Apple Neural Engine, No Cloud Required

Google’s Gemma 4 release included more than the headline 31B model. The edge variants — E2B (2 billion parameters) and E4B (4 billion parameters) — are now running fully offline on iPhones, using Apple’s Neural Engine as the inference backend. The path to deployment is straightforward: download the quantized model (~1.5 GB) through either Locally AI or Google’s own AI Edge Gallery app, and all subsequent processing happens on-device.

No network call. No API key. No cloud dependency.

What “Edge-Optimised” Means in Practice

Google engineered the E2B and E4B models specifically to extract more capability per parameter than previous-generation Gemma variants. The result is documented in third-party testing: on standard benchmark tasks, the 2.3B Gemma 4 E2B model performs comparably to what 70B models produced 18 months ago, at roughly 1.5 GB of RAM. On an iPhone 15 Pro or later, where the Apple Neural Engine provides substantial dedicated matrix multiplication throughput, inference runs without throttling the rest of the device.

For reference, Apple Intelligence models — Apple’s own on-device AI layer — operate in a similar parameter range and use the same neural engine. Gemma 4 E-series is essentially slot-compatible with that execution environment.

Deployment Paths

Two consumer apps currently support the Gemma 4 edge models on iOS:

  • Locally AI — a local inference app that supports multiple quantised open models; Gemma 4 E2B and E4B are available as direct downloads from within the app
  • Google AI Edge Gallery — Google’s own first-party showcase app for on-device model inference; added Gemma 4 support alongside the model’s April 2026 release

Both apps handle model management and quantisation automatically. The underlying runtime in both cases maps the model’s operations onto Apple’s Neural Engine acceleration stack.

The Practical Implication

Gemma 4 E2B running on consumer hardware without a network dependency means two things:

Privacy-first AI becomes a commodity option. For sensitive query types — health, finance, legal, personal communications — an on-device inference path that requires no data to leave the device is now available to anyone with a mid-range iPhone and a 1.5 GB download budget. The capability exists; the friction to access it is minimal.

Cloud providers lose a forcing function. A meaningful fraction of LLM use cases — summarisation, drafting, Q&A on local documents — do not require frontier-scale intelligence. If Gemma 4 E2B covers those cases at zero marginal cost and without latency, the justification for API calls weakens on purely economic grounds.

Google released all Gemma 4 variants under Apache 2.0, which means the edge models can be embedded in commercial products without licence restrictions or royalty obligations. The iOS deployment is a consumer-facing signal of what that licence structure enables at scale.