CL-SN55 941 —
GPT-61S 890 +8.8%
GPT-56T 861 —
GPT-6S 847 +1.2%
GPT-56SC 847 +1.2%
CL-OP55X 843 +1.4%
GROK-46H 843 +1.4%
GLM-52 843 +1.2%
DSK-V4PH 843 +1.4%
GLM-5 826 +10.3%
MUSE-SPK 804 —
QWEN-38X 795 +10.1%
GPT-6A 782 +11.1%
CL-FAB5H 761 +1.6%
CL-OP5H 736 +1.7%
CL-OP5X 734 +1.7%
GEM-37FH 732 +1.7%
KIMI-K3X 719 +0.1%
CL-OP46H 719 +1.7%
CL-OP55H 717 +1.7%
CL-OP47H 708 +1.7%
GEM-38FH 689 +0.3%
GPT-56S 581 -0.5%
CL-OP47 546 -0.4%
INKL 531 —
GEM-3P 495 —
CL-OP46 491 —
GEM-31P 487 -0.2%
CL-OP48 484 —
GPT-6L 436 —
CL-SN55 941 —
GPT-61S 890 +8.8%
GPT-56T 861 —
GPT-6S 847 +1.2%
GPT-56SC 847 +1.2%
CL-OP55X 843 +1.4%
GROK-46H 843 +1.4%
GLM-52 843 +1.2%
DSK-V4PH 843 +1.4%
GLM-5 826 +10.3%
MUSE-SPK 804 —
QWEN-38X 795 +10.1%
GPT-6A 782 +11.1%
CL-FAB5H 761 +1.6%
CL-OP5H 736 +1.7%
CL-OP5X 734 +1.7%
GEM-37FH 732 +1.7%
KIMI-K3X 719 +0.1%
CL-OP46H 719 +1.7%
CL-OP55H 717 +1.7%
CL-OP47H 708 +1.7%
GEM-38FH 689 +0.3%
GPT-56S 581 -0.5%
CL-OP47 546 -0.4%
INKL 531 —
GEM-3P 495 —
CL-OP46 491 —
GEM-31P 487 -0.2%
CL-OP48 484 —
GPT-6L 436 —
← Back to feed

Mistral Ships Shieldstral: 3B Open-Weight Safety Classifier Beats 21B Models on Multimodal Moderation

Mistral has released Shieldstral, a 3 billion parameter open-weight multimodal safety classifier that outperforms models up to seven times its size on text safety benchmarks and sets a new state of the art on multimodal moderation. It ships under Apache 2.0 and runs on a single 16GB NVIDIA GPU.

The model rethinks how safety classification works. Instead of baking a fixed taxonomy of harm categories into the weights, Shieldstral accepts a plain-language policy question at inference time and returns a calibrated safety score from a single token. The effect: one model serves any deployment context without retraining.

How It Works

Every moderation request passes three inputs: an evaluation context, a strictness level, and an optional definition of what counts as unsafe content. The model then returns a binary verdict. The same content that passes a cybersecurity research tool can fail a mental-health platform, depending on the policy question asked.

That flexibility matters because harm definitions vary by product, audience, and jurisdiction. Traditional guardrail models encode a fixed view of harm into their weights. Swapping that view requires a new fine-tune. Shieldstral makes the policy a runtime variable.

The model covers both text-to-text and image-to-text evaluation in a unified interface. Most existing safety classifiers treat those as separate pipelines requiring different models.

Benchmark Position

Mistral claims Shieldstral matches models up to 7x its size on text safety benchmarks — roughly 21B-class models — while setting a new SOTA on multimodal moderation tasks. The technical report (arxiv: 2607.25857) provides the full benchmark breakdown across diverse harm categories.

Running a full inference pass requires only a 16GB GPU, which puts it within reach of single-instance deployment rather than a separate safety-model cluster.

Release

Shieldstral 1.0 3B is available on Hugging Face at mistralai/Shieldstral-1.0-3B under Apache 2.0. Mistral is releasing it as an inaugural member of the Open Secure AI Alliance, a joint initiative with NVIDIA and other organizations focused on open-weight safety infrastructure.

The model arrives as content moderation becomes a structural requirement rather than an afterthought. Platforms shipping frontier models face regulatory pressure from the EU AI Act and US state-level AI liability bills. A policy-adaptive classifier that doesn’t require retraining cuts the operational cost of compliance significantly.

Key Numbers

  • Parameters: 3B
  • Effective benchmark performance: matches 21B-class rivals on text safety
  • Multimodal moderation: new SOTA
  • License: Apache 2.0
  • GPU requirement: single 16GB NVIDIA GPU
  • Available: Hugging Face (mistralai/Shieldstral-1.0-3B)