CL-SN55 941 —
GPT-61S 890 +8.8%
GPT-56T 861 —
GPT-6S 847 +1.2%
GPT-56SC 847 +1.2%
CL-OP55X 843 +1.4%
GROK-46H 843 +1.4%
GLM-52 843 +1.2%
DSK-V4PH 843 +1.4%
GLM-5 826 +10.3%
MUSE-SPK 804 —
QWEN-38X 795 +10.1%
GPT-6A 782 +11.1%
CL-FAB5H 761 +1.6%
CL-OP5H 736 +1.7%
CL-OP5X 734 +1.7%
GEM-37FH 732 +1.7%
KIMI-K3X 719 +0.1%
CL-OP46H 719 +1.7%
CL-OP55H 717 +1.7%
CL-OP47H 708 +1.7%
GEM-38FH 689 +0.3%
GPT-56S 581 -0.5%
CL-OP47 546 -0.4%
INKL 531 —
GEM-3P 495 —
CL-OP46 491 —
GEM-31P 487 -0.2%
CL-OP48 484 —
GPT-6L 436 —
CL-SN55 941 —
GPT-61S 890 +8.8%
GPT-56T 861 —
GPT-6S 847 +1.2%
GPT-56SC 847 +1.2%
CL-OP55X 843 +1.4%
GROK-46H 843 +1.4%
GLM-52 843 +1.2%
DSK-V4PH 843 +1.4%
GLM-5 826 +10.3%
MUSE-SPK 804 —
QWEN-38X 795 +10.1%
GPT-6A 782 +11.1%
CL-FAB5H 761 +1.6%
CL-OP5H 736 +1.7%
CL-OP5X 734 +1.7%
GEM-37FH 732 +1.7%
KIMI-K3X 719 +0.1%
CL-OP46H 719 +1.7%
CL-OP55H 717 +1.7%
CL-OP47H 708 +1.7%
GEM-38FH 689 +0.3%
GPT-56S 581 -0.5%
CL-OP47 546 -0.4%
INKL 531 —
GEM-3P 495 —
CL-OP46 491 —
GEM-31P 487 -0.2%
CL-OP48 484 —
GPT-6L 436 —
← Back to feed

Ai2 Open-Sources AstaBrief 8B: Cited Scientific Reports in 51 Seconds vs 178 for Claude

The Allen Institute for AI on October 2 open-sourced AstaBrief 8B, a model built for one narrow task: turning a research question and a set of retrieved literature excerpts into a cited scientific report. The model weights and training data are available on HuggingFace. It is already live in production as Fast mode in Asta, Ai2’s agentic scientific research platform.

What It Does

AstaBrief takes two inputs — a research question and literature passages retrieved from prior search — and outputs a structured, cited report. The key design decision is that it writes the full report in a single forward pass rather than section by section, which previous pipelines did. That change accounts for most of the speed difference.

Across the full Asta pipeline:

  • Fast mode (AstaBrief 8B): 51.1 seconds per report
  • Thinking mode (Claude-powered): 178.5 seconds per report
  • Speedup: 3.5x

Ai2 describes the improvement against proprietary models it was previously using as “nearly an order-of-magnitude reduction in report generation time.”

Why an 8B Model

The 8B parameter scale was a deliberate choice. Ai2 wanted to validate whether a small model trained specifically for scientific report generation could match the quality of general-purpose frontier models, at a fraction of the cost and latency.

Training required tens of thousands of real research queries drawn from Asta user sessions. The data pipeline applied citation-focused filtering and preference data to align the model toward scientific grounding — preserving what the evidence actually supports rather than generalizing beyond it. Hallucinated citations or quietly broadened conclusions are a known failure mode when using general-purpose models on scientific literature.

Local Deployment for Sensitive Research

Open weights matter for research institutions where the query itself reveals unpublished or sensitive work. Running AstaBrief on local infrastructure means the research question never leaves the institution. Ai2 is releasing an example workflow that researchers can adapt to generate reports directly from their own PDFs, using its ai2-scholarqa-lib library.

Asta Integration

Asta now presents two modes in its Generate a report feature. Fast mode runs AstaBrief 8B. Thinking mode runs a Claude-backed pipeline that prioritizes reasoning depth over speed. Users can choose based on whether they need a quick synthesis or a slower, heavier analysis.

The model was trained and evaluated against the frontier as it stood in 2025. Ai2 notes it has not rerun the full evaluation against current frontier models, so quality comparisons against today’s Claude or GPT-6 lineage are not available. The speed and cost advantages remain independent of that comparison.

Context

Ai2 positions Asta alongside platforms like OpenScholar, Elicit, and consensus.ai in the category of AI-assisted scientific literature tools. The distinguishing factor for AstaBrief is the combination of open weights, single-pass generation architecture, and training on actual research queries rather than synthetic tasks. The model is available at huggingface.co/allenai/AstaBrief_8B.