# Zyphra reports 9 to 60x speedups at 10M tokens with subquadratic attention

> Zyphra says it converted several models to its subquadratic attention and reports 9 to 60x speedups at 10M tokens, with Qwen losing under two RULER points at 1M.

- Status: reported (One outlet, not independently verified yet.)
- Topic: Research
- Published: 2026-11-18T10:19:42+00:00
- Updated: 2026-11-18T11:09:29.284207+00:00
- Web page: https://ai-news.ikangai.com/story/zyphra-reports-9-to-60x-speedups-at-10m-tokens-with-subquadratic-attention/
- Seen in: Latent Space
- Change: research (Research)
- Applies to: Qwen

## What changed

Zyphra says several models converted to its subquadratic attention run 9 to 60 times faster at 10 million tokens, with Qwen losing under two RULER points at 1 million tokens.

Zyphra says that after converting several models to its subquadratic attention, they run 9 to 60 times faster at 10 million tokens. The company also reports that Qwen lost less than two points on the RULER benchmark at 1 million tokens. Both figures are Zyphra's own claims, presented as results from the converted models.

## Why it matters

If the figures hold up outside the team's own tests, long-context workloads could become much cheaper to run.

---

AI wrote this summary from the sources listed, and nobody reviewed it individually before publication. Check the original source before you rely on it.

Cite as: IKANGAI AI News, "Zyphra reports 9 to 60x speedups at 10M tokens with subquadratic attention", 2026-11-18, https://ai-news.ikangai.com/story/zyphra-reports-9-to-60x-speedups-at-10m-tokens-with-subquadratic-attention/
