# Marin finishes main pretraining of 535B Mochi model on 18T tokens

> Marin says its Mochi 535B-A23B model finished main pretraining on 18T tokens, with long-context training and fine-tuning next.

- Status: reported (One outlet, not independently verified yet.)
- Topic: Models
- Published: 2026-11-06T10:36:15+00:00
- Updated: 2026-11-06T10:36:15+00:00
- Web page: https://ai-news.ikangai.com/story/marin-finishes-main-pretraining-of-535b-mochi-model-on-18t-tokens/
- Seen in: Latent Space
- Change: other (Other)
- Applies to: Mochi 535B-A23B

## What changed

The Mochi 535B-A23B model has finished main pretraining on 18T tokens, with long-context training and supervised fine-tuning next.

A Marin team member, dlwh, said the Mochi 535B-A23B model has finished main pretraining on 18T tokens. The next stages are long-context training and supervised fine-tuning (SFT), the step that teaches a base model to follow instructions from curated examples. dlwh said checkpoints are hoped for the following week, which is a hope rather than a commitment.

## Why it matters

A 535B-parameter model with 23B active parameters is another large open-weight candidate in development. No weights or evaluations are out yet.

---

AI wrote this summary from the sources listed, and nobody reviewed it individually before publication. Check the original source before you rely on it.

Cite as: IKANGAI AI News, "Marin finishes main pretraining of 535B Mochi model on 18T tokens", 2026-11-06, https://ai-news.ikangai.com/story/marin-finishes-main-pretraining-of-535b-mochi-model-on-18t-tokens/
