# Jun Song says black-hat group offered him money to train models on exploit data

> Jun Song says an anonymous group offered a large sum to train open-weight models on exploit data, and that he declined.

- Status: reported (One outlet, not independently verified yet.)
- Topic: Safety & Security
- Published: 2026-11-03T05:35:54+00:00
- Updated: 2026-11-03T05:35:54+00:00
- Web page: https://ai-news.ikangai.com/story/jun-song-says-black-hat-group-offered-him-money-to-train-models-on-exploit-data/
- Seen in: Latent Space

Jun Song says an anonymous black-hat group approached him with an offer of an astronomical sum to post-train open-weight models on exploit data, and that he turned it down. He posted about the approach on X on November 1, 2026.

Song's details are sparse. He says the group claimed to hold attack data "unlike anything I have ever seen," and the request was for reinforcement-learning post-training. His post does not say how the group would verify its data or what reward it intended to use. The linked material doesn't say either.

One user suggested the approach resembled a law-enforcement sting, since a dataset offered to random RL practitioners for cash could be bait. Another argued the approach would be inefficient, because public CVE write-ups and exploit repositories are already freely available as training material. These are comments from individual users, not findings, and the post doesn't resolve either point.

## Why it matters

Open-weight models could be targeted for cyber misuse, which raises the security bar for companies that deploy or fine-tune them.

## Further reporting

- [Chubby♨️ on X: "Jun Song says an anonymous black hat group offered him a huge sum to train open-weight AI models on exploit data; he declined but fears someone ](https://x.com/kimmonismus/status/2116810022151663996)

---

AI wrote this summary from the sources listed, and nobody reviewed it individually before publication. Check the original source before you rely on it.