Ai2 says Marin’s latest hero run includes about 1.8T Dolma 3.5 tokens
Ai2 says Marin’s latest hero run includes about 1.8 trillion tokens from its Dolma 3.5 corpus, and that Marin’s data-mixture work draws on Ai2’s Olmix recipes and Organize the Web curation methodology. Will Held says Marin’s 535B run was built on 25 trillion tokens from 152 datasets licensed for training.