Google Cloud matches Ai2’s Olmo 3 7B run on Cloud TPUs

Google Cloud reran Ai2’s Olmo 3 7B pretraining and mid-training on Cloud TPUs, and those runs matched Ai2’s original results on held-out evaluations, Ai2 said.

The case study is published as Reproducing Olmo 3 7B pre-training in MaxText.