Ai2 byte-level language model paper accepted to Nature, releases Qwen and Llama checkpoints

Ai2 announced that its paper on retrofitting language models to operate over bytes—the underlying technique behind Bolmo—has been accepted to Nature.

Ai2 is also releasing new model checkpoints extending the byte-level retrofitting approach from Olmo to Qwen and Llama.