# Ai2 makes Stage 1 byte-level checkpoints available with unchanged base weights

Ai2 has released Stage 1 checkpoints for its byte-level language models, keeping original model weights unchanged while providing pre-trained byte components. The release allows researchers to experiment with new architectures and train systems without re-running the initial stage.

Language: en
Time zone: America/Los_Angeles

HTML: https://didcodexreset.com/news/0bcca4942d2145ebb404e5ef.html

Content language: en
Localization state: sameLanguage

Source: Ai2 · Published 10/7/2026, 09:01:28

Ai2 is making new Stage 1 checkpoints available with byte-level components already trained and the original model weights left unchanged. These intermediate checkpoints stem from its recipe for retrofitting existing language models to operate over bytes.

By providing checkpoints from the end of Stage 1, Ai2 enables researchers to test new architectures and train the full system directly without repeating the initial adaptation phase.

Tags: Ai2, Byte-Level Models, Model Checkpoints, Open Source AI

[View original post](https://x.com/allen_ai/status/2107862556664578506)