Georgi Gerganov says transformers can run GGUF models directly
The work brings ggml’s Metal kernels into the transformers ecosystem and, according to Georgi Gerganov, increases compatibility and performance.
#transformers
View all AI newsPedro Cuenca: tokenizers v1 (Rust) is 3 to 30 times faster, coming soon to transformers
Pedro Cuenca said tokenizers v1 (Rust) is 3 to 30 times faster, with an opt-out tokenization training crate, additional optimizations, and extensive benchmarks. He said it is coming soon to transformers.