Georgi Gerganov says transformers can run GGUF models directly
The work brings ggml’s Metal kernels into the transformers ecosystem and, according to Georgi Gerganov, increases compatibility and performance.
The work brings ggml’s Metal kernels into the transformers ecosystem and, according to Georgi Gerganov, increases compatibility and performance.