bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

Stars

5624

Forks

573

Language

Python

Last Updated

Jun 08, 2024

Similar Repos