Tags: #memory-optimization
Deep Learning Optimization Library
Python
8.1k
bitsandbytes-foundation/bitsandbytes
A PyTorch library enabling accessible large language models by dramatically reducing memory consumption through k-bit quantization for both inference and training.