1.58 bits per parameter
Artificial Intelligence
Microsoft’s Inference Framework Brings 1-Bit Large Language Models to Local Devices
On October 17, 2024, Microsoft announced BitNet.cpp, an inference framework designed to run 1-bit quantized Large Language Models (LLMs). BitNet.cpp is a big progress in Gen AI, enabling the deployment of 1-bit LLMs efficiently...
Recent posts
