Search
BARD AI
All About Artificial Intelligence - Stay AI Updated
Home
Tags
Quantized
Tag: quantized
Artificial Intelligence
QLoRa: Wonderful-Tune a Large Language Model on Your GPU QLoRa: Quantized LLMs with Low-Rank Adapters Wonderful-tuning a GPT model with QLoRa GPT Inference with QLoRa Conclusion
admin
-
June 2, 2023
0
Artificial Intelligence
Quantizing OpenAI’s Whisper with the Huggingface Optimum Library → >30% Faster Inference, 64% Lower Memory tl;dr Introduction Step 1: Install requirements Step 2: Quantize the model Step 3: Compare original and quantized model Results
admin
-
May 19, 2023
1