These quantized models have a smaller memory footprint, but acceptable quality.
chicken
Crataco
AI & ML interests
Using my best computers to quantize LLMs for your worst computers
Recent Activity
liked a model 1 day ago
arbazsiddiqui/Ozan-v1-12B liked a model 10 days ago
wave-on-discord/silly-v0.2 liked a model 13 days ago
SporkySporkness/gemma-4-26B-A4B-GGUFOrganizations
None yet