Shaij PRO

appoose

·

AI & ML interests

None yet

Organizations

Posts 2

Post

2152

Releasing HQQ Llama-3.1-70b 4-bit quantized version! Check it out at https://huggingface.co/mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq.

Achieves 99% of the base model performance across various benchmarks! Details in the model card.

Post

1814

Excited to announce the release of our high-quality Llama-3.1 8B 4-bit HQQ/calibrated quantized model! Achieving an impressive 99.3% relative performance to FP16, it also delivers the fastest inference speed for transformers.

https://huggingface.co/mobiuslabsgmbh/Llama-3.1-8b-instruct_4bitgs64_hqq_calib

spaces 1

MobiusSearch

models 1

appoose/aana-soccer-no-pretraining-weight-balanced-2_2.0_720-combined-finetuned

Updated May 30, 2024

datasets 0

None public yet