MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )
mudler PRO
mudler
AI & ML interests
APEX quants, LocalAI Creator ( https://localai.io )
Website: https://mudler.pm, llama.cpp fan
Recent Activity
new activity about 3 hours ago
lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled:request quant apex updated a collection about 3 hours ago
APEX Quants (GGUF) updated a model about 11 hours ago
LocalAI-io/whisper-large-v3-turbo-it-multi-ggmlOrganizations
Fine-tuned models for LocalAI finetuned by me
-
LocalAI-io/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 14 • 8 -
LocalAI-io/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 6 -
LocalAI-io/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 7 • 1 -
LocalAI-io/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 11 • 10
MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )
Fine-tuned models for LocalAI finetuned by me
-
LocalAI-io/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 14 • 8 -
LocalAI-io/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 6 -
LocalAI-io/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 7 • 1 -
LocalAI-io/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 11 • 10
models 50
mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-GGUF
35B • Updated • 1.9k • 3
mudler/MiniMax-M2.7-APEX-GGUF
229B • Updated • 9.71k • 3
mudler/gemma-4-26B-A4B-it-heretic-APEX-GGUF
25B • Updated • 33.5k • 33
mudler/gemma-4-26B-A4B-it-Claude-Opus-Distill-APEX-GGUF
25B • Updated • 20.8k • 15
mudler/gemma-4-26B-A4B-it-APEX-GGUF
25B • Updated • 245k • 48
mudler/Step-3.5-Flash-APEX-GGUF
197B • Updated • 3.88k • 2
mudler/Qwopus-MoE-35B-A3B-APEX-GGUF
35B • Updated • 7.32k • 12
mudler/Qwen3.6-35B-A3B-uncensored-heretic-APEX-GGUF
35B • Updated • 16.5k • 20
mudler/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-APEX-GGUF
35B • Updated • 12k • 3
mudler/Qwen3.6-35B-A3B-APEX-GGUF
35B • Updated • 115k • 81