Inference Providers
Active filters: vLLM
mistralai/Mistral-Medium-3.5-128B
128B • Updated • 270k
• 338
QuantTrio/Qwen3.6-35B-A3B-AWQ
Image-Text-to-Text
• 36B • Updated • 855k
• 25
QuantTrio/Qwen3.6-27B-AWQ
Image-Text-to-Text
• 28B • Updated • 889k
• 13
mistralai/Mistral-Small-4-119B-2603
119B • Updated • 61.6k
• 379
RecViking/Mistral-Medium-3.5-128B-NVFP4
74B • Updated • 10.8k
• 6
cyankiwi/Mistral-Medium-3.5-128B-AWQ-INT4
25B • Updated • 17.2k
• 3
mistralai/Mistral-Small-4-119B-2603-NVFP4
Updated • 997
• 89
mistralai/Mistral-Small-4-119B-2603-eagle
Updated • 182
• 52
mradermacher/Mistral-Small-4-119B-2603-i1-GGUF
119B • Updated • 759
• 1
Text Generation
• 754B • Updated • 862
• 7
QuantTrio/Qwen3-Coder-30B-A3B-Instruct-AWQ
Text Generation
• 31B • Updated • 499k
• 8
Image-Text-to-Text
• 10B • Updated • 244k
• 17
model-scope/glm-4-9b-chat-GPTQ-Int4
Text Generation
• 9B • Updated • 27
• 6
model-scope/glm-4-9b-chat-GPTQ-Int8
Text Generation
• 9B • Updated • 8
• 2
tclf90/qwen2.5-72b-instruct-gptq-int4
Text Generation
• 73B • Updated • 59
• 2
tclf90/qwen2.5-72b-instruct-gptq-int3
Text Generation
• 69B • Updated • 61
prithivMLmods/Nu2-Lupi-Qwen-14B
Text Generation
• 15B • Updated • 7
• 2
mradermacher/Nu2-Lupi-Qwen-14B-GGUF
15B • Updated • 191
• 1
mradermacher/Nu2-Lupi-Qwen-14B-i1-GGUF
15B • Updated • 493
• 1
JunHowie/Qwen3-0.6B-GPTQ-Int4
Text Generation
• 0.6B • Updated • 274
• 1
JunHowie/Qwen3-0.6B-GPTQ-Int8
Text Generation
• 0.6B • Updated • 18
JunHowie/Qwen3-1.7B-GPTQ-Int4
Text Generation
• 2B • Updated • 2.71k
• 1
JunHowie/Qwen3-1.7B-GPTQ-Int8
Text Generation
• 2B • Updated • 24
JunHowie/Qwen3-32B-GPTQ-Int4
Text Generation
• 33B • Updated • 26.8k
• 4
JunHowie/Qwen3-32B-GPTQ-Int8
Text Generation
• 33B • Updated • 459
• 4
JunHowie/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
• 5B • Updated • 23
• 1
JunHowie/Qwen3-14B-GPTQ-Int8
Text Generation
• 15B • Updated • 91
• 1
JunHowie/Qwen3-14B-GPTQ-Int4
Text Generation
• 15B • Updated • 121k
• 4
JunHowie/Qwen3-8B-GPTQ-Int8
Text Generation
• 8B • Updated • 816
JunHowie/Qwen3-8B-GPTQ-Int4
Text Generation
• 8B • Updated • 492
• 4