Jon Nielsen

Jon-Nielsen's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in danielrmay/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-W4A16 about 2 months ago

3090 user? I'd like to hear from you!

19

#1 opened about 2 months ago by

danielrmay

New activity in 0xSero/GLM-5.2-504B-W4A16 2 months ago

Interesting with the size of the weights

#1 opened 2 months ago by

Jon-Nielsen

New activity in sokann/GLM-5.2-GGUF-2.244bpw 2 months ago

Thank you for the excellent quant

🤗 1

#6 opened 2 months ago by

Jon-Nielsen

New activity in SixVolts/GLM-5.2-ewaste-edition-GGUF 2 months ago

Thank you for the excellent quants

❤️ 1

#1 opened 2 months ago by

Jon-Nielsen

New activity in DevQuasar/zai-org.GLM-5.2-GGUF 2 months ago

Error loading in ik_llama.cpp

1

#1 opened 3 months ago by

Jon-Nielsen

New activity in cyankiwi/Step-3.7-Flash-AWQ-INT4 3 months ago

how to use it

10

#1 opened 3 months ago by

iSource1

New activity in RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16 3 months ago

Great! Sucessfully Running on 8*48G 4090Ti: Avg generation throughput: 221.5 tokens/s, Running: 4 reqs

3

#1 opened 3 months ago by

nwzjk

New activity in mratsim/Qwen3.5-397B-A17B-EXL3 4 months ago

Thanks for this

#3 opened 4 months ago by

Jon-Nielsen

New activity in lukealonso/MiMo-V2.5-NVFP4 4 months ago

Looping in OpenCode

👀 1

5

#4 opened 4 months ago by

Jon-Nielsen

Link to model and docker image

👍 1

1

#2 opened 4 months ago by

Jon-Nielsen

New activity in mratsim/MiniMax-M2.5-FP8-INT4-AWQ 5 months ago

Hoping for your magic on MiniMax-M2.7-FP8-INT4-AWQ quant

17

#2 opened 5 months ago by

dehnhaide

New activity in MiniMaxAI/MiniMax-M2.5 5 months ago

Minimax 2.7???

49

#53 opened 5 months ago by

rombodawg

New activity in Intel/Devstral-2-123B-Instruct-2512-int4-AutoRound 5 months ago

Problems with tool calling

#1 opened 5 months ago by

Jon-Nielsen

New activity in nvidia/Qwen3.5-397B-A17B-NVFP4 5 months ago

## Real-World Performance on 4x RTX PRO 6000 (SM120) -- Honest Numbers

❤️ 5

3

#7 opened 6 months ago by

brandonmusic

New activity in Sehyo/Qwen3.5-122B-A10B-NVFP4 6 months ago

Running command?

👍 1

7

#2 opened 6 months ago by

bhat1

New activity in lukealonso/MiniMax-M2.5-NVFP4 7 months ago

VLLM error for kv weight scaling - workaround

7

#6 opened 7 months ago by

ShaunEvansMD

New activity in mratsim/MiniMax-M2.5-BF16-INT4-AWQ 7 months ago

Links in README

1

#6 opened 7 months ago by

Jon-Nielsen

New activity in lukealonso/MiniMax-M2.5-NVFP4 7 months ago

"w1_weight_scale_2 must match w3_weight_scale_2. Accuracy may be affected."

👍 1

21

#2 opened 7 months ago by

zenmagnets

New activity in mratsim/GLM-4.7-EXL3 8 months ago

10/10 Best EXL3 model card

🤗🚀 9

3

#3 opened 8 months ago by

gghfez