Henkie Tenkie

HenkTenk's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cyankiwi/Qwen3.6-27B-AWQ-BF16-INT8 5 days ago

Compatible with vLLM on Ampere?

#3 opened 5 days ago by

HenkTenk

New activity in cyankiwi/Qwen3.6-27B-AWQ-BF16-INT4 5 days ago

What is the update ?

8

#4 opened 17 days ago by

robert1968

New activity in Qwen/Qwen3.6-27B-FP8 24 days ago

Garbage output

👍 2

6

#8 opened 24 days ago by

andylele

New activity in QuantTrio/Qwen3.6-35B-A3B-AWQ 28 days ago

PPLX or KLD, or other benchmark

1

#4 opened 28 days ago by

HenkTenk

New activity in cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit 28 days ago

How does this compare to the original 8bit qwen quant and the 4 bit auto-round quant?

2

#5 opened 30 days ago by

sparx3

New activity in cyankiwi/GLM-4.6V-AWQ-4bit 3 months ago

Can't seem to correctly generate structured output

17

#3 opened 5 months ago by

kldzj

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 4 months ago

Running on 6 GPUs

🤗 1

4

#10 opened 7 months ago by

0xSero

KV Cache per token and Doubling the context size

3

#12 opened 4 months ago by

HenkTenk

New activity in cyankiwi/Devstral-2-123B-Instruct-2512-AWQ-4bit 5 months ago

Unable to use on 4x3090

3

#4 opened 5 months ago by

marutichintan

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 5 months ago

Running on 4 GPUs with TP=4

3

#11 opened 6 months ago by

nephepritou

New activity in cyankiwi/Devstral-2-123B-Instruct-2512-AWQ-4bit 5 months ago

Duplicate files

➕ 1

7

#3 opened 5 months ago by

darkstar3537

New activity in cyankiwi/GLM-4.5V-AWQ-4bit 8 months ago

vLLM v0.10.2 won't start

2

#1 opened 8 months ago by

HenkTenk

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 9 months ago

Improved useability

2

#7 opened 9 months ago by

HenkTenk

New activity in gghfez/c4ai-command-a-03-2025-AWQ 9 months ago

Newest vLLM produces nonsense with longer context

4

#1 opened 9 months ago by

HenkTenk

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 9 months ago

Does this actually work with VLLM?

32

#1 opened 10 months ago by

sirus