Prism ML

prism-ml's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

pashak 

in prism-ml/Ternary-Bonsai-27B-gguf 4 days ago

Benchmark: 27B Q2_0 vs Qwen3.6-27B IQ2_XXS on one RTX 5060 Ti 16 GB (quality@budget, speed, VRAM, energy)

❤️ 2

4

#58 opened 8 days ago by

Astezelex

pashak 

in prism-ml/Ternary-Bonsai-27B-gguf 6 days ago

docs: point the llama.cpp quickstart at the PQ2_0 pack

1

#59 opened 7 days ago by

Gorilla4X

pashak 

in prism-ml/Bonsai-27B-gguf 11 days ago

Bonsai-27B Q1_0 less than 7 tk/s on llama.cpp b10612

8

#26 opened 12 days ago by

nerun

pashak 

in prism-ml/Ternary-Bonsai-27B-Demo 16 days ago

A simple math

1

#1 opened about 2 months ago by

rahul7star

pashak 

in prism-ml/Ternary-Bonsai-27B-gguf 21 days ago

Speed when CPU-only?

8

#51 opened 25 days ago by

TriAxp

pashak 

in prism-ml/Bonsai-27B-gguf 23 days ago

Update metadata (tokenizer.ggml.model)

#23 opened 23 days ago by

abudahm

pashak 

in prism-ml/Ternary-Bonsai-27B-gguf 24 days ago

Speed when CPU-only?

8

#51 opened 25 days ago by

TriAxp

pashak 

in prism-ml/Bonsai-27B-gguf about 1 month ago

VLLM serve is not working

3

#19 opened about 1 month ago by

codegood

Ollama 500 error loading Bonsai-27B GGUF (dspark architecture)

➕👍 3

4

#11 opened about 2 months ago by

amdeld