🤝 Open to Collab

Steffen Röcker PRO

sroecker

·

https://x.com/sroecker

AI & ML interests

Local models

Recent Activity

liked a model 3 days ago

deepseek-ai/DeepSeek-V4-Flash-0731

liked a model 3 days ago

thinkingmachines/Inkling-Small-NVFP4

liked a model 3 days ago

thinkingmachines/Inkling-Small

View all activity

Organizations

upvoted a collection 2 months ago

🧬 Carbon

Carbon 500M, 3B, 8B genomic models and GGUF variants for llama.cpp • 7 items • Updated Jun 2 • 46

upvoted 3 collections 3 months ago

NuExtract3

12 items • Updated May 26 • 15

GSQ

GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling, https://huggingface.co/papers/2604.18556 • 9 items • Updated May 25 • 9

Fixed Chat Templates for Qwen 3.5 & 3.6

Rewritten Jinja templates fixing 5 bugs in official Qwen 3.5/3.6. Works in LM Studio, llama.cpp, MLX, vLLM. • 1 item • Updated Apr 30 • 7

upvoted a paper 3 months ago

Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling

Paper • 2605.13301 • Published May 13 • 166

upvoted 4 collections 3 months ago

SpecDrift

Models released as a part of Attention-Drift Paper, trained for deployment on production • 2 items • Updated May 10 • 2

Gemma 4 Assistant GGUF

Gemma 4 MTP assistant drafters as GGUF (F16/Q8_0/Q5_K_M/Q4_K_M/Q4_K_S). Speculative-decoding heads for the atomic-llama-cpp-turboquant fork. • 4 items • Updated May 7 • 13

8GB VRAM Local LLMs - Practitioner Tested

11 models on RTX 4060 Ti 8GB. speed king: Llama 1B (228 tok/s). quality king: Gemma 4 E4B (6/6). agentic king: gpt-oss-20b (10/10). • 21 items • Updated May 21 • 5

Granite 4.1 Language Models

Efficient language models for multilingual generation, coding, RAG, and AI assistant workflows. • 6 items • Updated Apr 29 • 63

upvoted an article 3 months ago

Article

Granite 4.1 LLMs: How They’re Built

ibm-granite

•

Apr 29

• 88

upvoted 9 collections 3 months ago

APEX Quants (GGUF)

MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant ) • 44 items • Updated 8 days ago • 131

1930 Coder

Fine-tuning the Talkie 13B 1930 model on agentic trajectories • 4 items • Updated May 5 • 4

Qwen3.6

4 items • Updated Apr 22 • 466

Laguna XS.2

Designed for agentic coding and long-horizon work on a local machine. Apache 2.0. • 5 items • Updated Jun 29 • 29

privacy-filter

OpenAI's privacy-filter fine0tuned models • 12 items • Updated 21 days ago • 12

talkie-13b

talkie-1930-13b is a vintage language model trained on pre-1931 English-language text. See https://github.com/talkie-lm/talkie to run talkie. • 3 items • Updated Apr 21 • 57

DeepSeek V4

8 items • Updated Apr 25 • 9

DeepSeek-V4

7 items • Updated 3 days ago • 781

DR-Venus

5 items • Updated Jun 15 • 17

upvoted a paper 3 months ago

Pushing the Limits of Large Language Model Quantization via the Linearity Theorem

Paper • 2411.17525 • Published Nov 26, 2024 • 6