SaylorTwift/deep-swe
9.49 MB
Nathan Habib PRO
SaylorTwift
AI & ML interests
Evals
Recent Activity
new activity 2 minutes ago
WeiboAI/VibeThinker-3B:Add evaluation results from model card benchmark tables new activity 24 minutes ago
Qwen/Qwen3.6-27B:Update Terminal Bench 2.0 evaluation notes with methodology details new activity 30 minutes ago
allenai/tmax-4b:Add Terminal Bench 2.0 evaluation resultOrganizations
Posts 1
Post
2541
How do I test an LLM for my unique needs?
If you work in finance, law, or medicine, generic benchmarks are not enough.
This blog post uses Argilla, Distilllabel and 🌤️Lighteval to generate evaluation dataset and evaluate models.
https://github.com/argilla-io/argilla-cookbook/blob/main/domain-eval/README.md
If you work in finance, law, or medicine, generic benchmarks are not enough.
This blog post uses Argilla, Distilllabel and 🌤️Lighteval to generate evaluation dataset and evaluate models.
https://github.com/argilla-io/argilla-cookbook/blob/main/domain-eval/README.md
Articles 13
Article
19
Is it agentic enough? Benchmarking open models on your own tooling
spaces 24
Running
MCP
Reposcan
🦀
Search and explore repo issues, PRs, and code
Running
Qwen3 8B
📉
Inspect and browse server log files
Running
Qwen2.5 0.5B Instruct Evals
📊
Inspect and view log files in a web interface
Running
Meta Llama 3.1 8b Cb
📉
Inspect and explore log files in a web view
Running
Transformers CB
📈
View and explore server logs in a web interface
No application file
Agents
Leaderboard Dashboard
📈
datasets 57
SaylorTwift/harbor-assets
Updated • 24
SaylorTwift/gemma4-blog-images
Viewer • Updated • 1 • 5
SaylorTwift/mteb-bitext-mining-aggregated
Viewer • Updated • 588k • 1.2k
SaylorTwift/gsm8k-cb-llama31-8b-results
Viewer • Updated • 100 • 7
SaylorTwift/gsm8k-cb-results
Viewer • Updated • 100 • 20
SaylorTwift/aime-2026-qwen35-results
Viewer • Updated • 1 • 5
SaylorTwift/aime-2026-qwen25-72b-results
Viewer • Updated • 1 • 5
SaylorTwift/aime-2026-vllm-results
Viewer • Updated • 1 • 9
SaylorTwift/claude-sonnet-4-0
Updated • 47
SaylorTwift/aime25
Viewer • Updated • 30 • 17