Article
1
Leo PRO
leideng
AI & ML interests
Efficient AI, Sparse Attention
Recent Activity
updated a collection about 5 hours ago
SFT authored a paper about 10 hours ago
Extending Context Window of Large Language Models via Semantic
Compression authored a paper about 10 hours ago
Beyond Scaling Laws: Understanding Transformer Performance with
Associative MemoryOrganizations
None yet
-
DAPO: An Open-Source LLM Reinforcement Learning System at Scale
Paper • 2503.14476 • Published • 146 -
Proximal Policy Optimization Algorithms
Paper • 1707.06347 • Published • 11 -
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Paper • 2305.18290 • Published • 66 -
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Paper • 2402.03300 • Published • 145
-
DAPO: An Open-Source LLM Reinforcement Learning System at Scale
Paper • 2503.14476 • Published • 146 -
Proximal Policy Optimization Algorithms
Paper • 1707.06347 • Published • 11 -
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Paper • 2305.18290 • Published • 66 -
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Paper • 2402.03300 • Published • 145
datasets 12
leideng/Dolci-Think-SFT-7B-4K-Plus
Viewer • Updated • 3.63M • 1.69k
leideng/Dolci-Instruct-SFT-4K-Plus
Viewer • Updated • 2.19M • 842
leideng/Dolci-Think-RL-7B-4K-Plus
Viewer • Updated • 102k • 39
leideng/Dolci-Instruct-RL-4K-Plus
Viewer • Updated • 170k • 48
leideng/Dolci-Think-DPO-7B-4K-Plus
Viewer • Updated • 150k • 100
leideng/Dolci-Instruct-DPO-4K-Plus
Viewer • Updated • 260k • 289
leideng/longbench-v2-view
Viewer • Updated • 1.51k • 67
leideng/longbench-view
Viewer • Updated • 8.42k • 214
leideng/nanochat-ascend-dataset
Viewer • Updated • 72.3k • 446
leideng/nanochat-ascend-eval
Viewer • Updated • 272k • 227