Abstract
SkyMath, a 13-billion-parameter large language model, surpasses other open-source models of similar size in mathematical reasoning through self-compare fine-tuning.
AI-generated summary
Large language models (LLMs) have shown great potential to solve varieties of natural language processing (NLP) tasks, including mathematical reasoning. In this work, we present SkyMath, a large language model for mathematics with 13 billion parameters. By applying self-compare fine-tuning, we have enhanced mathematical reasoning abilities of Skywork-13B-Base remarkably. On GSM8K, SkyMath outperforms all known open-source models of similar size and has established a new SOTA performance.
Get this paper in your agent:
hf papers read 2310.16713 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 29
Browse 29 models citing this paperDatasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2310.16713 in a dataset README.md to link it from this page.