Post
223
Byrne-100M-Ultra-MC
Quazim0t0/Byrne-100M-Ultra-MC
114M looped transformer (SpikeWhale v2 / Byrne) with a parallel Memory Cache branch. Trained from scratch on a web/code/math mix, then SFT, then DPO. All three stages are in this repo.
It's a small model. Fluent English, simple chat formatting, not a knowledge base, weak at code and multi-step reasoning. Numbers in Evaluation.
Demo: Quazim0t0/Byrne-100M-UltraX-MC-Chat
Quazim0t0/Byrne-100M-Ultra-MC
114M looped transformer (SpikeWhale v2 / Byrne) with a parallel Memory Cache branch. Trained from scratch on a web/code/math mix, then SFT, then DPO. All three stages are in this repo.
It's a small model. Fluent English, simple chat formatting, not a knowledge base, weak at code and multi-step reasoning. Numbers in Evaluation.
Demo: Quazim0t0/Byrne-100M-UltraX-MC-Chat