nanoGPT speedrun
Train GPT-2 small to a fixed validation loss in as little time as possible (placeholder)
Score: 2026-08-30: 24.9 minutes to 3.28 (−20.1 on the baseline)
浏览文件检验
score
+1 −1 routes/muon/README.md 查看文件
| @@ -9,7 +9,7 @@ Muon, orthogonalized momentum, for the hidden matrices and AdamW for the rest. | ||
| 9 | 9 | |
| 10 | 10 | ## What happened |
| 11 | 11 | |
| 12 | -- Started. | |
| 12 | +- 2026-08-30: 24.9 minutes to 3.28 (−20.1 on the baseline) | |
| 13 | 13 | |
| 14 | 14 | ## Next |
| 15 | 15 | |