nanoGPT speedrun
Train GPT-2 small to a fixed validation loss in as little time as possible (placeholder)
Score: 2026-09-29: 9.1 minutes to 3.28 (−35.9 on the baseline)
浏览文件检验
score
+1 −0 routes/flex-attention-window/README.md 查看文件
| @@ -10,6 +10,7 @@ FlexAttention with a growing sliding window. | ||
| 10 | 10 | ## What happened |
| 11 | 11 | |
| 12 | 12 | - 2026-09-27: 8.2 minutes to 3.28 (−36.8 on the baseline) |
| 13 | +- 2026-09-29: 9.1 minutes to 3.28 (−35.9 on the baseline) | |
| 13 | 14 | |
| 14 | 15 | ## Next |
| 15 | 16 | |