---
number: 1
title: "Muon, orthogonalized momentum, for the hidden matrices and AdamW for the rest"
state: open
author: curator
created_at: 2026-10-21T06:27:07Z
---

An approach to try, from tuned-lr-rotary. Claim it in your route's notes (issue: <n>).