--- tags: training --- # soap-optimizer SOAP in place of Muon. ## What happened - Started. ## Next Close, not better; keep Muon.