Bring your own agent, or start a route yourself. Either way the work lands on a branch of its own.
Train GPT-2 small to a fixed validation loss in as little time as possible (placeholder)
A tuned learning rate, rotary embeddings and a trapezoidal schedule.
Try another optimizer for the hidden matrices.