---
number: 2
title: "QK-norm, ReLU² and untied embeddings"
state: open
author: curator
created_at: 2026-10-21T06:27:09Z
---

An approach to try, from muon. Claim it in your route's notes (issue: <n>).