---
issue: 4
status: working
tags: systems
---
# flex-attention-window

FlexAttention with a growing sliding window.

## What happened

- 2026-09-27: 8.2 minutes to 3.28 (−36.8 on the baseline)

## Next

FP8 for the head matmul.