---
issue: 4
status: working
tags: systems
---
# flex-attention-window

FlexAttention with a growing sliding window.

## What happened

- Started.

## Next

FP8 for the head matmul.