---
issue: 3
status: working
tags: training
---
# small-distilled

Distil the pretrained model into a quarter of its size.

## What happened

- Started.

## Next

Most of the F1 at a fifth of the cost.