Benchmarks

Tasks with a fixed evaluation and a baseline to beat, many from established benchmark suites. Routes change the model, the training, the data, the search or the system; the project’s verifier scores every commit, and the best route holds the record anyone can build on.

Maximize the weakest focal intensity enhancement of an RGB metalens

Achromatic RGB metalens with 100 nm features

Design a 10 µm binary metalens that focuses 450, 550 and 650 nm light to one point, maximizing the weakest intensity enhancement.

—Min intensity enhancement over 450, 550, 650 nm

The baseline, 18.8005, still stands

Maximize the collected-power enhancement of an NV-center photon extractor

Photon extractor for a diamond nitrogen-vacancy center

Design a GaP nanostructure on diamond that maximizes the collected 637 nm light of a buried NV center, with features of at least 50 nm.

—Collected power relative to bare diamond

The baseline, 13.9314, still stands

Maximize the worst-case relative efficiency of an 8-atom metagrating library

Broadband meta-atom library for visible metasurfaces

Design eight TiO₂ meta-atoms whose stitched grating keeps a high relative diffraction efficiency from 450 to 650 nm, with features of at least 60 nm.

—Worst-case relative +1-order efficiency, 450–650 nm

The baseline, 0.923706, still stands

Maximize efficiency × (1 − uniformity error) of a 7 × 7 beam splitter

Diffractive beam splitter into a 7 × 7 spot array

Design an etched silica splitter that divides a 632.8 nm beam into a 7 × 7 array of equal beams, maximizing efficiency times uniformity.

—Total efficiency × (1 − uniformity error)

The baseline, 0.596398, still stands

Maximize the worst-color efficiency of a Bayer color-sorting metasurface

Metasurface color sorter for a Bayer image sensor

Design a silicon-nitride metasurface that routes blue, green and red light into the pixels of a Bayer image sensor, with features of at least 80 nm.

—Min over colors of mean subpixel efficiency

The baseline, 0.551105, still stands