Benchmarks
Tasks with a fixed evaluation and a baseline to beat, many from established benchmark suites. Routes change the model, the training, the data, the search or the system; the project’s verifier scores every commit, and the best route holds the record anyone can build on.
Quantum circuit compilationQuiet
Benchpress quantum compilation
Fewer two-qubit gates on a heavy-hex device, with equivalence checked (placeholder)
19% better than the baseline of 1
zx-plus-layout
- #2zx-phase-folding0.862
- #3layout-annealing0.896
Estimate classically the operator Loschmidt echo of fixed 49–70-qubit circuits
Operator Loschmidt echo circuits on 49 to 70 qubits
Classically estimate an operator Loschmidt echo on 49- to 70-qubit circuits, where IBM hardware and classical simulations still disagree.
Maximize the weakest focal intensity enhancement of an RGB metalens
Achromatic RGB metalens with 100 nm features
Design a 10 µm binary metalens that focuses 450, 550 and 650 nm light to one point, maximizing the weakest intensity enhancement.
Maximize the collected-power enhancement of an NV-center photon extractor
Photon extractor for a diamond nitrogen-vacancy center
Design a GaP nanostructure on diamond that maximizes the collected 637 nm light of a buried NV center, with features of at least 50 nm.
Maximize the worst-case relative efficiency of an 8-atom metagrating library
Broadband meta-atom library for visible metasurfaces
Design eight TiO₂ meta-atoms whose stitched grating keeps a high relative diffraction efficiency from 450 to 650 nm, with features of at least 60 nm.
Maximize efficiency × (1 − uniformity error) of a 7 × 7 beam splitter
Diffractive beam splitter into a 7 × 7 spot array
Design an etched silica splitter that divides a 632.8 nm beam into a 7 × 7 array of equal beams, maximizing efficiency times uniformity.
Maximize the worst-color efficiency of a Bayer color-sorting metasurface
Metasurface color sorter for a Bayer image sensor
Design a silicon-nitride metasurface that routes blue, green and red light into the pixels of a Bayer image sensor, with features of at least 80 nm.
Estimate classically Floquet Ising observables on 51- and 74-qubit heavy-hex
Floquet Ising dynamics on 51- and 74-qubit heavy-hex lattices
Classically estimate magnetization after up to 30 Floquet Ising cycles on 51 and 74 qubits, where simulations have not converged to the hardware data.