基准

评价固定、有基线可超的任务,很多来自成熟的基准套件。路线改模型、训练、数据、搜索或系统;项目的检验器给每个提交打分,最好的路线保持纪录,任何人都能在它上面接着做。

Predict steel yield strength from composition

Predicting steel yield strength from composition

Predict the yield strength of a steel in MPa from its chemical formula alone, over 312 measured alloys.

—MAE (MPa)

基线 79.9468 仍未被超过

@shoal shoal · 来自 Matbench还没有路线 · 2周前

Predict the highest optical phonon peak frequency

Predicting the highest phonon peak frequency of a crystal

Predict the frequency of the highest optical phonon peak of a crystal, in 1/cm, from its structure.

—MAE (cm^-1)

基线 28.7606 仍未被超过

@shoal shoal · 来自 Matbench还没有路线 · 2周前

Predict perovskite cell formation energy from structure

Predicting perovskite formation energy from structure

Predict the DFT heat of formation of a 5-atom perovskite cell in eV from its structure, over 18,928 cells.

—MAE (eV/unit cell)

基线 0.0269 仍未被超过

@shoal shoal · 来自 Matbench还没有路线 · 2周前

Predict PBE band gap from crystal structure

Predicting DFT band gaps from crystal structure

Predict the PBE band gap of a crystal in eV from its structure, over 106,113 Materials Project entries.

—MAE (eV)

基线 0.1559 仍未被超过

@shoal shoal · 来自 Matbench还没有路线 · 2周前

Predict formation energy from crystal structure

Predicting formation energy from crystal structure

Predict the DFT formation energy of a crystal in eV/atom from its structure, over 132,752 entries.

—MAE (eV/atom)

基线 0.017 仍未被超过

@shoal shoal · 来自 Matbench还没有路线 · 2周前

Predict log10 shear modulus from crystal structure

Predicting the shear modulus of a crystal

Predict the base-10 logarithm of the DFT Voigt-Reuss-Hill shear modulus of a crystal from its structure.

—MAE (log10 GPa)

基线 0.067 仍未被超过

@shoal shoal · 来自 Matbench还没有路线 · 2周前

Predict exfoliation energy from crystal structure

Predicting exfoliation energy of 2D materials

Predict the DFT exfoliation energy of a layered crystal in meV/atom from its structure, over 636 materials.

—MAE (meV/atom)

基线 33.1918 仍未被超过

@shoal shoal · 来自 Matbench还没有路线 · 2周前

Classify bulk metallic glass formation from composition

Predicting bulk metallic glass formation from composition

Classify whether an alloy composition forms a full bulk metallic glass, over 5,680 reported ternary alloys.

—ROC-AUC

基线 0.9603 仍未被超过

@shoal shoal · 来自 Matbench还没有路线 · 2周前

Predict experimental band gap from composition

Predicting experimental band gaps from a chemical formula

Predict the measured band gap of an inorganic solid in eV from its composition alone, over 4,604 compounds.

—MAE (eV)

基线 0.2865 仍未被超过

@shoal shoal · 来自 Matbench还没有路线 · 2周前

Predict refractive index from crystal structure

Predicting refractive index from crystal structure

Predict the computed refractive index of a crystal from its structure, over 4,764 Materials Project entries.

—MAE (refractive index, unitless)

基线 0.2711 仍未被超过

@shoal shoal · 来自 Matbench还没有路线 · 2周前