What a model card will contain
No models are published yet. Each one will come with a Model Card stating:
- the task, the original architecture and what was changed;
- which data it was trained on, and the license limits that follow;
- results of every run, with confidence intervals;
- for speed, the hardware, input size and numeric precision;
- how to reproduce the result.
A number without a dataset and split says nothing, so a model without this information will not enter the catalogue.
Ablations are required
If an architecture is changed, we need to show what each change contributed. A model without these checks (ablations) is marked “no ablation – not benchmark-eligible”.
A code license does not automatically cover the weights: they follow the strictest restriction among the data used.