Versions

A Version is a code variant an Experiment produced. When the run has a Runner, each Version runs your Script and is scored against your Metrics, so you can compare it with the Baseline and with other Versions. Code generation and execution have separate statuses: a generated Version is not a tested one.

The Versions table

Switch between the Table and Graphs views. The table lists every Version against the Baseline, with its Composite score, its per-Metric results (for example XXH32_MBps or XXH64_MBps) and their change against the Baseline. The strongest Version is marked Best. Choose which columns to show and filter the Versions by name.

The Composite score is how the run ranks Versions against the Baseline, and higher is better. Model-judged Metrics can feed into it as well as measured ones, so it is not a percentage speed-up and not proof of correctness. Read the per-Metric results before you draw conclusions.

A single Version

Open a Version to see its Approach, the Code it changed, its Metrics against the Baseline, and the Logs of its runs. Step through Versions with the previous and next controls.

From a Version, or from its row in the table:

• Run this version runs it again for a fresh measurement.
• Create PR opens the Version's Branch, where you review the diff, verify it and open the Pull Request.
• Download zip or Download Git patch takes the change away as a file.

Run baseline re-measures the unmodified code, and the new measurements join the Baseline's series.