enharmonic · visualiser · GitHub

Scoreboard

How enharmonic's spellers compare with published pitch spellers, dataset by dataset. Lab results, snapshot of 18 November 2026 (our spellers at commit eb2acb8); the numbers are still moving.

Every speller gets the same MIDI notes, without key signatures, and every note is scored by the same three-tier scorer:

Exact
spelled as the composer wrote it.
Flipped
a coherent transposition: part of a passage spelled consistently on the other enharmonic side (D♭ major read as C♯ major), the same music shifted by a comma. Not an error.
Wrong
breaks the spelling of the notes around it (C♯–F–G♯ for C♯–E♯–G♯). The bars below rank by this.

By dataset

SpellerExact %Flipped %Wrong %Wrong notesNote

Across datasets

DatasetTwo-pass wrong %Best other spellerits wrong %Two-pass rank
All datasets
DatasetTwo-pass wrong %Best other spellerits wrong %Two-pass rank

The held-out sets (ASAP, OpenScore lieder, all DCML corpora pooled, and four fresh sets gathered after our spellers were built) are harder than Meredith: no speller reaches its Meredith accuracy there, so compare the rankings, not the absolute figures with published ones. Each set keeps only the pieces every speller completed: Temperley's program fails on a few pieces per set, and those are removed from every row. PSE was not run on them.

Our four spellers

A ladder: each rung adds one idea to the one before.

Read with care