Have a personal or library account? Click to login
MTD: A Multimodal Dataset of Musical Themes for MIR Research Cover
Open Access
|Oct 2020

Figures & Tables

tismir-3-1-68-g1.png
Figure 1

The BM book and various derived data modalities from MTD. (a) Original book. (b) Clean sheet music engraving of a musical theme. (c) Piano roll representation. (d) Alignment data. (e) Waveform of audio snippet.

Table 1

Categorization of theme/melody retrieval scenarios, according to modalities.

QueryDatabaseExample Literature
symbolicsymbolicKornstädt (1998)
audiosymbolicPrechelt and Typke (2001)
symbolicaudioBalke et al. (2016)
audioaudioSalamon et al. (2013)
tismir-3-1-68-g2.png
Figure 2

Various themes from the MTD. (a) Beethoven: Symphony No. 5 in C minor, Op. 67, first movement (piano transcription), first theme. (b) Beethoven: Piano Sonata No. 2 in A major, Op. 2, No. 2, first movement, second theme. (c) Schubert: Piano Sonata in B♭ major, D 960, first movement, second theme. (d) Debussy: Reflets dans l’eau (Images, Book 1, L 110, No. 1), two themes.

tismir-3-1-68-g3.png
Figure 3

Various bar graphs for metadata of the themes. Numbers of themes on horizontal axes (logarithmic) are shown per (a) composer (non-bold numbers after the slash indicate total number of themes in BM book), (b) theme instrumentation, (c) work instrumentation, and (d) ensemble type.

Table 2

Overview of all metadata contained in the MTD.

FieldDescription
MTDIDIdentifier, used in the MTD
BMIDIdentifier, from original BM book
EDMIDIdentifier, used in the EDM
ComposerIDIdentifier, based on composer’s name
WorkIDIdentifier, usually based on catalog number
PerformanceIDIdentifier, based on main performer of recording
CollectionIDIdentifier, based on album collection
LabelIDIdentifier, based on recording label
WCMIDInternal ID for audio recording
MusicBrainzIDMusicBrainz release ID for album collection
ComposerBirthComposer’s year of birth
ComposerDeathComposer’s year of death
WorkTitleSub-title, nickname, or non-numeric title for musical work
ThemeLabelBMLabel for theme, from original BM book
ThemeInstrumentsInstrument (s) playing the theme
WorkInstrumentsInstrument (s) of the musical work
EnsembleEnsemble type
PolyphonyIndication of musical texture
NameCDCD name in album collection
NameTrackTrack name in the CD of the album collection
StartTimeStart time of theme occurence in audio recording
EndTimeEnd time of theme occurence in audio recording
MidiTranspositionPitch transposition difference between recording and symbolic encoding
CommentTextual comment
tismir-3-1-68-g4.png
Figure 4

Dataset overview. (a) Main statistics of dataset. Average information (Ø) given as mean ± standard deviation. (b) Histogram of theme durations in quarter notes and (c) in seconds.

tismir-3-1-68-g5.png
Figure 5

Time signatures in the MTD.

Table 3

Overview of the MTD directory structure.

DirectoryDescriptionFormat
data_EDM-orig_CSVOriginal EDM filesCSV
data_EDM-orig_IMGPDF
data_EDM-orig_MIDMIDI
data_EDM-corr_CSVCorrected EDM filesCSV
data_EDM-corr_IMGPDF
data_EDM-corr_MIDMIDI
data_EDM-alig_CSVAligned EDM filesCSV
data_EDM-alig_MIDMIDI
data_SCORE_CSVSCORE filesCSV
data_SCORE_IMGPDF
data_SCORE_MIDMIDI
data_SCORE_SIBSibelius
data_SCORE_XMLMusicXML
data_ALIGNMENTAlignment dataCSV
data_AUDIOAudio snippetsWAV
data_METAMetadataJSON
tismir-3-1-68-g6.png
Figure 6

Screenshots of our web-based interfaces. (a) Overview table of web page. (b) Subpage for the theme with MTD ID 1066. (c) Jupyter notebook. (d) Alignment tool.

DOI: https://doi.org/10.5334/tismir.68 | Journal eISSN: 2514-3298
Language: English
Submitted on: Jul 23, 2020
Accepted on: Sep 21, 2020
Published on: Oct 21, 2020
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2020 Frank Zalkow, Stefan Balke, Vlora Arifi-Müller, Meinard Müller, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.