The Music Perception Toolbox: Analytical Methods for Pitch and Rhythm Similarity, Consonance, Complexity, and Structure

Andrew J. Milne

doi:10.5334/tismir.392

The Music Perception Toolbox: Analytical Methods for Pitch and Rhythm Similarity, Consonance, Complexity, and Structure

Transactions of the International Society for Music Information Retrieval

Volume 9 (2026): Issue 1

By: Andrew J. Milne

Open Access

|Oct 2026

Amiot, E. (2016). Music Through Fourier Space: Discrete Fourier Transform in Music Theory. Computational Music Science. Springer. 10.1007/978-3-319-45581-5.
Open DOI Search in Google Scholar Back to article
Balzano, G. J. (1982). The pitch set as a level of description for studying musical perception. In M. Clynes (Ed.), Music, Mind, and Brain: The Neuropsychology of Music (pp. 321–351). Plenum Press. 10.1007/978-1-4684-8917-0_17.
Open DOI Search in Google Scholar Back to article
Carey, N. (2002). On coherence and sameness, and the evaluation of scale candidacy claims. Journal of Music Theory, 46(1/2), 1–56. 10.1215/00222909-46-1-2-1.
Open DOI Search in Google Scholar Back to article
Carey, N. (2007). Coherence and sameness in well‑formed and pairwise well‑formed scales. Journal of Mathematics and Music, 1(2), 79–98. 10.1080/17459730701376743.
Open DOI Search in Google Scholar Back to article
Dean, R. T., Milne, A. J., and Bailes, F. (2019). Spectral pitch similarity is a predictor of perceived change in sound‑ as well as note‑based music. Music & Science, 2, 2059204319847351. 10.1177/2059204319847351.
Open DOI Search in Google Scholar Back to article
Eck, D. (2006). Identifying metrical and temporal structure with an autocorrelation phase matrix. Music Perception, 24(2), 167–176. 10.1525/MP.2006.24.2.167.
Open DOI Search in Google Scholar Back to article
Eerola, T., and Lahdelma, I. (2021). The anatomy of consonance/dissonance: Evaluating acoustic and cultural predictors across multiple datasets with chords. Music & Science, 4, 20592043211030471. 10.1177/20592043211030471.
Open DOI Search in Google Scholar Back to article
Eerola, T., and Toiviainen, P. (2004). MIR in MATLAB: The MIDI toolbox. In 5th International Conference on Music Information Retrieval. International Society for Music Information Retrieval.
Search in Google Scholar Back to article
Eitel, M., Ruth, N., Harrison, P., Frieler, K., and Müllensiefen, D. (2024). Perception of chord sequences modeled with prediction by partial matching, voice‑leading distance, and spectral pitch‑class similarity: A new approach for testing individual differences in harmony perception. Music & Science, 7, 20592043241257654. 10.1177/20592043241257654.
Open DOI Search in Google Scholar Back to article
Harrison, P. M. C., and Pearce, M. T. (2020). Simultaneous consonance in music perception and composition. Psychological Review, 127(2), 216–244. 10.1037/rev0000169.
Open DOI Search in Google Scholar Back to article
Hearne, L. M. (2020). The Cognition of Harmonic Tonality in Microtonal Scales. (Doctoral dissertation). Western Sydney University. http://hdl.handle.net/1959.7/uws:58606.
Search in Google Scholar Back to article
Hearne, L. M., Dean, R. T., and Milne, A. J. (2026). Acoustical and cultural explanations for contextual tonal stability. Music Perception, 1–23. 10.1525/mp.2026.2472336.
Open DOI Search in Google Scholar Back to article
Homer, S. T., Harley, N., and Wiggins, G. A. (2024). Modelling of musical perception using spectral knowledge representation. Journal of Cognition, 7(1), 32. 10.5334/joc.356.
Open DOI Search in Google Scholar Back to article
Huron, D. (2008). A comparison of average pitch height and interval size in major‑ and minor‑key themes: Evidence consistent with affect‑related pitch prosody. Empirical Musicology Review, 3(2), 59–63. 10.18061/1811/31941.
Open DOI Search in Google Scholar Back to article
Hutchinson, W., and Knopoff, L. (1978). The acoustic component of western consonance. Interface, 7, 1–29. 10.1080/09298217808570246.
Open DOI Search in Google Scholar Back to article
Kameoka, A., and Kuriyagawa, M. (1969). Consonance theory parts 1 and 2. The Journal of the Acoustical Society of America, 45(6), 1451–1469. 10.1121/1.1911623.
Open DOI Search in Google Scholar Back to article
Krumhansl, C. L., and Kessler, E. J. (1982). Tracing the dynamic changes in perceived tonal organization in a spatial representation of musical keys. Psychological Review, 89(4), 334–368. 10.1037/0033-295X.89.4.334.
Open DOI Search in Google Scholar Back to article
Lartillot, O., Toiviainen, P., and Eerola, T. (2008). A Matlab toolbox for music information retrieval. In C. Preisach, H. Burkhardt, L. Schmidt‑Thieme, and R. Decker (Eds.), Data Analysis, Machine Learning and Applications (pp. 261–268). Springer‑Verlag. 10.1007/978-3-540-78246-9_31.
Open DOI Search in Google Scholar Back to article
Mashinter, K. (2006). Calculating sensory dissonance: Some discrepancies arising from the models of Kameoka & Kuriyagawa, and Hutchinson & Knopoff. Empirical Musicology Review, 1(2), 65–84. 10.18061/1811/24077.
Open DOI Search in Google Scholar Back to article
Milne, A. J. (2013). A Computational Model of the Cognition of Tonality. (Doctoral dissertation). The Open University. 10.21954/ou.ro.00009783.
Open DOI Search in Google Scholar Back to article
Milne, A. J. (2019). XronoMorph: Investigating paths through rhythmic space. In S. Holland, T. Mudd, K. Wilkie‑McKenna, A. P. McPherson, and M. M. Wanderley (Eds.), New Directions in Music and Human‑Computer Interaction (pp. 95–113). Springer. 10.1007/978-3-319-92069-6_6.
Open DOI Search in Google Scholar Back to article
Milne, A. J. (2024). Commentary on Buechele, Cooke, & Berezovsky (2024): Entropic models of scales and some extensions. Empirical Musicology Review, 19(2), 144–153. 10.18061/emr.v19i2.10085.
Open DOI Search in Google Scholar Back to article
Milne, A. J., Bulger, D., and Herff, S. A. (2017). Exploring the space of perfectly balanced rhythms and scales. Journal of Mathematics and Music, 11(2–3), 101–133. 10.1080/17459737.2017.1395915.
Open DOI Search in Google Scholar Back to article
Milne, A. J., and Dean, R. T. (2016). Computational creation and morphing of multilevel rhythms by control of evenness. Computer Music Journal, 40(1), 35–53. 10.1162/COMJ_a_00343.
Open DOI Search in Google Scholar Back to article
Milne, A. J., Dean, R. T., and Bulger, D. (2023a). The effects of rhythmic structure on tapping accuracy. Attention, Perception, & Psychophysics, 85(8), 2673–2699. 10.3758/s13414-023-02778-2.
Open DOI Search in Google Scholar Back to article
Milne, A. J., and Herff, S. A. (2020). The perceptual relevance of balance, evenness, and entropy in musical rhythms. Cognition, 203, 104233. 10.1016/j.cognition.2020.104233.
Open DOI Search in Google Scholar Back to article
Milne, A. J., and Holland, S. (2016). Empirically testing voiceleading, Tonnetz, and spectral models of perceived triadic distance. Journal of Mathematics and Music, 10(1), 59–85. 10.1080/17459737.2016.1152517.
Open DOI Search in Google Scholar Back to article
Milne, A. J., Laney, R., and Sharp, D. B. (2015). A spectral pitch class model of the probe tone data and scalic tonality. Music Perception, 32(4), 364–393. 10.1525/mp.2015.32.4.364.
Open DOI Search in Google Scholar Back to article
Milne, A. J., Laney, R., and Sharp, D. B. (2016). Testing a spectral model of tonal affinity with microtonal melodies and inharmonic spectra. Musicae Scientiae, 20(4), 465–494. 10.1177/1029864915622682.
Open DOI Search in Google Scholar Back to article
Milne, A. J., Sethares, W. A., Laney, R., and Sharp, D. B. (2011). Modelling the similarity of pitch collections with expectation tensors. Journal of Mathematics and Music, 5(1), 1–20. 10.1080/17459737.2011.573678.
Open DOI Search in Google Scholar Back to article
Milne, A. J., Smit, E. A., Sarvasy, H. S., and Dean, R. T. (2023b). Evidence for a universal association of auditory roughness with musical stability. PLOS One, 18(9), e0291642. 10.1371/journal.pone.0291642.
Open DOI Search in Google Scholar Back to article
Parncutt, R. (1988). Revision of Terhardt’s psychoacoustical model of the root(s) of a musical chord. Music Perception, 6(1), 65–94. 10.2307/40285416.
Open DOI Search in Google Scholar Back to article
Parncutt, R. (2006). Commentary on Keith Mashinter’s “Calculating sensory dissonance: Some discrepancies arising from the models of Kameoka & Kuriyagawa, and Hutchinson & Knopoff”. Empirical Musicology Review, 1(4), 201–204. 10.18061/1811/24148.
Open DOI Search in Google Scholar Back to article
Pearce, M. (2018). Statistical learning and probabilistic prediction in music cognition: Mechanisms of stylistic enculturation. Annals of the New York Academy of Sciences, 1423, 378–395. 10.1111/nyas.13654.
Open DOI Search in Google Scholar Back to article
Plomp, R., and Levelt, W. J. M. (1965). Tonal consonance and critical bandwidth. The Journal of the Acoustical Society of America, 38(4), 548–560. 10.1121/1.1909741.
Open DOI Search in Google Scholar Back to article
Quinn, I. (2007). General equal‑tempered harmony: Parts two and three. Perspectives of New Music, 45(1), 4–63. 10.1353/pnm.2007.0016.
Open DOI Search in Google Scholar Back to article
Rothenberg, D. (1977). A model for pattern perception with musical applications part I: Pitch structures as order‑preserving maps. Mathematical Systems Theory, 11(1), 199–234. 10.1007/BF01768477.
Open DOI Search in Google Scholar Back to article
Sethares, W. A. (1993). Local consonance and the relationship between timbre and scale. The Journal of the Acoustical Society of America, 94(3), 1218–1228. 10.1121/1.408175.
Open DOI Search in Google Scholar Back to article
Sethares, W. A. (2005). Tuning, Timbre, Spectrum, Scale (2nd ed.). Springer Verlag. 10.1007/b138848.
Open DOI Search in Google Scholar Back to article
Sethares, W. A., Milne, A. J., Tiedje, S., Prechtl, A., and Plamondon, J. (2009). Spectral tools for Dynamic Tonality and audio morphing. Computer Music Journal, 33(2), 71–84. 10.1162/comj.2009.33.2.71.
Open DOI Search in Google Scholar Back to article
Smit, E. A., Milne, A. J., Dean, R. T., and Weidemann, G. (2019). Perception of affect in unfamiliar musical chords. PLOS One, 14(6), 1–28. 10.1371/journal.pone.0218570.
Open DOI Search in Google Scholar Back to article
Smit, E. A., Milne, A. J., Sarvasy, H. S., and Dean, R. T. (2022). Emotional responses in Papua New Guinea show negligible evidence for a universal effect of major versus minor music. PLOS One, 17(6), e0269597. 10.1371/journal.pone.0269597.
Open DOI Search in Google Scholar Back to article
Temperley, D., and Tan, D. (2013). Emotional connotations of diatonic modes. Music Perception, 30(3), 237–257. 10.1525/MP.2012.30.3.237.
Open DOI Search in Google Scholar Back to article
Tenney, J. (1988). A History of ‘Consonance’ and ‘Dissonance’. Excelsior Music.
Search in Google Scholar Back to article
Tymoczko, D. (2023). Tonality: An Owner’s Manual. Oxford University Press. 10.1093/oso/9780197577103.001.0001.
Open DOI Search in Google Scholar Back to article
Undy, C., Dean, R. T., and Milne, A. J. (2026). An algorithm for human embodiment and computational realization of familiar and novel African/clave rhythm. Leonardo, 59(3), 301–309. 10.1162/leon_a_02716.
Open DOI Search in Google Scholar Back to article