Identifying Melodic Motifs and Stable Notes from Gestural Information in Indian Vocal Performances

Shreyas Nadkarni; Preeti Rao; Martin Clayton

doi:10.5334/tismir.211

Abstract

Manual gesture plays an important role in Indian classical singing, and one of its functions is to support, illustrate or communicate aspects of raga melody. We explore the relationship between hand movements and melodic elements in Indian classical vocal performances, using kinematic data to classify stable notes and raga‑specific phrases. Our findings reveal consistent gestural patterns across singers, with potential applications in gesture-based music analysis.

References

Chiu, S.‑T. (1991). Bandwidth selection for kernel density estimation. Annals of Statistics, 19(4), 1883–1905.
Back to article
Clayton, M. (2005). Communication in Indian raga performance. In D. Miell, D. J. Hargreaves, & R. MacDonald (Eds.), Musical Communication (pp. 361–381). Oxford University Press.
Back to article
Clayton, M. (2007). Time, gesture and attention in a khyāl performance. Asian Music, 38(2), 71–96.
Back to article
Clayton, M., Li, J., Clarke, A., and Weinzierl, M. (2024). Hindustani raga and singer classification using 2D and 3D pose estimation from video recordings. Journal of New Music Research, 53(1), 1–16.
Back to article
Clayton, M., Rao, P., Shikarpur, N., Roychowdhury, S., and Li, J. (2022). Raga classification from vocal performances using multimodal analysis. In Proceedings of the 23rd International Society for Music Information Retrieval Conference, ISMIR, Bengaluru, India, pp. 283–290.
Back to article
Ganguli, K. K., and Rao, P. (2021). A study of variability in raga motifs in performance contexts. Journal of New Music Research, 50, 1–15.
Back to article
Ganguli, K. K., and Rao, P. (2018). On the distributional representation of ragas: Experiments with allied raga pairs. Journal of New Music Research, 47(1), 79–95.
Back to article
Jenkins, T., and Pouw, W. (2023). Gesture–speech coupling in persons with aphasia: A kinematic‑acoustic analysis. Journal of Experimental Psychology: General, 152(5), 1469–1483.
Back to article
Kulkarni, S. (2017). Shyamrao Gharana (Vol. 1). Prism Books Pvt. Ltd.
Back to article
Leante, L. (2009). The lotus and the king: Imagery, gesture and meaning in a Hindustani rāg. Ethnomusicology Forum, 18(2), 185–206.
Back to article
Leante, L. (2013). Gesture and imagery in music performance: Perspectives from North Indian classical music. In The Routledge Companion to Music and Visual Culture (pp. 145–152). Routledge.
Back to article
Leante, L. (2018). The cuckoo’s song: Imagery and movement in monsoon ragas. In I. Rajamani, M. Pernau, and K. R. B. Schofield (Eds.), Monsoon Feelings: A History of Emotions in the Rain. Niyogi Books.
Back to article
Meert, W., Hendrickx, K., Craenendonck, T. V., and Robberechts, P. (2016). Dtaidistance (Version v2).
Back to article
Müller, M. (2015). Fundamentals of Music Processing. Springer.
Back to article
Nadkarni, S., Roychowdhury, S., Rao, P., and Clayton, M. (2023). Exploring the correspondence of melodic contour with gesture in raga alap singing. In Proceedings of the 24th International Society for Music Information Retrieval Conference, ISMIR, Milan, Italy, pp. 1–8.
Back to article
Paschalidou, S. (2022). Effort inference and prediction by acoustic and movement descriptors in interactions with imaginary objects during dhrupad vocal improvisation. Wearable Technologies, 3, e14.
Back to article
Pearson, L. (2013). Gesture and the sonic event in Karnatak music. Empirical Musicology Review, 8(1), 2–14.
Back to article
Pearson, L., and Pouw, W. (2022). Gesture–vocal coupling in Karnatak music performance: A neuro‑bodily distributed aesthetic entanglement. Annals of the New York Academy of Sciences, 1515(1), 219–236.
Back to article
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., and Duchesnay, E. (2011). Scikit‑learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825–2830.
Back to article
Rahaim, M. (2012). Musicking Bodies: Gesture and Voice in Hindustani Music. Wesleyan University Press.
Back to article
Rao, S., and van der Meer, W. (2012). Music in motion, the automatic transcription system for Indian music. https://autrimncpa.wordpress.com/about/.
Back to article
Shokoohi‑Yekta, M., Hu, B., Jin, H., Wang, J., and Keogh, E. (2017). Generalizing DTW to the multi‑dimensional case requires an adaptive approach. Data Mining and Knowledge Discovery, 31, 1–31.
Back to article
Vidwans, A., Ganguli, K., and Rao, P. (2012). Classification of Indian classical vocal styles from melodic contours. In Proceedings of the 2nd CompMusic Workshop, Istanbul, Turkey, pp. 1–8.
Back to article

Identifying Melodic Motifs and Stable Notes from Gestural Information in Indian Vocal Performances

Abstract

Paradigm

My account