Playing Technique Recognition by Joint Time–Frequency Scattering - HAL-SHS - Sciences de l'Homme et de la Société Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Playing Technique Recognition by Joint Time–Frequency Scattering

Résumé

Playing techniques are important expressive elements in music signals. In this paper, we propose a recognition system based on the joint time-frequency scattering transform (jTFST) for pitch evolution-based playing techniques (PETs), a group of playing techniques with monotonic pitch changes over time. The jTFST represents spectro-temporal patterns in the time-frequency domain, capturing discriminative information of PETs. As a case study, we analyse three commonly used PETs of the Chinese bamboo flute: acciacatura, portamento, and glissando, and encode their characteristics using the jTFST. To verify the proposed approach, we create a new dataset, the CBF-petsDB, containing PETs played in isolation as well as in the context of whole pieces performed and annotated by professional players. Feeding the jTFST to a machine learning classifier, we obtain F-measures of 71% for acciacatura, 59% for portamento, and 83% for glissando detection, and provide explanatory visualisations of scattering coefficients for each technique.
Fichier principal
Vignette du fichier
icassp2020-changhong_wang.pdf (1.59 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03277686 , version 1 (04-07-2021)

Identifiants

Citer

Changhong Wang, Vincent Lostanlen, Emmanouil Benetos, Elaine Chew. Playing Technique Recognition by Joint Time–Frequency Scattering. ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), May 2020, Barcelona (virtual), Spain. pp.881-885, ⟨10.1109/ICASSP40776.2020.9053474⟩. ⟨hal-03277686⟩
52 Consultations
79 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More