Advancing Transposition-Preserving Pitch Estimation in Audio Signals with Neural Network Architectures
DOI:
https://doi.org/10.54097/92s4zt92Keywords:
Transposition-Preserving Pitch Estimation; Music Information Retrieval; Attention Mechanisms.Abstract
This study addresses the challenge of transposition-preserving pitch estimation from audio signals, a critical task in music information retrieval that facilitates robust pitch recognition across varied musical transpositions. Accurate pitch estimation is foundational for applications like automated music transcription and music analysis, where maintaining the relational integrity of pitch shifts is essential. The objective of this research is to develop a neural network model capable of predicting pitch distributions from Constant-Q Transform (CQT) frames that are both original and pitch-shifted. The proposed model incorporates advanced neural architecture involving convolutional layers and transposition-preserving Toeplitz fully connected layers. Specifically, the model processes input through layer normalization and a series of 1D convolutions, integrating Squeeze-and-Excitation (SE), Convolutional Block Attention Module (CBAM), and Coordinate Attention (CA) to enhance feature recognition capabilities. This is followed by a softmax layer for classification, ensuring the model's outputs reflect the transposed relationships evident in the inputs. Experiments conducted on a comprehensive audio dataset demonstrate that the integration of attention mechanisms significantly enhances model performance, with the Coordinate Attention module proving particularly effective in spatial feature recognition. The results highlight the capability to preserve pitch information across transformations and confirm its potential in real-world applications. This study not only advances the field of music information retrieval but also establishes a framework for future developments in pitch estimation technologies.
Downloads
References
[1] Kim J.W. Automatic Music Transcription in the Deep Learning Era: Perspectives on Generative Neural Networks. New York University, 2020.
[2] Hess W. Pitch determination of speech signals: algorithms and devices. Springer Science & Business Media, 2012.
[3] Duan Z. Temperley D. Note-level Music Transcription by Maximum Likelihood Sampling. ISMIR, 2014: 181-186.
[4] Gowrishankar B.S. Bhajantri N.U. An exhaustive review of automatic music transcription techniques: Survey of music transcription techniques. International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES). IEEE, 2016: 140-152.
[5] Matsunaga T. Saito H. Multi-Layer Combined Frequency and Periodicity Representations for Multi-Pitch Estimation of Multi-Instrument Music. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024.
[6] Sigtia S. et al. An end-to-end neural network for polyphonic piano music transcription. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2016, 24(5): 927-939.
[7] Elghamrawy S.M. Ibrahim S.E. Audio signal processing and musical instrument detection using deep learning techniques. International Japan-Africa Conference on Electronics, Communications, and Computations (JAC-ECC). IEEE, 2021: 146-149.
[8] Elowsson A. Friberg A. Modeling music modality with a key-class invariant pitch chroma CNN. 2019, arXiv preprint: 1906.07145.
[9] Morrison M. Hsieh C. Pruyne N. et al. Cross-domain neural pitch and periodicity estimation. 2023, arXiv preprint: 2301.12258.
[10] Wu Y.T. Chen B. Su L. Multi-instrument automatic music transcription with self-attention-based instance segmentation. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2020, 28: 2796-2809.
[11] Gfeller B. Frank C. Roblek D. et al. SPICE: Self-supervised pitch estimation. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2020, 28: 1118-1128.
[12] Wang C. Li Z. Tang B. et al. Towards high-fidelity singing voice conversion with acoustic reference and contrastive predictive coding. 2021, arXiv preprint: 2110.04754.
[13] Riou A. Lattner S. Hadjeres G. et al. Pesto: Pitch estimation with self-supervised transposition-equivariant objective. International Society for Music Information Retrieval Conference (ISMIR 2023). 2023.
[14] Hou Q. Zhou D. Feng J. Coordinate attention for efficient mobile network design. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2021: 13713-13722.
[15] Hsu C.L. Jang J.S.R. On the improvement of singing voice separation for monaural recordings using the MIR-1K dataset. IEEE transactions on audio, speech, and language processing, 2009, 18(2): 310-319.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Highlights in Science, Engineering and Technology

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







