Chord-Color Mapping for Audio-Visual Generation: Integrating Deep Learning and Emotion Quantification
DOI:
https://doi.org/10.54097/kzmpm585Keywords:
Chord, Color, Mapping, Audiovisual GenerationAbstract
This study explores chord-color mapping as a means of enhancing AI-driven audio-visual art. Addressing the longstanding lack of systematic analysis of the emotional connection between chords and colors, we propose a model that integrates deep learning and emotion quantification. The model establishes a "color-emotion-chord" pathway by leveraging image color features and a chord dataset with emotional labels, trained using an LSTM architecture for emotion-driven audio-visual generation. Evaluations demonstrate the model’s ability to substantially enhance emotional expression and aesthetic appeal while preserving essential image information. This research contributes new methodologies for cross-sensory art, music therapy, interactive design, and art education.
Downloads
References
[1] Shen, L. (2022). Audiovisual Dynamics: Intellectual Construction and Artistic Evolution of Music–Image Association (Master’s thesis). China Academy of Art.
[2] Zheng, R. (2011). Harmonic Functions and Their Acoustic Principles. Huangzhong (Journal of Wuhan Conservatory of Music), (04), 105–113.
[3] Li, R. (2018). A Study on the Scientific Basis of Musical Harmony (Master’s thesis). Shanxi University.
[4] Jin, Y., & Zhou, F. (2022). Synesthetic Expression Elements of Audiovisual Interaction Design in Musical Performance. Art Research, (02), 95–98.
[5] Han, D., & Zhao, H. (2009). Color Synesthesia and Emotional Recognition in Conceptual Integration. Foreign Language Research, (1), 40–43.
[6] Eaton, J. (1999). The Art of Color. Beijing: World Book Publishing Company.
[7] Hua, C. (2012). Color Harmony. Beijing: Central Conservatory of Music Press.
[8] Guo, C., Huang, M., & Xi, Y. (2020). Effects of Primary Color Spectrum and Visual Field on Color Perception. Spectroscopy and Spectral Analysis, 40(12), 3765–3771.
[9] Wu, B., & Liang, X. (2023). Research on the Relationship Between Music and Visual Expression in Audiovisual Interactive Design. Packaging and Design, (5), 142–143.
[10] Qu, T., Huang, D., & Tong, K. (2007). A Review of Music Visualization Research. Computer Science, 34(9), 16–22.
[11] Wang, X. (2022). Research on Emotion-Based Music Visualization Technology Using EEG (Master’s thesis). Changchun University of Science and Technology.
[12] Wang, L., Du, L., & Wang, J. (2007). Music Emotion Classification Based on AdaBoost. Journal of Electronics & Information Technology, 29(9), 2067–2072.
[13] Roberts, A., Engel, J., Raffel, C., Hawthorne, C., et al. (2018). A Hierarchical Latent Vector Model for Learning Long-Term Structure in Music. arXiv preprint arXiv:1803.05428.
[14] Su, J. (2021). Research on AI Composition Practice and Theory Based on Artificial Neural Networks: A Case Study of the Keras Framework (Master’s thesis). Shanghai Conservatory of Music.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Frontiers in Computing and Intelligent Systems
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
