Designing Collective Experience: A Research-through-Design Framework for Gameful Multisensory Interaction

Authors

  • Jiuzhen Deng Parsons School of Design, The New School, New York, USA

DOI:

https://doi.org/10.54097/g08xrj69

Keywords:

Multisensorial experience design, embodied art, gameful design, affective interaction.

Abstract

This study investigates how multisensory and gameful interaction can be mobilized to shape collective embodied experiences within contemporary media environments through an interactive installation, Garden of Balloons: Synaesthetic Play and Collective Perception, which is designed around shared multisensory play. Through touch, scent, sound, and visual feedback, participants engage in collective activities that form the basis of this research-through-design (RtD) investigation. As participants move and play together, they begin to respond to one another in ways that create moments of shared attention and connection. Drawing observations, video recordings, and participant reflections, this study reflects these moments and derives a set of design principles for future multisensory and gameful experiences. At a time when many everyday interactions take place through screens and digital platforms, the findings suggest that multisensory gameful systems can create opportunities for people to pay attention to one another and share experiences in the same space. Moreover, interactive art becomes more than a medium for expression. It can also provide moments for people to connect, participate, and experience a sense of togetherness.

Downloads

Download data is not yet available.

References

[1] Dourish P. Where the action is: The foundations of embodied interaction. MIT Press, 2001.

[2] Deutsch T. Synaesthesia and synergy in art: Gustav Mahler’s Symphony No. 2 visualization. In: Advances in multimedia modeling. Springer, 2012: 117–126.

[3] Hansen MBN. Affect as medium, or the “digital-facial-image.” Journal of Visual Culture, 2003, 2(2): 205–228.

[4] Papacharissi Z. Affective publics and structures of storytelling: Sentiment, events and mediality. Information, Communication & Society, 2016, 19(3): 307–324.

[5] Li J. Artistic synaesthesia and cross-border theater design: Cirque du Soleil’s KA. In: Proceedings of the International Conference on Art, Social Science, and Education (ICASSEE 2020). Atlantis Press, 2020.

[6] Curwen J, Delannoy J, Ward J. Music-colour synaesthesia: Sensorimotor features and synaesthetic experience. In: Proceedings of CIM22. University of Edinburgh, 2022.

[7] Gallagher S. Interpretations of embodied cognition. In: Tschacher W, Bergomi C, eds. The implications of embodiment: Cognition and communication. Imprint Academic, 2011: 59–70.

[8] Filimon L. Syncretism and synaesthesia in music: Unification of arts and perceptions. Artes Journal of Musicology, 2023, 19(1): 85–99.

[9] Manning E. Wondering the world directly—or, how movement outruns the subject. Body & Society, 2014, 20(3–4): 162–188.

[10] Piquero Álvarez L. Sound, silence, resonance, and embodiment: Choreographic synaesthesia. Idea Journal, 2020, 17(2): 215–229.

[11] Gallese V. Mirror neurons, embodied simulation, and the neural basis of social identification. Psychoanalytic Dialogues, 2009, 19(5): 519–536.

[12] Anderson B. Affective atmospheres. Emotion, Space and Society, 2009, 2(2): 77–81.

[13] Massumi B. The autonomy of affect. Cultural Critique, 1995, 31: 83–109.

[14] Deterding S. Gamification: Designing for motivation. Interactions, 2012, 19(4): 14–17.

[15] Isbister K. Connecting through play. Interactions, 2016, 23(4): 26–33.

[16] Csikszentmihalyi M. Creativity: Flow and the psychology of discovery and invention. HarperCollins, 1996.

[17] Sun T, Huang X. FlowJam: Augmented experience design for participatory musical engagement. In: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. ACM, 2025.

[18] Brennan T. The transmission of affect. Cornell University Press, 2004.

[19] Murgia E. Teaching synaesthesia as a gateway to creativity. Enhancement: The Interdisciplinary Research Journal, 2015, 2(2).

[20] Fischer-Lichte E. The transformative power of performance: A new aesthetics. Routledge, 2008.

[21] Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology, 2006, 3(2): 77–101.

[22] Frayling C. Research in art and design. Royal College of Art Research Papers, 1993, 1(1): 1–5.

[23] Höök K, Löwgren J. Strong concepts: Intermediate-level knowledge in interaction design research. ACM Transactions on Computer-Human Interaction, 2012, 19(3): 1–18.

Downloads

Published

25-08-2026

Issue

Section

Articles

How to Cite

Deng, J. (2026). Designing Collective Experience: A Research-through-Design Framework for Gameful Multisensory Interaction. Academic Journal of Management and Social Sciences, 17(1), 43-53. https://doi.org/10.54097/g08xrj69