Text‐to‐Haptics: Enhancing Multisensory Storytelling through Emotionally Congruent Midair Haptics

In multisensory storytelling, the integration of touch, sound, speech, and visual elements plays a crucial role in enhancing the narrative immersion and audience engagement. In light of this, this article presents a scalable and intelligent hybrid artificial intelligence (AI) method that uses emotional text analysis for deciding when and what midair haptics to display alongside audiovisual content generated by latent stable diffusion methods. Then, a user study involving 40 participants is described, the results of which suggest that the proposed approach enhances the audience level of engagement as they experience a short AI‐generated multisensory (audio–visual–haptic) story.

Object Details

• Location: Deutsche Nationalbibliothek Frankfurt am Main
• Extent: Online-Ressource
• Language: Englisch

References and Relationships

• Bibliographic citation: Text‐to‐Haptics: Enhancing Multisensory Storytelling through Emotionally Congruent Midair Haptics ; day:15 ; month:12 ; year:2024 ; extent:14 ; Advanced intelligent systems ; (15.12.2024) (gesamt 14)

Contributors, Places and Time

• Creator: Stroinski, Maciej ; Kwarciak, Kamil ; Kowalewski, Mateusz ; Hemmerling, Daria ; Frier, William ; Georgiou, Orestis

Further information

• DOI: 10.1002/aisy.202400758
• URN: urn:nbn:de:101:1-2412161307320.998556248129
• Rights: Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
• Last update: 15.08.2025, 7:30 AM CEST