Text‐to‐Haptics: Enhancing Multisensory Storytelling through Emotionally Congruent Midair Haptics

In multisensory storytelling, the integration of touch, sound, speech, and visual elements plays a crucial role in enhancing the narrative immersion and audience engagement. In light of this, this article presents a scalable and intelligent hybrid artificial intelligence (AI) method that uses emotional text analysis for deciding when and what midair haptics to display alongside audiovisual content generated by latent stable diffusion methods. Then, a user study involving 40 participants is described, the results of which suggest that the proposed approach enhances the audience level of engagement as they experience a short AI‐generated multisensory (audio–visual–haptic) story.

Angaben zum Objekt

• Standort: Deutsche Nationalbibliothek Frankfurt am Main
• Umfang: Online-Ressource
• Sprache: Englisch

Verweise und Beziehungen

• Erschienen in: Text‐to‐Haptics: Enhancing Multisensory Storytelling through Emotionally Congruent Midair Haptics ; day:15 ; month:12 ; year:2024 ; extent:14 ; Advanced intelligent systems ; (15.12.2024) (gesamt 14)

Beteiligte, Orts- und Zeitangaben

• Urheber: Stroinski, Maciej ; Kwarciak, Kamil ; Kowalewski, Mateusz ; Hemmerling, Daria ; Frier, William ; Georgiou, Orestis

Weitere Informationen

• DOI: 10.1002/aisy.202400758
• URN: urn:nbn:de:101:1-2412161307320.998556248129
• Rechteinformation: Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
• Letzte Aktualisierung: 15.08.2025, 07:30 MESZ