Speaker trait characterization in web videos: Uniting speech, language, and facial features

Conference paper | Konferenzbeitrag

We present a multi-modal approach to speaker characterization using acoustic, visual and linguistic features. Full realism is provided by evaluation on a database of real-life web videos and automatic feature extraction including face and eye detection, and automatic speech recognition. Different segmentations are evaluated for the audio and video streams, and the statistical relevance of Linguistic Inquiry and Word Count (LIWC) features is confirmed. In the result, late multimodal fusion delivers 73, 92 and 73% average recall in binary age, gender and race classification on unseen test subjects, outperforming the best single modalities for age and race.

Object Details

• ISBN: 978-1-4799-0356-6
• ISSN: 2379-190X
• Extent: Seite(n): 3647-3651
• Language: Englisch
• Notes: Status: Veröffentlichungsversion; begutachtet (peer reviewed) ; 38. International Conference on Acoustics, Speech and Signal Processing (ICASSP 2013). Vancouver, 2013

References and Relationships

• Bibliographic citation: Proceedings of the 38th International Conference on Acoustics, Speech and Signal Processing (ICASSP 2013)

Classification and Topics

• Subject: Naturwissenschaften ; Naturwissenschaften, Technik(wissenschaften), angewandte Wissenschaften ; Video ; Video-Clip ; Aufzeichnung ; Computerlinguistik ; Internet ; Evaluation ; Soziale Medien ; Experiment ; audiovisuelle Medien

Contributors, Places and Time

• Event: Geistige Schöpfung
• (who): Weninger, Felix ; Wagner, Claudia ; Wöllmer, Martin ; Schuller, Björn ; Morency, Louis-Philipp
• Event: Veröffentlichung
• (who): IEEE
• (where): Vereinigte Staaten von Amerika
• (when): 2013

Further information

• DOI: https://doi.org/10.1109/ICASSP.2013.6638338
• URN: urn:nbn:de:0168-ssoar-66084-2
• Rights: GESIS - Leibniz-Institut für Sozialwissenschaften. Bibliothek Köln
• Last update: 21.06.2024, 4:26 PM CEST