Machine‐Learned Light‐Field Camera that Reads Facial Expression from High‐Contrast and Illumination Invariant 3D Facial Images
Facial expression conveys nonverbal communication information to help humans better perceive physical or psychophysical situations. Accurate 3D imaging provides stable topographic changes for reading facial expression. In particular, light‐field cameras (LFCs) have high potential for constructing depth maps, thanks to a simple configuration of microlens arrays and an objective lens. Herein, machine‐learned NIR‐based LFCs (NIR‐LFCs) for facial expression reading by extracting Euclidean distances of 3D facial landmarks in pairwise fashion are reported. The NIR‐LFC contains microlens arrays with asymmetric Fabry−Perot filter and NIR bandpass filter on CMOS image sensor, fully packaged with two vertical‐cavity surface‐emitting lasers. The NIR‐LFC not only increases the image contrast by 2.1 times compared with conventional LFCs, but also reduces the reconstruction errors by up to 54%, regardless of ambient illumination conditions. A multilayer perceptron (MLP) classifies input vectors, consisting of 78 pairwise distances on the facial depth map of happiness, anger, sadness, and disgust, and also exhibits exceptional average accuracy of 0.85 (p<0.05). This LFC provides a new platform for quantitatively labeling facial expression and emotion in point‐of‐care biomedical, social perception, or human−machine interaction applications.
- Standort
-
Deutsche Nationalbibliothek Frankfurt am Main
- Umfang
-
Online-Ressource
- Sprache
-
Englisch
- Erschienen in
-
Machine‐Learned Light‐Field Camera that Reads Facial Expression from High‐Contrast and Illumination Invariant 3D Facial Images ; day:16 ; month:12 ; year:2021 ; extent:9
Advanced intelligent systems ; (16.12.2021) (gesamt 9)
- Urheber
-
Bae, Sang-In
Lee, Sangyeon
Kwon, Jae-Myeong
Kim, Hyun-Kyung
Jang, Kyung-Won
Lee, Doheon
Jeong, Ki-Hun
- DOI
-
10.1002/aisy.202100182
- URN
-
urn:nbn:de:101:1-2021121714062176566463
- Rechteinformation
-
Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
- Letzte Aktualisierung
-
15.08.2025, 07:32 MESZ
Datenpartner
Deutsche Nationalbibliothek. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Beteiligte
- Bae, Sang-In
- Lee, Sangyeon
- Kwon, Jae-Myeong
- Kim, Hyun-Kyung
- Jang, Kyung-Won
- Lee, Doheon
- Jeong, Ki-Hun
Ähnliche Objekte (12)
Facial reanimation by hypoglossal-facial neurorrhaphy
Facial Massager
Facial architecture
Horóscopo facial
Facial fractures
Gimnasia facial
Automatic facial analysis methods : facial point localization, head pose estimation, and facial expression recognition
The Facial Profile in the Context of Facial Aesthetics
Spatial normalization of facial thermal images using facial landmarks
Altering Facial Movements Abolishes Neural Mirroring of Facial Expressions
Cutaneous facial surgery
The facial nerve
Facial reanimation by hypoglossal-facial neurorrhaphy
Facial Massager
Facial architecture
Horóscopo facial
Facial fractures
Gimnasia facial
Automatic facial analysis methods : facial point localization, head pose estimation, and facial expression recognition
The Facial Profile in the Context of Facial Aesthetics
Spatial normalization of facial thermal images using facial landmarks
Altering Facial Movements Abolishes Neural Mirroring of Facial Expressions
Cutaneous facial surgery
The facial nerve
Facial reanimation by hypoglossal-facial neurorrhaphy
Facial Massager
Facial architecture
Horóscopo facial
Facial fractures
Gimnasia facial
Automatic facial analysis methods : facial point localization, head pose estimation, and facial expression recognition
The Facial Profile in the Context of Facial Aesthetics
Spatial normalization of facial thermal images using facial landmarks
Altering Facial Movements Abolishes Neural Mirroring of Facial Expressions
Cutaneous facial surgery