Detecting transitions in manual tasks from wearables: an unsupervised labeling approach
Abstract: Authoring protocols for manual tasks such as following recipes, manufacturing processes or laboratory experiments requires significant effort. This paper presents a system that estimates individual procedure transitions from the user’s physical movement and gestures recorded with inertial motion sensors. Combined with egocentric or external video recordings, this facilitates efficient review and annotation of video databases. We investigate different clustering algorithms on wearable inertial sensor data recorded on par with video data, to automatically create transition marks between task steps. The goal is to match these marks to the transitions given in a description of the workflow, thus creating navigation cues to browse video repositories of manual work. To evaluate the performance of unsupervised algorithms, the automatically-generated marks are compared to human expert-created labels on two publicly-available datasets. Additionally, we tested the approach on a novel dataset in a manufacturing lab environment, describing an existing sequential manufacturing process. The results from selected clustering methods are also compared to some supervised methods
- Standort
-
Deutsche Nationalbibliothek Frankfurt am Main
- Umfang
-
Online-Ressource
- Sprache
-
Englisch
- Schlagwort
-
Autorensystem
Benutzerführung
- Ereignis
-
Veröffentlichung
- (wo)
-
Freiburg
- (wer)
-
Universität
- (wann)
-
2018
- Urheber
- DOI
-
10.3390/informatics5020016
- URN
-
urn:nbn:de:bsz:25-freidok-161821
- Rechteinformation
-
Kein Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
- Letzte Aktualisierung
-
15.08.2025, 07:23 MESZ
Datenpartner
Deutsche Nationalbibliothek. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Beteiligte
Entstanden
- 2018
Ähnliche Objekte (12)
Detecting derogatory compounds – an unsupervised approach
Detecting derogatory compounds – an unsupervised approach
Riemannian Flows for Supervised and Unsupervised Geometric Image Labeling
Unsupervised Data Labeling on Graphs by Self‐Assignment Flows
Unsupervised learning of prototypical fillers for implicit semantic role labeling
Mining mathematical documents for question answering via unsupervised formula labeling
Detecting insurance fraud using supervised and unsupervised machine learning
Detecting clinical medication errors with AI enabled wearable cameras
Detecting phenotype-driven transitions in regulatory network structure
Unsupervised learning-based approach for detecting 3D edges in depth maps
Detecting genomic deletions from high-throughput sequence data with unsupervised learning
Detecting epileptic seizures with multimodal non-EEG data from wearables
Detecting derogatory compounds – an unsupervised approach
Detecting derogatory compounds – an unsupervised approach
Riemannian Flows for Supervised and Unsupervised Geometric Image Labeling
Unsupervised Data Labeling on Graphs by Self‐Assignment Flows
Unsupervised learning of prototypical fillers for implicit semantic role labeling
Mining mathematical documents for question answering via unsupervised formula labeling
Detecting insurance fraud using supervised and unsupervised machine learning
Detecting clinical medication errors with AI enabled wearable cameras
Detecting phenotype-driven transitions in regulatory network structure
Unsupervised learning-based approach for detecting 3D edges in depth maps
Detecting genomic deletions from high-throughput sequence data with unsupervised learning
Detecting epileptic seizures with multimodal non-EEG data from wearables
Detecting derogatory compounds – an unsupervised approach
Detecting derogatory compounds – an unsupervised approach
Riemannian Flows for Supervised and Unsupervised Geometric Image Labeling
Unsupervised Data Labeling on Graphs by Self‐Assignment Flows
Unsupervised learning of prototypical fillers for implicit semantic role labeling
Mining mathematical documents for question answering via unsupervised formula labeling
Detecting insurance fraud using supervised and unsupervised machine learning
Detecting clinical medication errors with AI enabled wearable cameras
Detecting phenotype-driven transitions in regulatory network structure
Unsupervised learning-based approach for detecting 3D edges in depth maps
Detecting genomic deletions from high-throughput sequence data with unsupervised learning