Detecting transitions in manual tasks from wearables: an unsupervised labeling approach
Abstract: Authoring protocols for manual tasks such as following recipes, manufacturing processes or laboratory experiments requires significant effort. This paper presents a system that estimates individual procedure transitions from the user’s physical movement and gestures recorded with inertial motion sensors. Combined with egocentric or external video recordings, this facilitates efficient review and annotation of video databases. We investigate different clustering algorithms on wearable inertial sensor data recorded on par with video data, to automatically create transition marks between task steps. The goal is to match these marks to the transitions given in a description of the workflow, thus creating navigation cues to browse video repositories of manual work. To evaluate the performance of unsupervised algorithms, the automatically-generated marks are compared to human expert-created labels on two publicly-available datasets. Additionally, we tested the approach on a novel dataset in a manufacturing lab environment, describing an existing sequential manufacturing process. The results from selected clustering methods are also compared to some supervised methods
- Location
-
Deutsche Nationalbibliothek Frankfurt am Main
- Extent
-
Online-Ressource
- Language
-
Englisch
- Keyword
-
Autorensystem
Benutzerführung
- Event
-
Veröffentlichung
- (where)
-
Freiburg
- (who)
-
Universität
- (when)
-
2018
- DOI
-
10.3390/informatics5020016
- URN
-
urn:nbn:de:bsz:25-freidok-161821
- Rights
-
Kein Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
- Last update
-
25.03.2025, 1:52 PM CET
Data provider
Deutsche Nationalbibliothek. If you have any questions about the object, please contact the data provider.
Associated
Time of origin
- 2018
Other Objects (12)
Detecting derogatory compounds – an unsupervised approach
Detecting derogatory compounds – an unsupervised approach
Riemannian Flows for Supervised and Unsupervised Geometric Image Labeling
Detecting insurance fraud using supervised and unsupervised machine learning
Unsupervised learning of prototypical fillers for implicit semantic role labeling
Mining mathematical documents for question answering via unsupervised formula labeling
Detecting epileptic seizures with multimodal non-EEG data from wearables
Detecting tonic-clonic seizures in multimodal biosignal data from wearables: methodology design and validation
Detecting gravitational waves from cosmological phase transitions with LISA: an update
Detecting operation regimes using unsupervised clustering with infected group labelling to improve machine diagnostics and prognostics
Manipulating Deformable Linear Objects: Characteristics in Force Signals for Detecting Contact State Transitions
Unsupervised learning : 21.03.1999 - 26.03.1999
Detecting derogatory compounds – an unsupervised approach
Detecting derogatory compounds – an unsupervised approach
Riemannian Flows for Supervised and Unsupervised Geometric Image Labeling
Detecting insurance fraud using supervised and unsupervised machine learning
Unsupervised learning of prototypical fillers for implicit semantic role labeling
Mining mathematical documents for question answering via unsupervised formula labeling
Detecting epileptic seizures with multimodal non-EEG data from wearables
Detecting tonic-clonic seizures in multimodal biosignal data from wearables: methodology design and validation
Detecting gravitational waves from cosmological phase transitions with LISA: an update
Detecting operation regimes using unsupervised clustering with infected group labelling to improve machine diagnostics and prognostics
Manipulating Deformable Linear Objects: Characteristics in Force Signals for Detecting Contact State Transitions
Unsupervised learning : 21.03.1999 - 26.03.1999
Detecting derogatory compounds – an unsupervised approach
Detecting derogatory compounds – an unsupervised approach
Riemannian Flows for Supervised and Unsupervised Geometric Image Labeling
Detecting insurance fraud using supervised and unsupervised machine learning
Unsupervised learning of prototypical fillers for implicit semantic role labeling
Mining mathematical documents for question answering via unsupervised formula labeling
Detecting epileptic seizures with multimodal non-EEG data from wearables
Detecting tonic-clonic seizures in multimodal biosignal data from wearables: methodology design and validation
Detecting gravitational waves from cosmological phase transitions with LISA: an update
Detecting operation regimes using unsupervised clustering with infected group labelling to improve machine diagnostics and prognostics
Manipulating Deformable Linear Objects: Characteristics in Force Signals for Detecting Contact State Transitions