Hierarchical Planning with Deep Reinforcement Learning for 3D Navigation of Microrobots in Blood Vessels
Designing intelligent microrobots that can autonomously navigate and perform instructed routines in blood vessels, a crowded environment with complexities including Brownian disturbance, concentrated cells, confinement, different flow patterns, and diverse vascular geometries, can offer enormous opportunities and challenges in biomedical applications. Herein, a biological‐agent mimicking a hierarchical control scheme that enables a microrobot to efficiently navigate and execute customizable routines in simplified blood vessel environments is reported. The control scheme consists of two decoupled components: a high‐level controller decomposing complex navigation tasks into short‐ranged, simpler subtasks and a low‐level deep reinforcement learning (DRL) controller responsible for maneuvering microrobots to accomplish subtasks. The proposed DRL controller utilizes 3D convolutional neural networks and is capable of learning control policies directly from raw 3D sensory data. It is shown that such a control scheme achieves effective and robust decision‐making within unseen, diverse complicated environments and offers flexibility for customizable task routines. This study provides a proof of principle for designing intelligent control systems for autonomous navigation in vascular networks for microrobots.
- Standort
-
Deutsche Nationalbibliothek Frankfurt am Main
- Umfang
-
Online-Ressource
- Sprache
-
Englisch
- Erschienen in
-
Hierarchical Planning with Deep Reinforcement Learning for 3D Navigation of Microrobots in Blood Vessels ; day:26 ; month:09 ; year:2022 ; extent:10
Advanced intelligent systems ; (26.09.2022) (gesamt 10)
- Urheber
-
Yang, Yuguang
Bevan, Michael A.
Li, Bo
- DOI
-
10.1002/aisy.202200168
- URN
-
urn:nbn:de:101:1-2022092715123417985692
- Rechteinformation
-
Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
- Letzte Aktualisierung
- 15.08.2025, 07:21 MESZ
Datenpartner
Dieses Objekt wird bereitgestellt von:
Deutsche Nationalbibliothek.
Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Beteiligte
- Yang, Yuguang
- Bevan, Michael A.
- Li, Bo
Ähnliche Objekte (12)
Micro/Nano Motor Navigation and Localization via Deep Reinforcement Learning
Efficient Navigation of Colloidal Robots in an Unknown Environment via Deep Reinforcement Learning
Ultrasound Microrobots with Reinforcement Learning
Wirtschaftspolitische Rahmenbedingungen und ausländische Direktinvestitionen in der VR China
Technology Transfer and Early Industrial Development: Evidence from the Sino-Soviet Alliance
Behavioral heterogeneity and financial markets: Locked/crossed quotes under informationally efficient pricing
Brownian Cargo Capture in Mazes via Intelligent Colloidal Microrobot Swarms
Bifurcation analysis of a two-dimensional discrete Hindmarsh–Rose type model
A general framework for analyzing tumor subclonality using SNP array and DNA sequencing data
Population coding of valence in the basolateral amygdala
Infection-induced cascading failures – impact and mitigation
Blow-up rates and uniqueness of entire large solutions to a semilinear elliptic equation with nonlinear convection term
Micro/Nano Motor Navigation and Localization via Deep Reinforcement Learning
Efficient Navigation of Colloidal Robots in an Unknown Environment via Deep Reinforcement Learning
Ultrasound Microrobots with Reinforcement Learning
Wirtschaftspolitische Rahmenbedingungen und ausländische Direktinvestitionen in der VR China
Technology Transfer and Early Industrial Development: Evidence from the Sino-Soviet Alliance
Behavioral heterogeneity and financial markets: Locked/crossed quotes under informationally efficient pricing
Brownian Cargo Capture in Mazes via Intelligent Colloidal Microrobot Swarms
Bifurcation analysis of a two-dimensional discrete Hindmarsh–Rose type model
A general framework for analyzing tumor subclonality using SNP array and DNA sequencing data
Population coding of valence in the basolateral amygdala
Infection-induced cascading failures – impact and mitigation
Blow-up rates and uniqueness of entire large solutions to a semilinear elliptic equation with nonlinear convection term
Micro/Nano Motor Navigation and Localization via Deep Reinforcement Learning
Efficient Navigation of Colloidal Robots in an Unknown Environment via Deep Reinforcement Learning
Ultrasound Microrobots with Reinforcement Learning
Wirtschaftspolitische Rahmenbedingungen und ausländische Direktinvestitionen in der VR China
Technology Transfer and Early Industrial Development: Evidence from the Sino-Soviet Alliance
Behavioral heterogeneity and financial markets: Locked/crossed quotes under informationally efficient pricing
Brownian Cargo Capture in Mazes via Intelligent Colloidal Microrobot Swarms
Bifurcation analysis of a two-dimensional discrete Hindmarsh–Rose type model
A general framework for analyzing tumor subclonality using SNP array and DNA sequencing data
Population coding of valence in the basolateral amygdala
Infection-induced cascading failures – impact and mitigation