Deep Reinforcement Learning for the Navigation of Neurovascular Catheters
Abstract: Endovascular catheters are necessary for state-ofthe- art treatments of life-threatening and time-critical diseases like strokes and heart attacks. Navigating them through the vascular tree is a highly challenging task. We present our preliminary results for the autonomous control of a guidewire through a vessel phantom with the help of Deep Reinforcement Learning. We trained Deep-Q-Network (DQN) and Deep Deterministic Policy Gradient (DDPG) agents on a simulated vessel phantom and evaluated the training performance. We also investigated the effect of the two enhancements Hindsight Experience Replay (HER) and Human Demonstration (HD) on the training speed of our agents. The results show that the agents are capable of learning to navigate a guidewire from a random start point in the vessel phantom to a random goal. This is achieved with an average success rate of 86.5% for DQN and 89.6% for DDPG. The use of HER and HD significantly increases the training speed. The results are promising and future research should address more complex vessel phantoms and the use of a combination of guidewire and catheter.
- Location
-
Deutsche Nationalbibliothek Frankfurt am Main
- Extent
-
Online-Ressource
- Language
-
Englisch
- Bibliographic citation
-
Deep Reinforcement Learning for the Navigation of Neurovascular Catheters ; volume:5 ; number:1 ; year:2019 ; pages:5-8 ; extent:4
Current directions in biomedical engineering ; 5, Heft 1 (2019), 5-8 (gesamt 4)
- Creator
-
Behr, Tobias
Pusch, Tim Philipp
Siegfarth, Marius
Hüsener, Dominik
Mörschel, Tobias
Karstensen, Lennart
- DOI
-
10.1515/cdbme-2019-0002
- URN
-
urn:nbn:de:101:1-2022101214463595740280
- Rights
-
Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
- Last update
-
15.08.2025, 7:24 AM CEST
Data provider
Deutsche Nationalbibliothek. If you have any questions about the object, please contact the data provider.
Associated
- Behr, Tobias
- Pusch, Tim Philipp
- Siegfarth, Marius
- Hüsener, Dominik
- Mörschel, Tobias
- Karstensen, Lennart
Other Objects (12)
Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning
Learning navigation policies with deep reinforcement learning
Deep reinforcement learning for drone navigation using sensor data
Robotic navigation with deep reinforcement learning in transthoracic echocardiography
Autonomous Navigation with Deep Reinforcement Learning in Carla Simulator
Deep Reinforcement Learning with Heuristic Corrections for UGV Navigation
Autonomous Navigation with Deep Reinforcement Learning in CARLA Simulator
Micro/Nano Motor Navigation and Localization via Deep Reinforcement Learning
Memory-based crowd-aware robot navigation using deep reinforcement learning
Towards deep-reinforcement-learning-based navigation systems for open-path navigation in collaborative and highly dynamic environments
Efficient Navigation of Colloidal Robots in an Unknown Environment via Deep Reinforcement Learning
Model inductive bias enhanced deep reinforcement learning for robot navigation in crowded environments
Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning
Learning navigation policies with deep reinforcement learning
Deep reinforcement learning for drone navigation using sensor data
Robotic navigation with deep reinforcement learning in transthoracic echocardiography
Autonomous Navigation with Deep Reinforcement Learning in Carla Simulator
Deep Reinforcement Learning with Heuristic Corrections for UGV Navigation
Autonomous Navigation with Deep Reinforcement Learning in CARLA Simulator
Micro/Nano Motor Navigation and Localization via Deep Reinforcement Learning
Memory-based crowd-aware robot navigation using deep reinforcement learning
Towards deep-reinforcement-learning-based navigation systems for open-path navigation in collaborative and highly dynamic environments
Efficient Navigation of Colloidal Robots in an Unknown Environment via Deep Reinforcement Learning
Model inductive bias enhanced deep reinforcement learning for robot navigation in crowded environments
Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning
Learning navigation policies with deep reinforcement learning
Deep reinforcement learning for drone navigation using sensor data
Robotic navigation with deep reinforcement learning in transthoracic echocardiography
Autonomous Navigation with Deep Reinforcement Learning in Carla Simulator
Deep Reinforcement Learning with Heuristic Corrections for UGV Navigation
Autonomous Navigation with Deep Reinforcement Learning in CARLA Simulator
Micro/Nano Motor Navigation and Localization via Deep Reinforcement Learning
Memory-based crowd-aware robot navigation using deep reinforcement learning
Towards deep-reinforcement-learning-based navigation systems for open-path navigation in collaborative and highly dynamic environments
Efficient Navigation of Colloidal Robots in an Unknown Environment via Deep Reinforcement Learning