Visual Reinforcement Learning for Dynamic Object Detection
Abstract. Object detection is a widely studied task in computer vision. Current methods often focus on images captured from appropriate viewpoints. However, there is a large disparity between objects observed from different viewpoints in the real world. Dynamic Object Detection (DOD) method automatically adjusts the camera viewpoint in a visual scene to sequentially find optimal viewpoints. Currently, the DOD tasks are usually modeled as a sequential decision-making problem and solved using reinforcement learning methods. Existing approaches face challenges with sparse rewards and training instability. To tackle these issues, we proposed a single-step reward function and a lightweight network, respectively. The single-step reward function, which provides timely feedback, gives an efficient training process for DOD tasks. The lightweight network with few parameters can ensure the stability of the training process. To evaluate the effectiveness of our method, we developed a simulation dataset based on UE4, which consists of 1800 training images and 450 testing images. The dataset includes five object categories: vans, cars, trailers, box trucks and SUVs. Experiments demonstrate that our method outperforms SOTA object detectors on our simulation dataset. Specifically, the average precisions (APs) are improved from 89.1% to 96.0% when using the YOLOv8 object detector.
- Standort
-
Deutsche Nationalbibliothek Frankfurt am Main
- Umfang
-
Online-Ressource
- Sprache
-
Englisch
- Erschienen in
-
Visual Reinforcement Learning for Dynamic Object Detection ; volume:XLVIII-1-2024 ; year:2024 ; pages:679-684 ; extent:6
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences ; XLVIII-1-2024 (2024), 679-684 (gesamt 6)
- Urheber
-
Wang, Xiangsheng
Hu, Xikun
Zhong, Ping
- DOI
-
10.5194/isprs-archives-XLVIII-1-2024-679-2024
- URN
-
urn:nbn:de:101:1-2405160450059.887378759625
- Rechteinformation
-
Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
- Letzte Aktualisierung
- 14.08.2025, 10:45 MESZ
Datenpartner
Deutsche Nationalbibliothek. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Beteiligte
- Wang, Xiangsheng
- Hu, Xikun
- Zhong, Ping
Ähnliche Objekte (12)
Dynamic YOLO for small underwater object detection
Multi-scale coupled attention for visual object detection
Dynamic human–object interaction detection for feature exclusion in visual simultaneous localization and mapping (SLAM)
Conditional random fields for detection of visual object classes
Analysis and improvement of the visual object detection pipeline
Conditional random fields for detection of visual object classes
Thermal 3D mapping for object detection in dynamic scenes
CISO: Co-iteration semi-supervised learning for visual object detection
Deep Adversarial Reinforcement Learning for Object Disentangling
Visual reinforcement shapes eye movements in visual search
Modeling for part-based visual object detection based on local features
Modeling for part-based visual object detection based on local features
Dynamic YOLO for small underwater object detection
Multi-scale coupled attention for visual object detection
Dynamic human–object interaction detection for feature exclusion in visual simultaneous localization and mapping (SLAM)
Conditional random fields for detection of visual object classes
Analysis and improvement of the visual object detection pipeline
Conditional random fields for detection of visual object classes
Thermal 3D mapping for object detection in dynamic scenes
CISO: Co-iteration semi-supervised learning for visual object detection
Deep Adversarial Reinforcement Learning for Object Disentangling
Visual reinforcement shapes eye movements in visual search
Modeling for part-based visual object detection based on local features
Modeling for part-based visual object detection based on local features
Dynamic YOLO for small underwater object detection
Multi-scale coupled attention for visual object detection
Dynamic human–object interaction detection for feature exclusion in visual simultaneous localization and mapping (SLAM)
Conditional random fields for detection of visual object classes
Analysis and improvement of the visual object detection pipeline
Conditional random fields for detection of visual object classes
Thermal 3D mapping for object detection in dynamic scenes
CISO: Co-iteration semi-supervised learning for visual object detection
Deep Adversarial Reinforcement Learning for Object Disentangling
Visual reinforcement shapes eye movements in visual search
Modeling for part-based visual object detection based on local features