Arbeitspapier
Reinforcement learning in financial markets - a survey
The advent of reinforcement learning (RL) in financial markets is driven by several advantages inherent to this field of artificial intelligence. In particular, RL allows to combine the "prediction" and the "portfolio construction" task in one integrated step, thereby closely aligning the machine learning problem with the objectives of the investor. At the same time, important constraints, such as transaction costs, market liquidity, and the investor's degree of risk-aversion, can be conveniently taken into account. Over the past two decades, and albeit most attention still being devoted to supervised learning methods, the RL research community has made considerable advances in the finance domain. The present paper draws insights from almost 50 publications, and categorizes them into three main approaches, i.e., critic-only approach, actor-only approach, and actor-critic approach. Within each of these categories, the respective contributions are summarized and reviewed along the representation of the state, the applied reward function, and the action space of the agent. This cross-sectional perspective allows us to identify recurring design decisions as well as potential levers to improve the agent's performance. Finally, the individual strengths and weaknesses of each approach are discussed, and directions for future research are pointed out.
- Sprache
-
Englisch
- Erschienen in
-
Series: FAU Discussion Papers in Economics ; No. 12/2018
- Klassifikation
-
Wirtschaft
- Thema
-
financial markets
reinforcement learning
survey
trading systems
machine learning
- Ereignis
-
Geistige Schöpfung
- (wer)
-
Fischer, Thomas G.
- Ereignis
-
Veröffentlichung
- (wer)
-
Friedrich-Alexander-Universität Erlangen-Nürnberg, Institute for Economics
- (wo)
-
Nürnberg
- (wann)
-
2018
- Handle
- Letzte Aktualisierung
-
10.03.2025, 11:43 MEZ
Datenpartner
ZBW - Deutsche Zentralbibliothek für Wirtschaftswissenschaften - Leibniz-Informationszentrum Wirtschaft. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Objekttyp
- Arbeitspapier
Beteiligte
- Fischer, Thomas G.
- Friedrich-Alexander-Universität Erlangen-Nürnberg, Institute for Economics
Entstanden
- 2018
Ähnliche Objekte (12)
Deep reinforcement learning in agent based financial market simulation
Machine learning in financial markets
Hacking Reinforcement Learning
Reinforcement learning - lecture 2
Reinforcement learning - lecture 1
Reinforcement learning - lecture 4
Reinforcement learning - lecture 3
Self-adjusting reinforcement learning
Latent Space Reinforcement Learning
Risk-averse reinforcement learning
Stable deep reinforcement learning
Biologically plausible Reinforcement Learning
Deep reinforcement learning in agent based financial market simulation
Machine learning in financial markets
Hacking Reinforcement Learning
Reinforcement learning - lecture 2
Reinforcement learning - lecture 1
Reinforcement learning - lecture 4
Reinforcement learning - lecture 3
Self-adjusting reinforcement learning
Latent Space Reinforcement Learning
Risk-averse reinforcement learning
Stable deep reinforcement learning
Biologically plausible Reinforcement Learning
Deep reinforcement learning in agent based financial market simulation
Machine learning in financial markets
Hacking Reinforcement Learning
Reinforcement learning - lecture 2
Reinforcement learning - lecture 1
Reinforcement learning - lecture 4
Reinforcement learning - lecture 3
Self-adjusting reinforcement learning
Latent Space Reinforcement Learning
Risk-averse reinforcement learning
Stable deep reinforcement learning