Reinforcement Learning techniques have shown a great potential in the active allocation of stock portfolios. However, state-of-the-art solutions show limited stability and fairly high sensitivity to volatile market conditions. To tackle these issues, this paper presents a new risk-aware approach based on Deep Q-learning Networks. It leverages Quantile Regression DQNs to mitigate the underlying market risks and an action branching architecture to effectively handle high-dimensional stock spaces. Furthermore, it also introduces noise perturbations to the network’s weights aimed at self-tuning the degree of exploration for each input dimension. Based on the empirical simulations, which were carried out on the Dow Jones-30 stocks over a three-year period, the proposed system performs better than state-of-the-art RL solutions in terms of cumulative return, stability, and sharpe ratio.
A risk-aware approach to stock portfolio allocation based on Deep Q-Networks / Fior, Jacopo; Cagliero, Luca. - (2022). (Intervento presentato al convegno International Conference on Application of Information and Communication Technologies (AICT) tenutosi a Washington DC (USA) nel 12-14 October 2022) [10.1109/AICT55583.2022.10013578].
A risk-aware approach to stock portfolio allocation based on Deep Q-Networks
Jacopo Fior;Luca Cagliero
2022
Abstract
Reinforcement Learning techniques have shown a great potential in the active allocation of stock portfolios. However, state-of-the-art solutions show limited stability and fairly high sensitivity to volatile market conditions. To tackle these issues, this paper presents a new risk-aware approach based on Deep Q-learning Networks. It leverages Quantile Regression DQNs to mitigate the underlying market risks and an action branching architecture to effectively handle high-dimensional stock spaces. Furthermore, it also introduces noise perturbations to the network’s weights aimed at self-tuning the degree of exploration for each input dimension. Based on the empirical simulations, which were carried out on the Dow Jones-30 stocks over a three-year period, the proposed system performs better than state-of-the-art RL solutions in terms of cumulative return, stability, and sharpe ratio.File | Dimensione | Formato | |
---|---|---|---|
A_risk-aware_approach_to_stock_portfolio_allocation_based_on_Deep_Q-Networks.pdf
non disponibili
Tipologia:
2a Post-print versione editoriale / Version of Record
Licenza:
Non Pubblico - Accesso privato/ristretto
Dimensione
2.14 MB
Formato
Adobe PDF
|
2.14 MB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11583/2971269