Reproduce “Dynamic Datasets and Market Environments for Financial Reinforcement Learning” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Xiao-Yang Liu, Ziyi Xia, Hongyang Yang, Jiechao Gao, Daochen Zha, Ming Zhu, Christina Dan Wang, Zhaoran Wang and 1 more

FinRL-Meta introduces an open-source, data-centric library for deep reinforcement learning (DRL) in finance, providing dynamic datasets and standardized market environments. It significantly enhances the reproducibility and real-world applicability of DRL trading strategies, demonstrating an average 12% reduction in peak disk-head time and an estimated 17% reduction in Total Cost of Ownership compared to existing methods, along with superior cumulative returns in various trading tasks.

Key insights

  • A data-centric AI approach, combined with DataOps practices, is essential for addressing the unique challenges of dynamic financial data and bridging the 'simulation-to-reality gap' in FinRL.
  • A comprehensive, layered framework with a continuous RLOps pipeline can effectively manage the complexities of financial DRL, ensuring data quality, reproducibility, and enabling real-time deployment.
  • Integrating a diverse set of features, including a custom financial sentiment dictionary and alternative data, significantly enhances the capabilities of DRL agents in predicting and acting upon market dynamics.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.