Learning Adaptive Trading Strategies for Market Models
Van Oort, Colin Michael
Van Oort, Colin Michael
Citations
Altmetric:
License
0
License
DOI
Abstract
Agent-based models (ABMs) are a natural choice for understanding many sociotechnical systems. In particular, stock markets are an excellent target. The constrained space of agent interactions should simplify model development, while the wealth of data produced by real-world markets should aid in model validation and verification. Additionally, a successful agent-based market model (ABMM) could serve as a valuable tool for understanding the impacts of system redesigns and policy changes. Despite these advantages, ABMMs have remained an academic novelty for the most part.We hypothesize that two primary factors limit the usefulness of ABMMs. First, failure to capture major mechanisms present in the real world system reduces the accuracy of such models. Second, simple agents with static strategies do not display the breadth of behaviors seen in real markets.We investigate these issues through the development of a detailed ABMM. Our model features a fragmented market structure, communication infrastructure with propagation delays, realistic auction mechanisms, and more. We populate this model with a variety of hand coded strategies, which serve as a baseline, along with learned strategies created by meta-reinforcement learning.The combination of more detailed market mechanisms and more intelligent agents leads to higher quality models that may be better able to inform design and policy decisions.
Description
Graduate
Date
2021-01-01