Using memory to accelerate planning
Skip to main content
eScholarship
Open Access Publications from the University of California

Using memory to accelerate planning

Creative Commons 'BY' version 4.0 license
Abstract

In both cognitive science and AI, planning research is characterized by a fundamental challenge: algorithms are costly. Consequently, much work concerns simplifying the required computations, or biasing them to more favourable regions of the solution space. One promising candidate for this is memory; memory is a powerful tool for guiding behaviour, especially in tandem with parametric learning models. However, a complete understanding of how these processes should and do interact in the mind remains elusive. We present statistical evidence from an extremely large dataset of chess games that memory empirically accelerates planning in the opening. In particular, we show that this interaction is rational: it is sensitive to the criticality of the given position, its popularity, and the latency since the last experience. We capture these dynamics in a normative model that integrates memory into Monte-Carlo tree search with an uncertainty-based stopping rule to emit move times.