Skip to main content
eScholarship
Open Access Publications from the University of California

Name that state: How language affects human reinforcement learning

Creative Commons 'BY' version 4.0 license
Abstract

We describe two experiments designed to test whether the ease with which people can label features of the environment influences human reinforcement learning. The first experiment presents evidence that people are more efficient at learning to discern relevant features of a task when candidate features are easier to name. The second experiment shows that learning what action to take in a given state is easier when states have more readily nameable verbal labels, an effect that was especially pronounced in environments with more states. The interaction between CLIP, a state-of-the-art AI model trained to map images to natural language concepts, and established human RL algorithms, captures the key effects without the need to specify condition-specific parameters. These results suggest a possible role for language information in how humans represent the environment when learning from trial and error.

Main Content
For improved accessibility of PDF content, download the file to your device.
Current View