Skip to main content
eScholarship
Open Access Publications from the University of California

Estimating the Entropy Rate of Finite Markov Chains With Application to Behavior Studies

  • Author(s): Vegetabile, BG
  • Stout-Oswald, SA
  • Davis, EP
  • Baram, TZ
  • Stern, HS
  • et al.
Abstract

© 2019 AERA. Predictability of behavior is an important characteristic in many fields including biology, medicine, marketing, and education. When a sequence of actions performed by an individual can be modeled as a stationary time-homogeneous Markov chain the predictability of the individual’s behavior can be quantified by the entropy rate of the process. This article compares three estimators of the entropy rate of finite Markov processes. The first two methods directly estimate the entropy rate through estimates of the transition matrix and stationary distribution of the process. The third method is related to the sliding-window Lempel–Ziv compression algorithm. The methods are compared via a simulation study and in the context of a study of interactions between mothers and their children.

Many UC-authored scholarly publications are freely available on this site because of the UC's open access policies. Let us know how this access is important for you.

Main Content
Current View