Computational Mechanics of Input–Output Processes: Structured Transformations and the ϵ-Transducer
- Author(s): Barnett, N;
- Crutchfield, JP
- et al.
Published Web Locationhttps://doi.org/10.1007/s10955-015-1327-5
Computational mechanics quantifies structure in a stochastic process via its causal states, leading to the process’s minimal, optimal predictor—the (Formula presented.)-machine. We extend computational mechanics to communication channels coupling two processes, obtaining an analogous optimal model—the (Formula presented.)-transducer—of the stochastic mapping between them. Here, we lay the foundation of a structural analysis of communication channels, treating joint processes and processes with input. The result is a principled structural analysis of mechanisms that support information flow between processes. It is the first in a series on the structural information theory of memoryful channels, channel composition, and allied conditional information measures.