How do we think about time? Converging lesion and neuroimaging evidence indicates that orbitofrontal cortex (OFC) supports the encoding and retrieval of temporal context in long-term memory¹, which may contribute to confabulation in individuals with OFC damage². Here, we reveal that OFC damage diminishes working memory for temporal order, that is, the ability to disentangle the relative recency of events as they unfold. OFC lesions reduced working memory for temporal order but not spatial position, and individual deficits were commensurate with lesion size. Comparable effects were absent in patients with lesions restricted to lateral prefrontal cortex (PFC). Based on these findings, we propose that OFC supports understanding of the order of events. Well-documented behavioral changes in individuals with OFC damage² may relate to impaired temporal-order understanding.