Skip to main content
eScholarship
Open Access Publications from the University of California

UCSF

UC San Francisco Previously Published Works bannerUCSF

AI scribe functions in psychiatric practice: clinical oversight, consent, and regulation

Abstract

Ambient artificial intelligence (AI) documentation tools, known as AI scribes, have entered psychiatric clinical practice, bundling at least three operations into a single workflow, without sufficient attention to the differences among them. In this Personal View, we argue that AI-generated clinical narrative (history of present illness), AI-generated clinical observation (mental status examination), and AI-generated diagnostic reasoning (assessment and plan) are functionally distinct operations that stand in qualitatively different relationships to their shared input, with distinct failure modes and oversight demands. We describe why psychiatric practice exposes these distinctions with particular clarity and examine their implications for liability, informed consent, and regulation. Psychiatry is uniquely positioned to surface distinctions among these operations because of the therapeutic and legal weight of word choice, the unnarrated structure of the mental status exam, and the formulation-driven nature of diagnostic reasoning. We offer provisional practice considerations for clinicians currently using these AI scribes and call for the field to build frameworks that reflect the different claims these AI scribes' outputs make.

Many UC-authored scholarly publications are freely available on this site because of the UC's open access policies. Let us know how this access is important for you.