- Main
Sycophantic Chatbots Cause Delusional Spiraling, Even in Ideal Bayesians
Abstract
"Delusional spiraling'' is a form of AI-induced psychosis, an emerging phenomenon where AI chatbot users find themselves dangerously confident in outlandish beliefs. This phenomenon is popularly attributed to "sycophancy,'' chatbots' well-documented bias towards validating users' claims. But an explanation of why sycophancy should cause delusional spirals---and why they occur only rarely, but seriously---has not been forthcoming. Here we take a theoretical and computational approach to probing the causal link between sycophancy and delusional spiraling. We propose a simple Bayesian model of a user conversing with a chatbot, and formalize notions of sycophancy and delusional spiraling in that model. We then show that in this model, even an ideal Bayesian user is vulnerable to delusional spiraling, and that sycophancy plays a causal role. Furthermore, this effect persists despite two candidate mitigations: preventing chatbots from hallucinating false claims, and informing users of AI sycophancy. The full paper is available at .