Fragile X syndrome (FXS) is a neurodevelopmental disorder that causes intellectual disability. It is a leading known genetic cause of autism. In addition to cognitive, social, and communication deficits, humans with FXS demonstrate abnormal sensory processing including sensory hypersensitivity. Sensory hypersensitivity commonly manifests as auditory, tactile, or visual defensiveness or avoidance. Clinical, behavioral, and electrophysiological studies consistently show auditory hypersensitivity, impaired habituation to repeated sounds, and reduced auditory attention in humans with FXS. Children with FXS also exhibit significant visuospatial impairments. Studies in infants and toddlers with FXS have documented impairments in processing texture-defined motion stimuli, temporal flicker, perceiving ordinal numerical sequence, and the ability to maintain the identity of dynamic object information during occlusion. Consistent with the observations in humans with FXS, fragile X mental retardation 1 ( Fmr1) gene knockout (KO) rodent models of FXS also show seizures, abnormal visual-evoked responses, auditory hypersensitivity, and abnormal processing at multiple levels of the auditory system, including altered acoustic startle responses. Among other sensory symptoms, individuals with FXS exhibit tactile defensiveness. Fmr1 KO mice also show impaired encoding of tactile stimulation frequency and larger size of receptive fields in the somatosensory cortex. Since sensory deficits are relatively more tractable from circuit mechanisms and developmental perspectives than more complex social behaviors, the focus of this review is on clinical, functional, and structural studies that outline the auditory, visual, and somatosensory processing deficits in FXS. The similarities in sensory phenotypes between humans with FXS and animal models suggest a likely conservation of basic sensory processing circuits across species and may provide a translational platform to not just develop biomarkers but also to understand underlying mechanisms. We argue that preclinical studies in animal models of FXS can facilitate the ongoing search for new therapeutic approaches in FXS by understanding mechanisms of basic sensory processing circuits and behaviors that are conserved across species.