Despite great interest in using magnetic resonance imaging (MRI) for studying the effects of genes on brain structure in humans, current approaches have focused almost entirely on predefined regions of interest and had limited success. Here, we used multivariate methods to define a single neuroanatomical score of how William's Syndrome (WS) brains deviate structurally from controls. The score is trained and validated on measures of T1 structural brain imaging in two WS cohorts (training, n = 38; validating, n = 60). We then associated this score with single nucleotide polymorphisms (SNPs) in the WS hemi-deleted region in five cohorts of neurologically and psychiatrically typical individuals (healthy European descendants, n = 1863). Among 110 SNPs within the 7q11.23 WS chromosomal region, we found one associated locus (p = 5e-5) located at GTF2IRD1, which has been implicated in animal models of WS. Furthermore, the genetic signals of neuroanatomical scores are highly enriched locally in the 7q11.23 compared with summary statistics based on regions of interest, such as hippocampal volumes (n = 12,596), and also globally (SNP-heritability = 0.82, se = 0.25, p = 5e-4). The role of genetic variability in GTF2IRD1 during neurodevelopment extends to healthy subjects. Our approach of learning MRI-derived phenotypes from clinical populations with well-established brain abnormalities characterized by known genetic lesions may be a powerful alternative to traditional region of interest-based studies for identifying genetic variants regulating typical brain development.