Precise control of gene expression plays fundamental roles in brain development, but the roles of chromatin regulators in neuronal connectivity have remained poorly understood. We report that depletion of the NuRD complex by in vivo RNAi and conditional knockout of the core NuRD subunit Chd4 profoundly impairs the establishment of granule neuron parallel fiber/Purkinje cell synapses in the rodent cerebellar cortex in vivo. By interfacing genome-wide sequencing of transcripts and ChIP-seq analyses, we uncover a network of repressed genes and distinct histone modifications at target gene promoters that are developmentally regulated by the NuRD complex in the cerebellum in vivo. Finally, in a targeted in vivo RNAi screen of NuRD target genes, we identify a program of NuRD-repressed genes that operate as critical regulators of presynaptic differentiation in the cerebellar cortex. Our findings define NuRD-dependent promoter decommissioning as a developmentally regulated programming mechanism that drives synaptic connectivity in the mammalian brain.