Neuroanatomical, molecular, and paleontological evidence is examined in light of human brain evolution. The brain of extant humans differs from the brains of other primates in its overall size and organization, and differences in size and organization of specific cortical areas and subcortical structures implicated into complex cognition and social and emotional processing. The human brain is also characterized by functional lateralizations, reflecting specializations of the cerebral hemispheres in humans for different types of processing, facilitating fast and reliable communication between neural cells in an enlarged brain. The features observed in the adult brain reflect human-specific patterns of brain development. Compared to the brains of other primates, the human brain takes longer to mature, promoting an extended period for establishing cortical microcircuitry and its modifications. Together, these features may underlie the prolonged period of learning and acquisition of technical and social skills necessary for survival, creating a unique cognitive and behavioral niche typical of our species. The neuroanatomical findings are in concordance with molecular analyses, which suggest a trend toward heterochrony in the expression of genes implicated in different functions. These include synaptogenesis, neuronal maturation, and plasticity in humans, mutations in genes implicated in neurite outgrowth and plasticity, and an increased role of regulatory mechanisms, potentially promoting fast modification of neuronal morphologies in response to new computational demands. At the same time, endocranial casts of fossil hominins provide an insight into the timing of the emergence of uniquely human features in the course of evolution. We conclude by proposing several ways of combining comparative neuroanatomy, molecular biology and insights gained from fossil endocasts in future research.