The Lanzhou reach of the Yellow River, located at the upstream of Lanzhou, has been contaminated by heavy metals and polycyclic aromatic hydrocarbons over a long-time. We hypothesized that indigenous microbial communities would remediate those contaminants and some unique populations could play an important role in this process. In this study, we investigated the sediment microbial community structure and function from the Lanzhou reach. Sediment samples were collected from two nearby sites (site A and site B) in the Lanzhou reach along the Yellow River. Sediment geochemical property data showed that site A sediment samples contained significantly (p < 0.05) higher heavy metals than site B, such as chromium (Cr), manganese (Mn), and copper (Cu). Both site A and B samples were incubated with or without hexavalent chromium (Cr (VI)) for 30 days in the laboratory, and Cr (VI) reduction was only observed in site A sediment samples. After incubation, MiSeq sequencing of 16S rRNA gene amplicons revealed that the phylogenetic composition and structure of microbial communities changed in both samples, and especially Proteobacteria, as the most abundant phylum increased from 45.1 % to 68.2 % in site A, and 50.1 % to 71.3 % in site B, respectively. Some unique OTUs and populations affiliated with Geobacter, Clostridium, Desulfosporosinus and Desulfosporosinus might be involved in Cr (VI) reduction in site A. Furthermore, GeoChip 4.0 (a comprehensive functional gene array) data showed that genes involved in carbon and nitrogen cycling and metal resistance significantly (p < 0.05) increased in site A sediment samples. All the results indicated that indigenous sediment microbial communities might be able to remediate contaminants like Cr (VI), and this information provides possible strategies for future bioremediation of the Lanzhou reach.