© 2017, Springer-Verlag GmbH Germany, part of Springer Nature. Grazing and topography have drastic effects on plant communities and soil properties. These effects are thought to influence arbuscular mycorrhizal (AM) fungi. However, the simultaneous impacts of grazing pressure (sheep ha−1) and topography on plant and soil factors and their relationship to the production of extra-radical AM hyphae are not well understood. Our 10-year study assessed relationships between grazing, plant species richness, aboveground plant productivity, soil nutrients, edaphic properties, and AM hyphal length density (HLD) in different topographic areas (flat or sloped). We found HLD linearly declined with increasing grazing pressure (1.5–9.0 sheep ha−1) in sloped areas, but HLD was greatest at moderate grazing pressure (4.5 sheep ha−1) in flat areas. Structural equation modeling indicates grazing reduces HLD by altering soil nutrient dynamics in sloped areas, but non-linearly influences HLD through plant community and edaphic changes in flat areas. Our findings highlight how topography influences key plant and soil factors, thus regulating the effects of grazing pressure on extra-radical hyphal production of AM fungi in grasslands. Understanding how grazing and topography influence AM fungi in semi-arid grasslands is vital, as globally, severe human population pressure and increasing demand for food aggravate the grazing intensity in grasslands.