Over-application of nitrogen (N) and phosphorus (P), and insufficient supply of potassium (K), have been considered as reasons for restriction of yield increases in North China Plain. Field experiments were conducted to evaluate the effects of nutrient management on yield, nutrient uptake and utilization in Shanxi, Hebei, Shandong and Henan provinces, where the typical winter wheat–summer maize rotation system in North Central China is practiced. The results indicated that improved nutrient management by balanced fertilization based on soil testing and target yield (the optimum treatment, OPT) optimized grain yield, nutrient uptake and nutrient use efficiency compared with those for farmer’s practice (FP). By adoption of our improved nutrient management strategy, yield increased by 0.8–13.7% for wheat and 5.8–18.5% for maize separately and, moreover, N and P input declined by 13% (266 kg N ha–1) and 45% (430 kg P2O5 ha–1), and K input increased by 43% (265 kg K2O ha–1) at the four sites over the FP. The OPT increased partial factor productivity of nitrogen (PFPN) and agronomic efficiency of nitrogen (AEN) at all sites with the exception of Shandong where N rates were generally higher than elsewhere, and improved nitrogen recovery efficiency (REN) across all four sites in this study. The results from this study demonstrated that there is still need and great potential to improve PFPN, AEN and REN further in this intensive winter wheat–summer maize rotation system.