Excessive nitrogen promotes the formation of nonproductive tillers in rice, which decreases nitrogen use efficiency (NUE). Developing high-NUE rice cultivars through balancing nitrogen uptake and the formation of productive tillers remains a long-standing challenge, yet how these two processes are coordinated in rice remains elusive. Here we identify the transcription factor OsGATA8 as a key coordinator of nitrogen uptake and tiller formation in rice. OsGATA8 negatively regulates nitrogen uptake by repressing transcription of the ammonium transporter gene OsAMT3.2. Meanwhile, it promotes tiller formation by repressing the transcription of OsTCP19, a negative modulator of tillering. We identify OsGATA8-H as a high-NUE haplotype with enhanced nitrogen uptake and a higher proportion of productive tillers. The geographical distribution of OsGATA8-H and its frequency change in historical accessions suggest its adaption to the fertile soil. Overall, this study provides molecular and evolutionary insights into the regulation of NUE and facilitates the breeding of rice cultivars with higher NUE.