The phytohormone auxin triggers root growth inhibition within seconds via a non-transcriptional pathway. Among members of the TIR1/AFB auxin receptor family, AFB1 has a primary role in this rapid response. However, the unique features that confer this specific function have not been identified. Here we show that the N-terminal region of AFB1, including the F-box domain and residues that contribute to auxin binding, is essential and sufficient for its specific role in the rapid response. Substitution of the N-terminal region of AFB1 with that of TIR1 disrupts its distinct cytoplasm-enriched localization and activity in rapid root growth inhibition by auxin. Importantly, the N-terminal region of AFB1 is indispensable for auxin-triggered calcium influx, which is a prerequisite for rapid root growth inhibition. Furthermore, AFB1 negatively regulates lateral root formation and transcription of auxin-induced genes, suggesting that it plays an inhibitory role in canonical auxin signaling. These results suggest that AFB1 may buffer the transcriptional auxin response, whereas it regulates rapid changes in cell growth that contribute to root gravitropism.