Infrared-responsive doped metal oxide nanocrystals are an emerging class of plasmonic materials whose localized surface plasmon resonances (LSPR) can be resonant with molecular vibrations. This presents a distinctive opportunity to manipulate light-matter interactions to redirect chemical or spectroscopic outcomes through the strong local electric fields they generate. Here we report a technique for measuring single nanocrystal absorption spectra of doped metal oxide nanocrystals, revealing significant spectral inhomogeneity in their mid-infrared LSPRs. Our analysis suggests dopant incorporation is heterogeneous beyond expectation based on a statistical distribution of dopants. The broad ensemble linewidths typically observed in these materials result primarily from sample heterogeneity and not from strong electronic damping associated with lossy plasmonic materials. In fact, single nanocrystal spectra reveal linewidths as narrow as 600 cm(-1) in aluminium-doped zinc oxide, a value less than half the ensemble linewidth and markedly less than homogeneous linewidths of gold nanospheres.