Desert dust accounts for a large fraction of shortwave radiation absorbed by aerosols, which adds to the climate warming produced by greenhouse gases. However, it remains uncertain exactly how much shortwave radiation dust absorbs. Here, we leverage in-situ measurements of dust single-scattering albedo to constrain absorption at mid-visible wavelength by North African dust, which accounts for approximately half of the global dust. We find that climate and chemical transport models overestimate North African dust absorption aerosol optical depth (AAOD) by up to a factor of two. This occurs primarily because models overestimate the dust imaginary refractive index, the effect of which is partially masked by an underestimation of large dust particles. Similar factors might contribute to an overestimation of AAOD retrieved by the Aerosol Robotic Network, which is commonly used to evaluate climate and chemical transport models. The overestimation of dust absorption by models could lead to substantial biases in simulated dust impacts on the Earth system, including warm biases in dust radiative effects.