This perspective offers a novel approach to calculate the theoretical minimum thermal load (TMTL) for minimizing energy consumption for thermal comfort in buildings. Analysis for buildings in the United States show that current thermal load is more than one order of magnitude higher than TMTL. To realize the TMTL, this perspective proposes technology needs in the near and long term, such as advanced zonal control, radiative heating, thermal textiles, and thermal energy storage.