Using portfolio analysis and individual detailed case studies, we studied the energy performance and drivers of energy use in 51 high-performance office buildings in the U.S., Europe, China, and other parts of Asia. Portfolio analyses revealed that actual site energy use intensity (EUI) of the study buildings varied by a factor of as much as 11, indicating significant variation in real energy use in HPBs worldwide. Nearly half of the buildings did not meet the American Society of Heating, Refrigerating, and Air Conditioning Engineers (ASHRAE) Standard 90.1-2004 energy target, raising questions about whether a building’s certification as high performing accurately indicates that a building is energy efficient and suggesting that improvement in the design and operation of HPBs is needed to realize their energy-saving potential. We studied the influence of climate, building size, and building technologies on building energy performance and found that although all are important, none are decisive factors in building energy use. EUIs were widely scattered in all climate zones. There was a trend toward low energy use in small buildings, but the correlation was not absolute; some small HPBs exhibited high energy use, and some large HPBs exhibited low energy use. We were unable to identify a set of efficient technologies that correlated directly to low EUIs. In two case studies, we investigated the influence of occupant behavior as well as operation and maintenance on energy performance and found that both play significant roles in realizing energy savings. We conclude that no single factor determines the actual energy performance of HPBs, and adding multiple efficient technologies does not necessarily improve building energy performance; therefore, an integrated design approach that takes account of climate, technology, occupant behavior, and operations and maintenance practices should be implemented to maximize energy savings in HPBs. These findings are intended to help architects, engineers, operators, and policy makers improve the design and operation of HPBs.