© 2016 Author(s). While methanol and ethanol are macroscopically miscible with water, their mixtures exhibit negative excess entropies of mixing. Despite considerable effort in both experiment and theory, there remains significant disagreement regarding the origin of this effect. Different models for the liquid mixture structure have been proposed to address this behavior, including the enhancement of the water hydrogen bonding network around the alcohol hydrophobic groups and microscopic immiscibility or clustering. We have investigated mixtures of methanol, ethanol, and isopropanol with water by liquid microjet X-ray absorption spectroscopy on the oxygen K-edge, an atom-specific probe providing details of both inter- and intra-molecular structure. The measured spectra evidence a significant enhancement of hydrogen bonding originating from the methanol and ethanol hydroxyl groups upon the addition of water. These additional hydrogen bonding interactions would strengthen the liquid-liquid interactions, resulting in additional ordering in the liquid structures and leading to a reduction in entropy and a negative enthalpy of mixing, consistent with existing thermodynamic data. In contrast, the spectra of the isopropanol-water mixtures exhibit an increase in the number of broken alcohol hydrogen bonds for mixtures containing up to 0.5 water mole fraction, an observation consistent with existing enthalpy of mixing data, suggesting that the measured negative excess entropy is a result of clustering or micro-immiscibility.