Cyanobacteria are highly abundant in the marine photic zone and primary drivers of the conversion of inorganic carbon into biomass. To date, all studied cyanobacterial lineages encode carbon fixation machinery relying upon form I Rubiscos within a CO2-concentrating carboxysome. Here, we report that the uncultivated anoxic marine zone (AMZ) IB lineage of Prochlorococcus from pelagic oxygen-deficient zones (ODZs) harbors both form I and form II Rubiscos, the latter of which are typically noncarboxysomal and possess biochemical properties tuned toward low-oxygen environments. We demonstrate that these cyanobacterial form II enzymes are functional in vitro and were likely acquired from proteobacteria. Metagenomic analysis reveals that AMZ IB are essentially restricted to ODZs in the Eastern Pacific, suggesting that form II acquisition may confer an advantage under low-O2 conditions. AMZ IB populations express both forms of Rubisco in situ, with the highest form II expression at depths where oxygen and light are low, possibly as a mechanism to increase the efficiency of photoautotrophy under energy limitation. Our findings expand the diversity of carbon fixation configurations in the microbial world and may have implications for carbon sequestration in natural and engineered systems.