Growing urban populations and deteriorating infrastructure are driving unprecedented demands for concrete, a material for which there is no alternative that can meet its functional capacity. The production of concrete, more particularly the hydraulic cement that glues the material together, is one of the worlds largest sources of greenhouse gas (GHG) emissions. While this is a well-studied source of emissions, the consequences of efficient structural design decisions on mitigating these emissions are not yet well known. Here, we show that a combination of manufacturing and engineering decisions have the potential to reduce over 76% of the GHG emissions from cement and concrete production, equivalent to 3.6 Gt CO2-eq lower emissions in 2100. The studied methods similarly result in more efficient utilization of resources by lowering cement demand by up to 65%, leading to an expected reduction in all other environmental burdens. These findings show that the flexibility within current concrete design approaches can contribute to climate mitigation without requiring heavy capital investment in alternative manufacturing methods or alternative materials.