© 2019, The Author(s). Diamond hosts optically active color centers with great promise in quantum computation, networking, and sensing. Realization of such applications is contingent upon the integration of color centers into photonic circuits. However, current diamond quantum optics experiments are restricted to single devices and few quantum emitters because fabrication constraints limit device functionalities, thus precluding color center integrated photonic circuits. In this work, we utilize inverse design methods to overcome constraints of cutting-edge diamond nanofabrication methods and fabricate compact and robust diamond devices with unique specifications. Our design method leverages advanced optimization techniques to search the full parameter space for fabricable device designs. We experimentally demonstrate inverse-designed photonic free-space interfaces as well as their scalable integration with two vastly different devices: classical photonic crystal cavities and inverse-designed waveguide-splitters. The multi-device integration capability and performance of our inverse-designed diamond platform represents a critical advancement toward integrated diamond quantum optical circuits.