High-quality epitaxial ferrites, such as low-damping MgAl-ferrite (MAFO), are promising nanoscale building blocks for all-oxide heterostructures driven by pure spin current. However, the impact of oxide interfaces on spin dynamics in such heterostructures remains an open question. Here, we investigate the spin dynamics and chemical and magnetic depth profiles of 15-nm-thick MAFO coherently interfaced with an isostructural 1-8-nm-thick overlayer of paramagnetic CoCr2O4 (CCO) as an all-oxide model system. Compared to MAFO without an overlayer, effective Gilbert damping in MAFO/CCO is enhanced by a factor of >3, irrespective of the CCO overlayer thickness. We attribute this damping enhancement to spin scattering at the approximately 1-nm-thick chemically disordered layer at the MAFO-CCO interface, rather than spin pumping or proximity-induced magnetism. Our results indicate that damping in ferrite-based heterostructures is strongly influenced by interfacial chemical disorder, even if the thickness of the disordered layer is a small fraction of the ferrite thickness.