Lysine Nɛ-acylations, such as acetylation or succinylation, are post-translational modifications that regulate protein function. In mitochondria, lysine acylation is predominantly non-enzymatic, and only a specific subset of the proteome is acylated. Coenzyme A (CoA) can act as an acyl group carrier via a thioester bond, but what controls the acylation of mitochondrial lysines remains poorly understood. Using published datasets, here we found that proteins with a CoA-binding site are more likely to be acetylated, succinylated, and glutarylated. Using computational modeling, we show that lysine residues near the CoA-binding pocket are highly acylated compared to those farther away. We hypothesized that acyl-CoA binding enhances acylation of nearby lysine residues. To test this hypothesis, we co-incubated enoyl-CoA hydratase short chain 1 (ECHS1), a CoA-binding mitochondrial protein, with succinyl-CoA and CoA. Using mass spectrometry, we found that succinyl-CoA induced widespread lysine succinylation and that CoA competitively inhibited ECHS1 succinylation. CoA-induced inhibition at a particular lysine site correlated inversely with the distance between that lysine and the CoA-binding pocket. Our study indicated that CoA acts as a competitive inhibitor of ECHS1 succinylation by binding to the CoA-binding pocket. Together, this suggests that proximal acylation at CoA-binding sites is a primary mechanism for lysine acylation in the mitochondria.