Singlet fission, the spin-allowed photophysical process converting an excited singlet state into two triplet states, has attracted significant attention for device applications. Research so far has focused mainly on the understanding of singlet fission in pure materials, yet blends offer the promise of a controlled tuning of intermolecular interactions, impacting singlet fission efficiencies. Here we report a study of singlet fission in mixtures of pentacene with weakly interacting spacer molecules. Comparison of experimentally determined stationary optical properties and theoretical calculations indicates a reduction of charge-transfer interactions between pentacene molecules with increasing spacer molecule fraction. Theory predicts that the reduced interactions slow down singlet fission in these blends, but surprisingly we find that singlet fission occurs on a timescale comparable to that in pure crystalline pentacene. We explain the observed robustness of singlet fission in such mixed films by a mechanism of exciton diffusion to hot spots with closer intermolecular spacings.