An extreme magnetoresistance (XMR) has recently been observed in several nonmagnetic semimetals. Increasing experimental and theoretical evidence indicates that the XMR can be driven by either topological protection or electron-hole compensation. Here, by investigating the electronic structure of a XMR material, YSb, we present spectroscopic evidence for a special case which lacks topological protection and perfect electron-hole compensation. Further investigations reveal that a cooperative action of a substantial difference between electron and hole mobility and a moderate carrier compensation might contribute to the XMR in YSb.