Reasoning about what other people see, know, and want is essential for navigating social life. Yet, even neurodevelopmentally healthy adults make perspective-taking errors. Here, we examined how the group membership of perspective-taking targets (ingroup vs. outgroup) affects processes underlying visual perspective-taking. In three experiments using two bases of group identity (university affiliation and minimal groups), interference from one's own differing perspective (i.e., egocentric intrusion) was stronger when responding from an ingroup versus an outgroup member's perspective. Spontaneous perspective calculation, as indexed by interference from another's visual perspective when reporting one's own (i.e., altercentric intrusion), did not differ across target group membership in any of our experiments. Process-dissociation analyses, which aim to isolate automatic processes underlying altercentric-intrusion effects, further revealed negligible effects of target group membership on perspective calculation. Meta-analytically, however, there was suggestive evidence that shared group membership facilitates responding from others' perspectives when self and other perspectives are aligned.