Critical scholarship on geographical indications (GIs) has increasingly focused upon their role in fostering development in the Global South. Recent work has drawn welcome attention to issues of governance and sparked new debates about the role of the state in GI regulation. We argue that this new emphasis needs to be coupled with a greater focus upon local social relations of power and interlinked issues of social justice. Rather than see GI regimes as apolitical technical administrative frameworks, we argue that they govern emerging public goods that should be forged to redress extant forms of social inequality and foster the inclusion of marginalized actors in commodity value chains. In many areas of the world, this will entail close attention to the historical specificities of colonial labor relations and their neocolonial legacies, which have entrenched conditions of racialized and gendered dispossession, particularly in plantation economies. Using examples from South Africa and South Asia, we illustrate how GIs conventionally reify territories in a fashion that obscures and/or naturalizes exploitative conditions of labor and unequal access to land based resources, which are legacies of historical disenfranchisement. Like other forms of neoliberal governmentality that support private governance for public ends, however, GIs might be shaped to support new forms of social justice. We show how issues of labor and place-based livelihoods increasingly influence new policy directions within Fair Trade agendas while concerns with “decolonizing” agricultural governance now animate certification initiatives emerging from new social movements. Both initiatives provide models for shaping the governance and regulation of GIs in projects of rural territorial development that encompass principles of rights-based development to further social movements for rural social justice.