Accountability for mistreatment during facility-based childbirth requires valid tools to measure and compare birth experiences. We analyse the WHO 'How women are treated during facility-based childbirth' community survey to test whether items mapping the typology of mistreatment function as scales and to create brief item sets to capture mistreatment by domain. The cross-sectional community survey was conducted at up to 8 weeks post partum among women giving birth at hospitals in Ghana, Guinea, Myanmar and Nigeria. The survey contained items assessing physical abuse, verbal abuse, stigma, failure to meet professional standards, poor rapport with healthcare workers, and health system conditions and constraints. For all domains except stigma, we applied item-response theory to assess item fit and correlation within domain. We tested shortened sets of survey items for sensitivity in detecting mistreatment by domain. Where items show concordance and scale reliability ≥0.60, we assessed convergent validity with dissatisfaction with care and agreement of scale scores between brief and full versions. 2672 women answered over 70 items on mistreatment during childbirth. Reliability exceeded 0.60 in all countries for items on poor rapport with healthcare workers and in three countries for items on failure to meet professional standards; brief scales generally showed high agreement with longer versions and correlation with dissatisfaction. Brief item sets were ≥85% sensitive in detecting mistreatment in each country, over 90% for domains of physical abuse and health system conditions and constraints. Brief scales to measure two domains of mistreatment are largely comparable with longer versions and can be informative for these four distinct settings. Brief item sets efficiently captured prevalence of mistreatment in the five domains analysed; stigma items can be used and adapted in full. Item sets are suitable for confirmation by context and implementation to increase accountability and inform efforts to eliminate mistreatment during childbirth.