The SARS-CoV-2 pandemic has had a deleterious impact on human health since its beginning in 2019. The purpose of this study was to examine the psychosocial impact of the COVID-19 pandemic in the Philippines and determine if there were differential impacts on women compared to men. A web-based survey was conducted in the Luzon Islands of the Philippines, during the pandemic quarantine. A total of 1879 participants completed online surveys between 28 March-12 April 2020. A bivariate analysis of both men and women for each psychological measure (stress, anxiety, depression, and impact of COVID-19) was conducted. Multivariable logistic regression models were built for each measure, dichotomized as high or low, separately for men and women. Younger age (p < 0.001), being married (p < 0.001), and being a parent (p < 0.004) were associated with women's poor mental health. Marriage and large household size are protective factors for men (p < 0.002 and p < 0.0012, respectively), but marriage may be a risk factor for women (p < 0.001). Overall, women were disproportionately negatively impacted by the pandemic compared to men.