Institutional barriers in HIV primary care settings can contribute substantially to disparities in retention in HIV treatment and HIV-related outcomes. This qualitative study compared the perceptions of clinic experiences of persons living with HIV (PLWH) in a Veterans Affairs HIV primary care clinic setting who were retained in care with the experiences of those who were not retained in care. Qualitative data from 25 in-depth interviews were analyzed to identify facilitators and barriers to retention in HIV care. Results showed that participants not retained in care experienced barriers to retention involving dissatisfaction with clinic wait times, low confidence in clinicians, and customer service concerns. For participants retained in care, patience with procedural issues, confidence in clinicians, and interpersonal connections were factors that enhanced retention despite the fact that these participants recognized the same barriers as those who were not retained in care. These findings can inform interventions aimed at improving retention in HIV care.