Abstract Background The use of opioid medications as treatment for chronic non-cancer pain remains controversial. Little information is currently available regarding healthcare providers' attitudes and beliefs about this practice among older adults. This study aimed to describe primary care providers' experiences and attitudes towards, as well as perceived barriers and facilitators to prescribing opioids as a treatment for chronic pain among older adults. Methods Six focus groups were conducted with a total of 23 physicians and three nurse practitioners from two academically affiliated primary care practices and three community health centers located in New York City. Focus groups were audiotape recorded and transcribed. The data were analyzed using directed content analysis; NVivo software was used to assist in the quantification of identified themes. Results Most participants (96%) employed opioids as therapy for some of their older patients with chronic pain, although not as first-line therapy. Providers cited multiple barriers, including fear of causing harm, the subjectivity of pain, lack of education, problems converting between opioids, and stigma. New barriers included patient/family member reluctance to try an opioid and concerns about opioid abuse by family members/caregivers. Studies confirming treatment benefit, validated tools for assessing risk and/or dosing for comorbidities, improved conversion methods, patient education, and peer support could facilitate opioid prescribing. Participants voiced greater comfort using opioids in the setting of delivering palliative or hospice care versus care of patients with chronic pain, and expressed substantial frustration managing chronic pain. Conclusions Providers perceive multiple barriers to prescribing opioids to older adults with chronic pain, and use these medications cautiously. Establishing the long-term safety and efficacy of these medications, generating improved prescribing methods, and implementing provider and patient educational interventions could help to improve the management of chronic pain in later life.