Background

School-located vaccination against influenza (SLV-I) has the potential to improve current suboptimal influenza immunization coverage for U.S. school-aged children. However, little is known about SLV-I's cost-effectiveness. The objective of this study is to establish the cost-effectiveness of SLV-I based on a two-year community-based randomized controlled trial (Year 1: 2009-2010 vaccination season, an unusual H1N1 pandemic influenza season, and Year 2: 2010-2011, a more typical influenza season).

Methods

We performed a cost-effectiveness analysis on a two-year randomized controlled trial of a Western New York SLV-I program. SLV-I clinics were offered in 21 intervention elementary schools (Year 1 n = 9,027; Year 2 n = 9,145 children) with standard-of-care (no SLV-I) in control schools (Year 1 n = 4,534 (10 schools); Year 2 n = 4,796 children (11 schools)). We estimated the cost-per-vaccinated child, by dividing the incremental cost of the intervention by the incremental effectiveness (i.e., the number of additionally vaccinated students in intervention schools compared to control schools).

Results

In Years 1 and 2, respectively, the effectiveness measure (proportion of children vaccinated) was 11.2 and 12.0 percentage points higher in intervention (40.7 % and 40.4 %) than control schools. In year 2, the cost-per-vaccinated child excluding vaccine purchase ($59.88 in 2010 US $) consisted of three component costs: (A) the school costs ($8.25); (B) the project coordination costs ($32.33); and (C) the vendor costs excluding vaccine purchase ($16.68), summed through Monte Carlo simulation. Compared to Year 1, the two component costs (A) and (C) decreased, while the component cost (B) increased in Year 2. The cost-per-vaccinated child, excluding vaccine purchase, was $59.73 (Year 1) and $59.88 (Year 2, statistically indistinguishable from Year 1), higher than the published cost of providing influenza vaccination in medical practices ($39.54). However, taking indirect costs (e.g., averted parental costs to visit medical practices) into account, vaccination was less costly in SLV-I ($23.96 in Year 1, $24.07 in Year 2) than in medical practices.

Conclusions

Our two-year trial's findings reinforced the evidence to support SLV-I as a potentially favorable system to increase childhood influenza vaccination rates in a cost-efficient way. Increased efficiencies in SLV-I are needed for a sustainable and scalable SLV-I program.

Objective

Adolescent immunization rates are suboptimal. Experts recommend provider prompts at health care visits to improve rates. We assessed the impact of either electronic health record (EHR) or nurse- or staff-initiated provider prompts on adolescent immunization rates.

Methods

We conducted a randomized controlled trial, allocating practices in 1 of 2 practice-based research networks (PBRN) to provider prompts or standard-of-care control. Ten primary care practices participated, 5 intervention and 5 controls, each matched in pairs on urban, suburban, or rural location and practice type (pediatric or family medicine), from a PBRN in Greater Rochester, New York (GR-PBRN); and 12 practices, 6 intervention, 6 controls, similarly matched, from a national pediatric continuity clinic PBRN (CORNET). The study period was 1 year per practice, ranging from June 2011 to January 2013. Study participants were adolescents 11 to 17 years attending these 22 practices; random sample of chart reviews per practice for baseline and postintervention year to assess immunization rates (n = 7,040 total chart reviews for adolescents with >1 visit in a period). The intervention was an EHR prompt (4 GR-PBRN and 5 CORNET practice pairs) (alert) that appeared on providers' computer screens at all office visits, indicating the specific immunizations that adolescents were recommended to receive. Staff prompts (1 GR-PBRN pair and 1 CORNET pair) in the form of a reminder sheet was placed on the provider's desk in the exam room indicating the vaccines due. We compared immunization rates, stratified by PBRN, for routine vaccines (meningococcus, pertussis, human papillomavirus, influenza) at study beginning and end.

Results

Intervention and control practices within each PBRN were similar at baseline for demographics and immunization rates. Immunization rates at the study end for adolescents who were behind on immunizations at study initiation were not significantly different for intervention versus control practices for any vaccine or combination of vaccines. Results were similar for each PBRN and also when only EHR-based prompts was assessed. For example, at study end, 3-dose human papillomavirus vaccination rates for GR-PBRN intervention versus control practices were 51% versus 53% (adjusted odds ratio 0.96; 95% confidence interval 0.64-1.34); CORNET intervention versus control rates were 50% versus 42% (adjusted odds ratio 1.06; 95% confidence interval 0.68-1.88).

Conclusions and relevance

In both a local and national setting, provider prompts failed to improve adolescent immunization rates. More rigorous practice-based changes are needed.

Background

Studies have noted variations in the cost-effectiveness of school-located influenza vaccination (SLIV), but little is known about how SLIV's cost-effectiveness may vary by targeted age group (e.g., elementary or secondary school students), or vaccine consent process (paper-based or web-based). Further, SLIV's cost-effectiveness may be impacted by its spillover effect on practice-based vaccination; prior studies have not addressed this issue.

Methods

We performed a cost-effectiveness analysis on two SLIV programs in upstate New York in 2015-2016: (a) elementary school SLIV using a stepped wedge design with schools as clusters (24 suburban and 18 urban schools) and (b) secondary school SLIV using a cluster randomized trial (16 suburban and 4 urban schools). The cost-per-additionally-vaccinated child (i.e., incremental cost-effectiveness ratio (ICER)) was estimated by dividing the incremental SLIV intervention cost by the incremental effectiveness (i.e., the additional number of vaccinated students in intervention schools compared to control schools). We performed deterministic analyses, one-way sensitivity analyses, and probabilistic analyses.

Results

The overall effectiveness measure (proportion of children vaccinated) was 5.7 and 5.5 percentage points higher, respectively, in intervention elementary (52.8%) and secondary schools (48.2%) than grade-matched control schools. SLIV programs vaccinated a small proportion of children in intervention elementary (5.2%) and secondary schools (2.5%). In elementary and secondary schools, the ICER excluding vaccine purchase was $85.71 and $86.51 per-additionally-vaccinated-child, respectively. When additionally accounting for observed spillover impact on practice-based vaccination, the ICER decreased to $80.53 in elementary schools -- decreasing substantially in secondary schools. (to $53.40). These estimates were higher than the published practice-based vaccination cost (median = $25.50, mean = $45.48). Also, these estimates were higher than our 2009-2011 urban SLIV program mean costs ($65) due to additional costs for use of a new web-based consent system ($12.97 per-additionally-vaccinated-child) and higher project coordination costs in 2015-2016. One-way sensitivity analyses showed that ICER estimates were most sensitive to the SLIV effectiveness.

Conclusions

SLIV raises vaccination rates and may increase practice-based vaccination in primary care practices. While these SLIV programs are effective, to be as cost-effective as practice-based vaccination our SLIV programs would need to vaccinate more students and/or lower the costs for consent systems and project coordination.

Trial registration

ClinicalTrials.gov NCT02227186 (August 25, 2014), updated NCT03137667 (May 2, 2017).

Background and objectives

Human papillomavirus (HPV) vaccination rates lag behind vaccination rates for other adolescent vaccines; a bundled intervention may improve HPV vaccination rates. Our objective is to evaluate the impact of quality improvement (QI) training plus a bundled practice-based intervention (provider prompts plus communication skills training plus performance feedback) on improving HPV vaccinations in pediatric resident continuity clinics.

Methods

Staff and providers in 8 resident clinics participated in a 12-month QI study. The intervention included training to strengthen provider communication about the HPV vaccine. Clinics also implemented provider prompts, received monthly performance feedback, and participated in learning collaborative calls. The primary outcome measure was eligible visits with vaccination divided by vaccine-eligible visits (captured HPV vaccination opportunities). Practices performed chart audits that were fed into monthly performance feedback on captured HPV vaccination opportunities. We used conditional logistic regression (conditioning on practice) to assess captured vaccination opportunities, with the time period of the study (before and after the QI intervention) as the independent variable.

Results

Overall, captured opportunities for HPV vaccination increased by 16.4 percentage points, from 46.9% to 63.3%. Special cause was demonstrated by centerline shift, with 8 consecutive points above the preintervention mean. On adjusted analyses, patients were more likely to receive a vaccine during, versus before, the intervention (odds ratio: 1.87; 95% confidence interval: 1.54-2.28). Captured HPV vaccination rates improved at both well-child and other visits (by 11.7 and 13.0 percentage points, respectively).

Conclusions

A bundled intervention of provider prompts and training in communication skills plus performance feedback increased captured opportunities for HPV vaccination.

Although autodialer centralized reminder and recall (C-R/R) from state immunization information systems (IISs) has been shown to raise childhood vaccination rates, its impact on human papillomavirus (HPV) vaccination rates is unclear. In a 4-arm pragmatic randomized controlled trial across 2 states, we randomly selected practices representative of the specialty (pediatrics, family medicine, and health center) where children received care. Within each practice, patients 11 to 17.9 years old who had not completed their HPV vaccine series (NY: N = 30 616 in 123 practices; CO: N = 31 502 in 80 practices) were randomly assigned to receive 0, 1, 2, or 3 IIS C-R/R autodialer messages per vaccine dose. We assessed HPV vaccine receipt via the IIS, calculated intervention costs, and compared HPV vaccine series initiation and completion rates across study arms. In New York, HPV vaccine initiation rates ranged from 37.0% to 37.4%, and completion rates were between 29.1% and 30.1%, with no significant differences across study arms. In Colorado, HPV vaccine initiation rates ranged from 31.2% to 33.5% and were slightly higher for 1 reminder compared with none, but vaccine completion rates, ranging from 27.0% to 27.8%, were similar. On adjusted analyses in Colorado, vaccine initiation rates were slightly higher for 1 and 3 C-R/R messages (adjusted risk ratios 1.07 and 1.04, respectively); completion rates were slightly higher for 1 and 3 C-R/R messages (adjusted risk ratios 1.02 and 1.03, respectively). IIS-based C-R/R for HPV vaccination did not improve HPV vaccination rates in New York and increased vaccination rates slightly in Colorado.