Objective

The study sought to assess, for children in one large health system, (1) characteristics of active users of the patient portal (≥1 use in prior 12 months), (2) portal use by adolescents, and (3) variations in pediatric patient portal use.

Materials and methods

We analyzed data from the electronic health record regarding pediatric portal use during 2017-2018 across a health system (39 871 pediatric patients).

Results

Altogether, 63.5% of pediatric patients were active portal users. Children (proxies) who were boys, privately insured, white, and spoke English were more likely to be active users. Common uses involved messaging with physicians, medications, allergies, letters, and laboratory results. By 15 years of age, >50% of adolescents used the portal by themselves (without a proxy). Pediatric portal use varied widely across practices.

Discussion

Pediatric or adolescent portal use is quite high, but large variations exist.

Conclusion

Use of the portal for pediatric care may reflect varying pediatric patient engagement.

Background

Over the past decades, increased knowledge about childhood abuse and trauma have prompted changes in child welfare policy, and practice that may have affected the out-of-home (OOH) care population. However, little is known about recent national trends in child maltreatment, OOH placement, or characteristics of children in OOH care. The objective of this study was to examine trends in child maltreatment and characteristics of children in OOH care.

Methods

We analyzed 2 federal administrative databases to identify and characterize US children who were maltreated (National Child Abuse and Neglect Data System) or in OOH care (Adoption and Foster Care Analysis and Reporting System). We assessed trends between 2000 and 2010.

Results

The number of suspected maltreatment cases increased 17% from 2000 to 2010, yet the number of substantiated cases decreased 7% and the number of children in OOH care decreased 25%. Despite the decrease in OOH placements, we found a 19% increase in the number of children who entered OOH care because of maltreatment (vs other causes), a 36% increase in the number of children with multiple (vs single) types of maltreatment, and a 60% increase in the number of children in OOH care identified as emotionally disturbed.

Conclusions

From 2000 to 2010, fewer suspected cases of maltreatment were substantiated, despite increased investigations, and fewer maltreated children were placed in OOH care. These changes may have led to a smaller but more complex OOH care population with substantial previous trauma and emotional problems.

Objective

Adolescent immunization rates are suboptimal. Experts recommend provider prompts at health care visits to improve rates. We assessed the impact of either electronic health record (EHR) or nurse- or staff-initiated provider prompts on adolescent immunization rates.

Methods

We conducted a randomized controlled trial, allocating practices in 1 of 2 practice-based research networks (PBRN) to provider prompts or standard-of-care control. Ten primary care practices participated, 5 intervention and 5 controls, each matched in pairs on urban, suburban, or rural location and practice type (pediatric or family medicine), from a PBRN in Greater Rochester, New York (GR-PBRN); and 12 practices, 6 intervention, 6 controls, similarly matched, from a national pediatric continuity clinic PBRN (CORNET). The study period was 1 year per practice, ranging from June 2011 to January 2013. Study participants were adolescents 11 to 17 years attending these 22 practices; random sample of chart reviews per practice for baseline and postintervention year to assess immunization rates (n = 7,040 total chart reviews for adolescents with >1 visit in a period). The intervention was an EHR prompt (4 GR-PBRN and 5 CORNET practice pairs) (alert) that appeared on providers' computer screens at all office visits, indicating the specific immunizations that adolescents were recommended to receive. Staff prompts (1 GR-PBRN pair and 1 CORNET pair) in the form of a reminder sheet was placed on the provider's desk in the exam room indicating the vaccines due. We compared immunization rates, stratified by PBRN, for routine vaccines (meningococcus, pertussis, human papillomavirus, influenza) at study beginning and end.

Results

Intervention and control practices within each PBRN were similar at baseline for demographics and immunization rates. Immunization rates at the study end for adolescents who were behind on immunizations at study initiation were not significantly different for intervention versus control practices for any vaccine or combination of vaccines. Results were similar for each PBRN and also when only EHR-based prompts was assessed. For example, at study end, 3-dose human papillomavirus vaccination rates for GR-PBRN intervention versus control practices were 51% versus 53% (adjusted odds ratio 0.96; 95% confidence interval 0.64-1.34); CORNET intervention versus control rates were 50% versus 42% (adjusted odds ratio 1.06; 95% confidence interval 0.68-1.88).

Conclusions and relevance

In both a local and national setting, provider prompts failed to improve adolescent immunization rates. More rigorous practice-based changes are needed.

Background

Studies have noted variations in the cost-effectiveness of school-located influenza vaccination (SLIV), but little is known about how SLIV's cost-effectiveness may vary by targeted age group (e.g., elementary or secondary school students), or vaccine consent process (paper-based or web-based). Further, SLIV's cost-effectiveness may be impacted by its spillover effect on practice-based vaccination; prior studies have not addressed this issue.

Methods

We performed a cost-effectiveness analysis on two SLIV programs in upstate New York in 2015-2016: (a) elementary school SLIV using a stepped wedge design with schools as clusters (24 suburban and 18 urban schools) and (b) secondary school SLIV using a cluster randomized trial (16 suburban and 4 urban schools). The cost-per-additionally-vaccinated child (i.e., incremental cost-effectiveness ratio (ICER)) was estimated by dividing the incremental SLIV intervention cost by the incremental effectiveness (i.e., the additional number of vaccinated students in intervention schools compared to control schools). We performed deterministic analyses, one-way sensitivity analyses, and probabilistic analyses.

Results

The overall effectiveness measure (proportion of children vaccinated) was 5.7 and 5.5 percentage points higher, respectively, in intervention elementary (52.8%) and secondary schools (48.2%) than grade-matched control schools. SLIV programs vaccinated a small proportion of children in intervention elementary (5.2%) and secondary schools (2.5%). In elementary and secondary schools, the ICER excluding vaccine purchase was $85.71 and $86.51 per-additionally-vaccinated-child, respectively. When additionally accounting for observed spillover impact on practice-based vaccination, the ICER decreased to $80.53 in elementary schools -- decreasing substantially in secondary schools. (to $53.40). These estimates were higher than the published practice-based vaccination cost (median = $25.50, mean = $45.48). Also, these estimates were higher than our 2009-2011 urban SLIV program mean costs ($65) due to additional costs for use of a new web-based consent system ($12.97 per-additionally-vaccinated-child) and higher project coordination costs in 2015-2016. One-way sensitivity analyses showed that ICER estimates were most sensitive to the SLIV effectiveness.

Conclusions

SLIV raises vaccination rates and may increase practice-based vaccination in primary care practices. While these SLIV programs are effective, to be as cost-effective as practice-based vaccination our SLIV programs would need to vaccinate more students and/or lower the costs for consent systems and project coordination.

Trial registration

ClinicalTrials.gov NCT02227186 (August 25, 2014), updated NCT03137667 (May 2, 2017).

Importance

Increasing influenza vaccination rates is a public health priority. One method recommended by the US Centers for Disease Control and Prevention and others is for health systems to send reminders nudging patients to be vaccinated.

Objective

To evaluate and compare the effect of electronic health record (EHR)-based patient portal reminders vs text message reminders on influenza vaccination rates across a health system.

Design, setting, and participants

This 3-arm randomized clinical trial was conducted from September 7, 2022, to April 30, 2023, among primary care patients within the University of California, Los Angeles (UCLA) health system.

Interventions

Arm 1 received standard of care. The health system sent monthly reminder messages to patients due for an influenza vaccine by portal (arm 2) or text (arm 3). Arm 2 had a 2 × 2 nested design, with fixed vs responsive monthly reminders and preappointment vs no preappointment reminders. Arm 3 had 1 × 2 design, with preappointment vs no preappointment reminders. Preappointment reminders for eligible patients were sent 24 and 48 hours before scheduled primary care visits. Fixed reminders (in October, November, and December) involved identical messages via portal or text. Responsive portal reminders involved a September message asking patients about their plans for vaccination, with a follow-up reminder if the response was affirmative but the patient was not yet vaccinated.

Main outcomes and measures

The primary outcome was influenza vaccination by April 30, 2023, obtained from the UCLA EHR, including vaccination from pharmacies and other sources.

Results

A total of 262 085 patients (mean [SD] age, 45.1 [20.7] years; 237 404 [90.6%] adults; 24 681 [9.4%] children; 149 349 [57.0%] women) in 79 primary care practices were included (87 257 in arm 1, 87 478 in arm 2, and 87 350 in arm 3). At the entire primary care population level, none of the interventions improved influenza vaccination rates. All groups had rates of approximately 47%. There was no statistical or clinically significant improvement following portal vs text, preappointment reminders vs no preappointment reminders (portal and text reminders combined), or responsive vs fixed monthly portal reminders.

Conclusions and relevance

At the population level, neither portal nor text reminders for influenza vaccination were effective. Given that vaccine hesitancy may be a major reason for the lack of impact of portal or text reminders, more intensive interventions by health systems are needed to raise influenza vaccination coverage levels.

Trial registration

ClinicalTrials.gov Identifier: NCT05525494.

Background and objectives

Human papillomavirus (HPV) vaccination rates lag behind vaccination rates for other adolescent vaccines; a bundled intervention may improve HPV vaccination rates. Our objective is to evaluate the impact of quality improvement (QI) training plus a bundled practice-based intervention (provider prompts plus communication skills training plus performance feedback) on improving HPV vaccinations in pediatric resident continuity clinics.

Methods

Staff and providers in 8 resident clinics participated in a 12-month QI study. The intervention included training to strengthen provider communication about the HPV vaccine. Clinics also implemented provider prompts, received monthly performance feedback, and participated in learning collaborative calls. The primary outcome measure was eligible visits with vaccination divided by vaccine-eligible visits (captured HPV vaccination opportunities). Practices performed chart audits that were fed into monthly performance feedback on captured HPV vaccination opportunities. We used conditional logistic regression (conditioning on practice) to assess captured vaccination opportunities, with the time period of the study (before and after the QI intervention) as the independent variable.

Results

Overall, captured opportunities for HPV vaccination increased by 16.4 percentage points, from 46.9% to 63.3%. Special cause was demonstrated by centerline shift, with 8 consecutive points above the preintervention mean. On adjusted analyses, patients were more likely to receive a vaccine during, versus before, the intervention (odds ratio: 1.87; 95% confidence interval: 1.54-2.28). Captured HPV vaccination rates improved at both well-child and other visits (by 11.7 and 13.0 percentage points, respectively).

Conclusions

A bundled intervention of provider prompts and training in communication skills plus performance feedback increased captured opportunities for HPV vaccination.

Background

Adult influenza vaccination rates are low. Tailored patient reminders might raise rates.

Objective

Evaluate impact of a health system's patient portal reminders: (1) tailored to patient characteristics and (2) incorporating behavioral science strategies, on influenza vaccination rates among adults.

Design

Pragmatic 6-arm randomized trial across a health system during the 2019-2020 influenza vaccination season. The setting was one large health system-53 adult primary care practices.

Participants

All adult patients who used the patient portal within 12 months, stratified by the following: young adults (18-64 years, without diabetes), older adults (≥65 years, without diabetes), and those with diabetes (≥18 years).

Interventions

Patients were randomized within strata to either (1) pre-commitment reminder alone (1 message, mid-October), (2) pre-commitment + loss frame messages, (3) pre-commitment + gain frame messages, (4) loss frame messages alone, (5) gain frame messages alone, or (6) standard of care control. Patients in the pre-commitment group were sent a message in mid-October, asking if they planned on getting an influenza vaccination. Patients in loss or gain frame groups were sent up to 3 portal reminders (late October, November, and December, if no documented influenza vaccination in the EHR) about importance and safety of influenza vaccine.

Main measures

Receipt of 1 influenza vaccine from 10/01/2019 to 03/31/2020.

Key results

196,486 patients (145,166 young adults, 29,795 older adults, 21,525 adults with diabetes) were randomized. Influenza vaccination rates were as follows: for young adults 36.8%, for older adults 55.6%, and for diabetics 60.6%. On unadjusted and adjusted (for age, gender, insurance, race, ethnicity, and prior influenza vaccine history) analyses, influenza vaccination rates were not statistically different for any study group versus control.

Conclusions

Patient reminders sent by a health system's patient portal that were tailored to patient demographics (young adults, older adults, diabetes) and that incorporated two behavioral economic messaging strategies (pre-commitment and loss/gain framing) were not effective in raising influenza vaccination rates.

Trial registration

This trial was registered with ClinicalTrials.gov (NCT04110314).

In a large health system, we evaluated the effectiveness of electronic health record patient portal reminders in increasing pediatric influenza vaccination rates. We conducted an intention-to-treat randomized clinical trial of 22 046 children from 6 months to <18 years of age in 53 primary care practices. Patients (or parent and/or proxies) who were active portal users were randomly assigned to receive reminder messages framed as gains or losses or no messages. They were separately randomly assigned to receive a precommitment message before the influenza season. The primary outcome was receipt of ≥1 seasonal influenza vaccinations. Additionally, children 6 months to <3 years of age due for a second influenza vaccine were randomly assigned to receive a reminder or no reminder for the second vaccination. First-dose influenza vaccination rates were 56.9% in the control group, 58.0% in the loss-frame reminders group (P = .07), and 58.0% in the gain-frame group (P = .47). Rates were 58.3% in the precommitment group versus 57.0% in the control group (P = .11). Adjusted risk ratios for first vaccination were 1.02 (95% confidence interval [CI]: 1.00-1.04) for loss-frame reminders, 1.01 (95% CI: 0.98-1.05) for gain-frame reminders, and 1.02 (95% CI: 1.00-1.04) for precommitment messages versus controls. Second-dose vaccination rates were 44.1% in the control group and 55.0% in the reminder group, with an adjusted risk ratio of 1.25 (95% CI: 1.07-1.45). Patient portal reminders for influenza vaccines in children, whether framed as gains or losses, did not increase first-dose influenza vaccination rates but were highly effective for the second dose of the vaccine.

Although autodialer centralized reminder and recall (C-R/R) from state immunization information systems (IISs) has been shown to raise childhood vaccination rates, its impact on human papillomavirus (HPV) vaccination rates is unclear. In a 4-arm pragmatic randomized controlled trial across 2 states, we randomly selected practices representative of the specialty (pediatrics, family medicine, and health center) where children received care. Within each practice, patients 11 to 17.9 years old who had not completed their HPV vaccine series (NY: N = 30 616 in 123 practices; CO: N = 31 502 in 80 practices) were randomly assigned to receive 0, 1, 2, or 3 IIS C-R/R autodialer messages per vaccine dose. We assessed HPV vaccine receipt via the IIS, calculated intervention costs, and compared HPV vaccine series initiation and completion rates across study arms. In New York, HPV vaccine initiation rates ranged from 37.0% to 37.4%, and completion rates were between 29.1% and 30.1%, with no significant differences across study arms. In Colorado, HPV vaccine initiation rates ranged from 31.2% to 33.5% and were slightly higher for 1 reminder compared with none, but vaccine completion rates, ranging from 27.0% to 27.8%, were similar. On adjusted analyses in Colorado, vaccine initiation rates were slightly higher for 1 and 3 C-R/R messages (adjusted risk ratios 1.07 and 1.04, respectively); completion rates were slightly higher for 1 and 3 C-R/R messages (adjusted risk ratios 1.02 and 1.03, respectively). IIS-based C-R/R for HPV vaccination did not improve HPV vaccination rates in New York and increased vaccination rates slightly in Colorado.

Influenza vaccination rates are low. Working with a large US health system, we evaluated three health system-wide interventions using the electronic health record's patient portal to improve influenza vaccination rates. We performed a two-arm RCT with a nested factorial design within the treatment arm, randomizing patients to usual-care control (no portal interventions) or to one or more portal interventions. We included all patients within this health system during the 2020-2021 influenza vaccination season, which overlapped with the COVID-19 pandemic. Through the patient portal, we simultaneously tested: pre-commitment messages (sent September 2020, asking patients to commit to a vaccination); monthly portal reminders (October - December 2020), direct appointment scheduling (patients could self-schedule influenza vaccination at multiple sites); and pre-appointment reminder messages (sent before scheduled primary care appointments, reminding patients about influenza vaccination). The main outcome measure was receipt of influenza vaccine (10/01/2020-03/31/2021). We randomized 213,773 patients (196,070 adults ≥18 years, 17,703 children). Influenza vaccination rates overall were low (39.0%). Vaccination rates for study arms did not differ: Control (38.9%), pre-commitment vs no pre-commitment (39.2%/38.9%), direct appointment scheduling yes/no (39.1%/39.1%), pre-appointment reminders yes/no (39.1%/39.1%); p > 0.017 for all comparisons (p value cut-off adjusted for multiple comparisons). After adjusting for age, gender, insurance, race, ethnicity, and prior influenza vaccination, none of the interventions increased vaccination rates. We conclude that patient portal interventions to remind patients to receive influenza vaccine during the COVID-19 pandemic did not raise influenza immunization rates. More intensive or tailored interventions are needed beyond portal innovations to increase influenza vaccination.