BACKGROUND: Implementation researchers have typically studied organizational culture and climate by testing whether individual dimensions are linked to the implementation of evidence-based practices (EBPs) rather than examining how the overarching social context influences implementation. This approach may limit implementation theory and strategy development to the extent that individual dimensions of culture and climate interact, mutually reinforce or counteract one another, or exhibit non-linear relationships. This study tests whether empirically identifiable culture and climate profiles emerge in a sample of organizations and examines how these profiles relate to EBP fidelity and work attitudes that support EBP sustainment, focusing on three EBPs for youth with autism delivered in schools as an example. METHODS: The study included 65 elementary schools in the U.S. that implemented three EBPs-discrete trial training, pivotal response training, and visual schedules-for youth with autism. Organizational culture and climate and work attitudes were assessed using the Organizational Social Context measure at the beginning of the school year. Observations of EBP fidelity occurred mid school-year. We used bias-adjusted stepwise latent profile modeling to (1) identify subpopulations of schools that share similar culture and climate profiles, and (2) test for mean differences across profiles in observed EBP fidelity and teacher and staff work attitudes. RESULTS: Controlling for region, four profiles best characterized the organizational cultures and climates of schools. Teachers and staff in schools with a comprehensive profile (high proficiency culture, positive climate) exhibited higher fidelity to two of three EBPs (ds = .95 to 1.64) and reported superior work attitudes (ds = .71 to 1.93) than teachers and staff in all other schools. Teachers and staff in supportive schools (low rigidity culture, positive climate) had better work attitudes, but not better fidelity, than those in schools with indifferent (low culture/climate, elevated stress) and constrained (high rigidity and resistance, high stress) profiles. CONCLUSIONS: Organizational culture and climate profiles are a strong predictor of EBP fidelity and work attitudes that support EBP sustainment, highlighting the importance of an organizations overarching social context when developing implementation theory and strategies. Strategies that foster a comprehensive profile may improve EBP implementation.

Implementing evidence-based practices (EBPs) for children with autism is challenging for teachers because these practices are often complex, requiring significant training and resources that are not available in most school settings. This brief investigation was designed to identify areas of strength and difficulty for teachers implementing one such EBP, pivotal response training (PRT). Observational data were gathered from 41 teachers participating in two separate investigations involving PRT. Despite differences in training procedures, teachers demonstrated similarities in areas of strength (clear opportunities/instruction and child choice) and difficulty (turn taking and multiple cues). These findings suggest next steps toward systematic adaptation of PRT for classroom use. The research may serve as a model for the process of adapting EBPs for practice settings.

The purpose of this study was to examine the extent to which public school teachers implemented evidence-based interventions for students with autism in the way these practices were designed. Evidence-based practices for students with autism are rarely incorporated into community settings, and little is known about the quality of implementation. An indicator of intervention quality is procedural implementation fidelity (the degree to which a treatment is implemented as prescribed). Procedural fidelity likely affects student outcomes. This project examined procedural implementation fidelity of three evidence-based practices used in a randomized trial of a comprehensive program for students with autism in partnership with a large, urban school district. Results indicate that teachers in public school special education classrooms can learn to implement evidence-based strategies; however they require extensive training, coaching, and time to reach and maintain moderate procedural implementation fidelity. Procedural fidelity over time, and across intervention strategies is examined.

Purpose of review

This synthesis of recent mental health services research with autistic individuals presents significant advances, current gaps, and recommendations for improving mental healthcare for this population.

Recent findings

Recent advances include improved understanding of co-occurring mental health conditions among autistic individuals, a growing evidence base for interventions to address them, the development and implementation of new service models to support mental health for this population, and a substantial increase in mental health services and implementation research focused on autism. Ongoing challenges include a lack of mental health interventions designed for community implementation with autistic individuals, limited workforce capacity, complex and disconnected service systems, and racial, ethnic, and socioeconomic disparities in accessibility and quality of mental health services. Despite the advances in our understanding of mental health needs and mental health services for autistic individuals, several critical gaps remain. We encourage future efforts to develop and test interventions that can be used in community settings, train and incentivize the workforce to provide them, realign policies and funding with best practice, and embrace an equity-focused approach to autism research and care.

Background

Research trials of early intervention (EI) programs for children with autism spectrum disorder (ASD) generally demonstrate medium-to-large gains, on average, compared with "treatment as usual," in different developmental domains. Almost all children with ASD receive their treatment through community-based services, however, and studies suggest that evidence-based interventions rarely make their way into community practice. Understanding the effectiveness of community-based EI and factors associated with these effects is the first step in developing strategies for wide-scale implementation of effective EI.

Methods

Studies of community-based EI for children with ASD were identified through a systematic search. Changes in cognitive, communication, social, and adaptive functioning from pre-treatment to post-treatment were assessed using standardized mean gain scores. Effect sizes were estimated using random effects models. Moderators of interest included type of community EI program, year of publication, intervention duration, and sample selection. Moderator effects were assessed using analysis of variance of mixed-effects models and meta-regression analyses.

Results

Forty-six groups from 33 studies met inclusion criteria (1,713 participants, mean age 37.4 months, 81.1% male). There were small but statistically significant gains in each of the four domains. Hedges's g ranged from 0.21 for adaptive behavior to 0.32 for communication outcomes, after removing outliers and correcting for publication bias. EI programs associated with universities and hospitals were superior, on average, to other community EI programs for cognitive and adaptive behavior outcomes. Intervention duration was negatively associated with effect sizes for communication and adaptive behavior outcomes.

Conclusions

These results indicate that there remains a large gap between outcomes observed in community settings and those reported in efficacy trials.

Objective

To determine the effect of the Early Start Denver Model (ESDM) for treatment of young children with autism on health care service use and costs.

Method

We used data from a randomized trial that tested the efficacy of the ESDM, which is based on developmental and applied behavioral analytic principles and delivered by trained therapists and parents, for 2 years. Parents were interviewed about their children's service use every 6 months from the onset of the intervention to follow-up (age 6 years). The sample for this study consisted of 39 children with autism who participated in the original randomized trial at age 18 to 30 months, and were also assessed at age 6 years. Of this sample, 21 children were in the ESDM group, and 18 children were in the community care (COM) group. Reported services were categorized and costed by applying unit hourly costs. Annualized service use and costs during the intervention and post intervention for the two study arms were compared.

Results

During the intervention, children who received the ESDM had average annualized total health-related costs that were higher by about $14,000 than those of children who received community-based treatment. The higher cost of ESDM was partially offset during the intervention period because children in the ESDM group used less applied behavior analysis (ABA)/early intensive behavioral intervention (EIBI) and speech therapy services than children in the comparison group. In the postintervention period, compared with children who had earlier received treatment as usual in community settings, children in the ESDM group used less ABA/EIBI, occupational/physical therapy, and speech therapy services, resulting in significant cost savings in the amount of about $19,000 per year per child.

Conclusion

Costs associated with ESDM treatment were fully offset within a few years after the intervention because of reductions in other service use and associated costs.

Clinical trial registration information

Early Characteristics of Autism; http://clinicaltrials.gov/; NCT0009415.

BACKGROUND: Parent-mediated early interventions (EI) for children with autism spectrum disorder (ASD) can result in significant improvements in childrens cognitive ability, social functioning, behavior, and adaptive skills, as well as improvements in parental self-efficacy and treatment engagement. The common component to efficacious parent-mediated early interventions for ASD is clinician use of parent coaching and occurs when a clinician actively teaches the parent techniques to improve their childs functioning. Available evidence suggests that community-based EI clinicians rarely coach parents when working with families of these children, although specific barriers to coaching are unknown. This consistent finding points to the need to develop strategies to improve the use of parent coaching in community EI programs. The purpose of this community-partnered study is to iteratively develop and pilot test a toolkit of implementation strategies designed to increase EI clinicians use of parent coaching. METHODS: This study has four related phases. Phase 1: examine how EI clinicians trained in Project ImPACT, an evidence-based parent-mediated intervention, coach parents of children with ASD. Phase 2: identify barriers and facilitators to clinician implementation of parent coaching by administering validated questionnaires to, and conducting semi-structured interviews with, clinicians, parents, and agency leaders. Phase 3: partner with a community advisory board to iteratively develop a toolkit of implementation strategies that addresses identified barriers and capitalizes on facilitators to improve clinician implementation of evidence-based parent coaching. Phase 4: pilot test the feasibility and effectiveness of the implementation strategy toolkit in improving EI clinicians use of parent coaching with nine EI clinicians and parent-child dyads using a multiple-baseline-across-participants single-case design. DISCUSSION: Completion of these activities will lead to an in-depth understanding of EI clinicians implementation of parent coaching in usual practice following training in an evidence-based parent-mediated intervention, barriers to their implementation of parent coaching, a toolkit of implementation strategies developed through an iterative community-partnered process, and preliminary evidence regarding the potential for this toolkit to improve EI clinicians implementation of parent coaching. These pilot data will offer important direction for a larger evaluation of strategies to improve the use of parent coaching for young children with ASD.

Caregiver-mediated interventions for young autistic children are increasingly considered standard of care. These interventions share two sets of components: strategies to improve children's communication, behavior, and development; and procedures to coach caregivers to implement those strategies. To date, no review has examined how caregiver coaching is described in caregiver-mediated intervention manuals. We assessed how caregiver coaching is described in caregiver-mediated intervention manuals for young autistic children. We conducted a scoping review to identify publicly available manuals that are designed to support providers in their practice; target core or co-occurring symptoms that affect young autistic children; and were tested as caregiver-mediated interventions in randomized controlled trials. We identified 11 publicly available manuals that met inclusion criteria. Manuals were coded using a summative content analysis to identify the presence and frequency of descriptions of caregiver coaching. The content analysis highlighted a wide range in the descriptions of caregiver coaching. Many intervention manuals did not include specific descriptions of caregiver coaching. Intervention developers should include explicit information about how to coach caregivers. Implementation strategies that specifically target caregiver coaching can serve as critical supports to increase the use of coaching in early intervention.