BACKGROUND: Low-value use of screening colonoscopy is wasteful and potentially harmful to patients. Decreasing low-value colonoscopy prevents procedural complications, saves patient time and reduces patient discomfort, and can improve access by reducing procedural demand. The objective of this study was to develop and validate an electronic measure of screening colonoscopy overuse using International Classification of Diseases, Tenth Edition codes and then apply this measure to estimate facility-level overuse to target quality improvement initiatives to reduce overuse in a large integrated healthcare system. METHODS: Retrospective national observational study of US Veterans undergoing screening colonoscopy at 119 Veterans Health Administration (VHA) endoscopy facilities in 2017. A measure of screening colonoscopy overuse was specified by an expert workgroup, and electronic approximation of the measure numerator and denominator was performed (electronic measure). The electronic measure was then validated via manual record review (n=511). Reliability statistics (n=100) were calculated along with diagnostic test characteristics of the electronic measure. The measure was then applied to estimate overall rates of overuse and facility-level variation in overuse among all eligible patients. RESULTS: The electronic measure had high specificity (99%) and moderate sensitivity (46%). Adjusted positive predictive value and negative predictive value were 33% and 95%, respectively. Inter-rater reliability testing revealed near perfect agreement between raters (k=0.81). 269 572 colonoscopies were performed in VHA in 2017 (88 143 classified as screening procedures). Applying the measure to these 88 143 screening colonoscopies, 24.5% were identified as potential overuse. Median facility-level overuse was 22.5%, with substantial variability across facilities (IQR 19.1%-27.0%). CONCLUSIONS: An International Classification of Diseases, Tenth Edition based electronic measure of screening colonoscopy overuse has high specificity and improved sensitivity compared with a previous International Classification of Diseases, Ninth Edition based measure. Despite increased focus on reducing low-value care and improving access, a quarter of VHA screening colonoscopies in 2017 were identified as potential low-value procedures, with substantial facility-level variability.

Objective

To describe a framework for leveraging big data for research and quality improvement purposes and demonstrate implementation of the framework for design of the Department of Veterans Affairs (VA) Colonoscopy Collaborative.

Methods

We propose that research utilizing large-scale electronic health records (EHRs) can be approached in a 4 step framework: 1) Identify data sources required to answer research question; 2) Determine whether variables are available as structured or free-text data; 3) Utilize a rigorous approach to refine variables and assess data quality; 4) Create the analytic dataset and perform analyses. We describe implementation of the framework as part of the VA Colonoscopy Collaborative, which aims to leverage big data to 1) prospectively measure and report colonoscopy quality and 2) develop and validate a risk prediction model for colorectal cancer (CRC) and high-risk polyps.

Results

Examples of implementation of the 4 step framework are provided. To date, we have identified 2,337,171 Veterans who have undergone colonoscopy between 1999 and 2014. Median age was 62 years, and 4.6 percent (n = 106,860) were female. We estimated that 2.6 percent (n = 60,517) had CRC diagnosed at baseline. An additional 1 percent (n = 24,483) had a new ICD-9 code-based diagnosis of CRC on follow up.

Conclusion

We hope our framework may contribute to the dialogue on best practices to ensure high quality epidemiologic and quality improvement work. As a result of implementation of the framework, the VA Colonoscopy Collaborative holds great promise for 1) quantifying and providing novel understandings of colonoscopy outcomes, and 2) building a robust approach for nationwide VA colonoscopy quality reporting.