Background: New challenges for diagnosis of HIV infection abound, including the impact on key viral and immunological markers of HIV vaccine studies, pre-exposure prophylaxis usage and breakthrough infections, and very early initiation of anti-retroviral treatment. These challenges impact the performance of current diagnostic assays, and require suitable specimens for development and evaluation. In this article we review and describe an archive developed by the Consortium for the Evaluation and Performance of HIV Incidence Assays (CEPHIA), in order to identify the critical features required to create a centralized specimen archive to support these current and future developments. Review and Findings: We review and describe the CEPHIA repository, a large, consolidated repository comprised of over 31,000 highly-selected plasma samples and other body fluid specimen types, with over 50 purposely designed specimen panels distributed to 19 groups since 2012. The CEPHIA repository provided financial return on investment, supported the standardization of HIV incidence assays, and informed guidance and standards set by the World Health Organization and UNAIDS. Unified data from extensively characterized specimens has allowed this resource to support biomarker discovery, assay optimization, and development of new strategies for estimating duration of HIV infection. Critical features of a high-value repository include 1) extensively-characterized samples, 2) high-quality clinical background data, 3) multiple collaborations facilitating ongoing sample replenishment, and 4) sustained history of high-level specimen utilization. Conclusion: With strong governance and leadership, a large consolidated archive of samples from multiple studies provides investigators and assay developers with easy access to diverse samples designed to address challenges associated with HIV diagnosis, helping to enable improvements to HIV diagnostic assays and ultimately elimination of HIV. Its creation and ongoing utilization should compel funders, institutions and researchers to address and improve upon current approaches to sharing specimens.

Background

It is frequently of epidemiological and/or clinical interest to estimate the date of HIV infection or time-since-infection of individuals. Yet, for over 15 years, the only widely-referenced infection dating algorithm that utilises diagnostic testing data to estimate time-since-infection has been the 'Fiebig staging' system. This defines a number of stages of early HIV infection through various standard combinations of contemporaneous discordant diagnostic results using tests of different sensitivity. To develop a new, more nuanced infection dating algorithm, we generalised the Fiebig approach to accommodate positive and negative diagnostic results generated on the same or different dates, and arbitrary current or future tests - as long as the test sensitivity is known. For this purpose, test sensitivity is the probability of a positive result as a function of time since infection.

Methods

The present work outlines the analytical framework for infection date estimation using subject-level diagnostic testing histories, and data on test sensitivity. We introduce a publicly-available online HIV infection dating tool that implements this estimation method, bringing together 1) curatorship of HIV test performance data, and 2) infection date estimation functionality, to calculate plausible intervals within which infection likely became detectable for each individual. The midpoints of these intervals are interpreted as infection time 'point estimates' and referred to as Estimated Dates of Detectable Infection (EDDIs). The tool is designed for easy bulk processing of information (as may be appropriate for research studies) but can also be used for individual patients (such as in clinical practice).

Results

In many settings, including most research studies, detailed diagnostic testing data are routinely recorded, and can provide reasonably precise estimates of the timing of HIV infection. We present a simple logic to the interpretation of diagnostic testing histories into infection time estimates, either as a point estimate (EDDI) or an interval (earliest plausible to latest plausible dates of detectable infection), along with a publicly-accessible online tool that supports wide application of this logic.

Conclusions

This tool, available at https://tools.incidence-estimation.org/idt/ , is readily updatable as test technology evolves, given the simple architecture of the system and its nature as an open source project.

Objective

To determine the precision of new and established methods for estimating duration of HIV infection.

Design

A retrospective analysis of HIV testing results from serial samples in commercially available panels, taking advantage of extensive testing previously conducted on 53 seroconverters.

Methods

We initially investigated four methods for estimating infection timing: method 1, 'Fiebig stages' based on test results from a single specimen; method 2, an updated '4th gen' method similar to Fiebig stages but using antigen/antibody tests in place of the p24 antigen test; method 3, modeling of 'viral ramp-up' dynamics using quantitative HIV-1 viral load data from antibody-negative specimens; and method 4, using detailed clinical testing history to define a plausible interval and best estimate of infection time. We then investigated a 'two-step method' using data from both methods 3 and 4, allowing for test results to have come from specimens collected on different days.

Results

Fiebig and '4th gen' staging method estimates of time since detectable viremia had similar and modest correlation with observed data. Correlation of estimates from both new methods (3 and 4), and from a combination of these two ('two-step method') was markedly improved and variability significantly reduced when compared with Fiebig estimates on the same specimens.

Conclusion

The new 'two-step' method more accurately estimates timing of infection and is intended to be generalizable to more situations in clinical medicine, research, and surveillance than previous methods. An online tool is now available that enables researchers/clinicians to input data related to method 4, and generate estimated dates of detectable infection.

Background

Custom HIV staging assays, including the Sedia HIV-1 Limiting Antigen (LAg) Avidity EIA and avidity modifications of the Ortho VITROS anti-HIV-1+2 and Abbott ARCHITECT HIV Ag/Ab Combo assays, are used to identify "recent" infections in clinical settings and for cross-sectional HIV incidence estimation. However, the high dynamic range of chemiluminescent platforms allows differentiating recent and long-standing infection on signal intensity, and this raises the prospect of using unmodified diagnostic assays for infection timing and surveillance applications.

Methods

We tested a panel of 2500 well-characterized specimens with estimable duration of HIV infection with the 3 assays and the unmodified ARCHITECT. Regression models were used to estimate mean durations of recent infection (MDRIs), context-specific false-recent rates (FRRs) and correlation between diagnostic signal intensity and LAg measurements. Hypothetical epidemiological scenarios were constructed to evaluate utility in surveillance applications.

Results

Over a range of MDRIs (reflecting recency discrimination thresholds), a diluted ARCHITECT-based RITA produced lower FRRs than the VITROS platform (FRR ≈ 0.5% and 1.5%, respectively at MDRI ≈ 200 days), and the unmodified diagnostic ARCHITECT produces incidence estimates with comparable precision to LAg (relative SE ≈ 17.5% and 15%, respectively at MDRI ≈ 200 days). ARCHITECT S/CO measurements were highly correlated with LAg optical density measurements (r = 0.80), and values below 200 are strongly predictive of LAg recency and duration of infection less than 1 year.

Conclusions

Low quantitative measurements from the unmodified ARCHITECT obviate the need for additional recency testing, and its use is feasible in clinical staging and incidence surveillance applications.

Background

Two manufacturers, Maxim Biomedical and Sedia Biosciences Corporation, supply CDC-approved versions of the HIV-1 Limiting Antigen Avidity EIA (LAg) for detecting 'recent' HIV infection in cross-sectional incidence estimation. This study assesses and compares the performance of the two assays for incidence surveillance.

Methods

We ran both assays on a panel of 2,500 well-characterized HIV-1-infected specimens. We analysed concordance of assay results, assessed reproducibility using repeat testing and estimated mean durations of recent infection (MDRIs) and false-recent rates (FRRs) for a range of normalized optical density (ODn) thresholds, alone and in combination with viral load thresholds. We defined three hypothetical surveillance scenarios, similar to the Kenyan and South African epidemics, and a concentrated epidemic. These scenarios allowed us to evaluate the precision of incidence estimates obtained by means of various recent infection testing algorithms (RITAs) based on each of the two assays.

Results

The Maxim assay produced lower ODn values than the Sedia assay on average, largely as a result of higher calibrator readings (mean OD of 0.749 vs. 0.643), with correlation of normalized readings lower (R2 = 0.908 vs. R2 = 0.938). Reproducibility on blinded control specimens was slightly better for Maxim. The MDRI of a Maxim-based algorithm at the 'standard' threshold (ODn ≤1.5 & VL >1,000) was 201 days (95% CI: 180,223) and for Sedia 171 (152,191). The difference Differences in MDRI were estimated at 32.7 (22.9,42.8) and 30.9 days (21.7,40.7) for the two algorithms, respectively. Commensurately, the Maxim algorithm had a higher FRR in treatment-naive subjects (1.7% vs. 1.1%). The two assays produced similar precision of incidence estimates in the three surveillance scenarios.

Conclusions

Differences between the assays can be primarily attributed to the calibrators supplied by the manufacturers. Performance for surveillance was extremely similar, although different thresholds were optimal (i.e. produced the lowest variance of incidence estimates) and at any given ODn threshold, different estimates of MDRI and FRR were obtained. The two assays cannot be treated as interchangeable: assay and algorithm-specific performance characteristic estimates must be used for survey planning and incidence estimation.

Objective

Assays for classifying HIV infections as 'recent' or 'nonrecent' for incidence surveillance fail to simultaneously achieve large mean durations of 'recent' infection (MDRIs) and low 'false-recent' rates (FRRs), particularly in virally suppressed persons. The potential for optimizing recent infection testing algorithms (RITAs), by introducing viral load criteria and tuning thresholds used to dichotomize quantitative measures, is explored.

Design

The Consortium for the Evaluation and Performance of HIV Incidence Assays characterized over 2000 possible RITAs constructed from seven assays (Limiting Antigen, BED, Less-sensitive Vitros, Vitros Avidity, BioRad Avidity, Architect Avidity, and Geenius) applied to 2500 diverse specimens.

Methods

MDRIs were estimated using regression, and FRRs as observed 'recent' proportions, in various specimen sets. Context-specific FRRs were estimated for hypothetical scenarios. FRRs were made directly comparable by constructing RITAs with the same MDRI through the tuning of thresholds. RITA utility was summarized by the precision of incidence estimation.

Results

All assays produce high FRRs among treated patients and elite controllers (10-80%). Viral load testing reduces FRRs, but diminishes MDRIs. Context-specific FRRs vary substantially by scenario - BioRad Avidity and Limiting Antigen provided the lowest FRRs and highest incidence precision in scenarios considered.

Conclusion

The introduction of a low viral load threshold provides crucial improvements in RITAs. However, it does not eliminate nonzero FRRs, and MDRIs must be consistently estimated. The tuning of thresholds is essential for comparing and optimizing the use of assays. The translation of directly measured FRRs into context-specific FRRs critically affects their magnitudes and our understanding of the utility of assays.

Objective

HIV seroconversion biomarkers are being used in cross-sectional studies for HIV incidence estimation. Bio-Rad Geenius HIV-1/2 Supplemental Assay is an immunochromatographic single-use assay that measures antibodies (Ab) against multiple HIV-1/2 antigens. The objective of this study was to determine whether the Geenius assay could additionally be used for recency estimation.

Design

This assay was developed for HIV-1/2 confirmation; however, quantitative data acquired give information on increasing concentration and diversity of antibody responses over time during seroconversion. A quantitative threshold of recent HIV infection was proposed to determine "recent" or "nonrecent" HIV infection; performance using this cutoff was evaluated.

Methods

We tested 2500 highly characterized specimens from research subjects in the United States, Brazil, and Africa with well-defined durations of HIV infection. Regression and frequency estimation were used to estimate assay properties relevant to HIV incidence measurement: mean duration of recent infection (MDRI), false-recent rate, and assay reproducibility and robustness.

Results

Using the manufacturer's proposed cutoff index of 1.5 to identify "recent" infection, the assay has an estimated false-recent rate of 4.1% (95% CI: 2.2 to 7.0) and MDRI of 179 days (155 to 201) in specimens from treatment-naive subjects, presenting performance challenges similar to other incidence assays. Lower index cutoffs associated with lower MDRI gave a lower rate of false-recent results.

Conclusions

These data suggest that with additional interpretive analysis of the band intensities using an algorithm and cutoff, the Geenius HIV-1/2 Supplemental Assay can be used to identify recent HIV infection in addition to confirming the presence of HIV-1 and HIV-2 antibodies.

Objective

Cross-sectional HIV incidence surveillance, using assays that distinguish 'recent' from 'nonrecent' infections, has been hampered by inadequate performance and characterization of incidence assays. In this study, the Consortium for the Evaluation and Performance of HIV Incidence Assays presents results of the first independent evaluation of five incidence assays (BED, Limiting Antigen Avidity, Less-sensitive Vitros, Vitros Avidity and BioRad Avidity).

Design

A large repository of diverse specimens from HIV-positive patients was established, multiple assays were run on 2500 selected specimens, and data were analyzed to estimate assay characteristics relevant for incidence surveillance.

Methods

The mean duration of recent infection (MDRI, average time 'recent' while infected for less than some time cut-off T) was estimated from longitudinal data on seroconverters by regression. The false-recent rate (FRR, probability of testing 'recent' when infected for longer than T) was explored by measuring the proportions of 'recent' results in various subsets of patients.

Results

Assays continue to fail to attain the simultaneously large MDRI and small FRR demanded by existing performance guidelines. All assays produce high FRRs amongst virally suppressed patients (>40%), including elite controllers and treated patients.

Conclusions

Results from this first independent evaluation provide valuable information about the current performance of assays, and suggest the need for further optimization. Variation of 'recent'/'nonrecent' thresholds and the use of multiple antibody-maturation assays, as well as other biomarkers, can now be explored, using the rich data generated by the Consortium for the Evaluation and Performance of HIV Incidence Assays. Consistently high FRRs amongst those virally suppressed suggest that viral load will be a particularly valuable supplementary marker.

Background

Assays have been developed for cross-sectional HIV incidence estimation using plasma samples. Large scale surveillance programs are planned using dried blood spot (DBS) specimens for incidence assessment. However, limited information exists on the performance of HIV cross-sectional incidence assays using DBS.

Methods

The assays evaluated were: Maxim HIV-1 Limiting Antigen Avidity EIA (LAg-Avidity), Sedia HIV-1 BED-Capture EIA (BED-CEIA), and CDC modified BioRad HIV-1/2 Plus O Avidity-based Assay (CDC-BioRad Avidity) using pre-determined cutoff values. 100 matched HIV-1 positive plasma and DBS samples, with known duration of infection, from the Consortium for the Evaluation and Performance of HIV Incidence Assays repository were tested. All assays were run in duplicate. To examine the degree of variability within and between results for each sample type, both categorical and continuous results were analyzed. Associations were assessed with Bland Altman, R2 values and Cohen's kappa coefficient (ĸ).

Results

Intra-assay variability using the same sample type was similar for all assays (R2 0.96 to 1.00). The R2 values comparing DBS and plasma results for LAg-Avidity, BED-CEIA, and CDC-BioRad Avidity were 0.96, 0.94, and 0.84, respectively. The concordance and ĸ values between DBS and plasma for all three assays were >87% and >0.64, respectively. The Bland-Altman analysis showed significant differences between plasma and DBS samples. For all three assays, a higher number of samples were classified as recent infections using DBS samples.

Conclusions

DBS and plasma sample results were highly correlated. However, when compared to plasma, each assay performed somewhat differently in DBS at the lower and higher ends of the dynamic range. DBS samples were more likely to be classified as recently infected by all three assays, which may lead to overestimation of incidence in surveys using performance criteria derived for plasma samples.

Background

Human immunodeficiency virus (HIV) antibodies are generated and maintained by ongoing systemic expression of HIV antigen. We investigated whether HIV antibody responses as measured by high-throughput quantitative and qualitative assays could be used to indirectly measure persistent HIV replication in individuals receiving antiretroviral therapy (ART).

Methods

HIV antibody responses were measured over time in the presence or absence of suppressive ART and were compared to the HIV reservoir size and expression of antiviral restriction factors.

Results

Among untreated individuals, including both elite controllers (ie, persons with a viral load of ≤40 copies/mL) and noncontrollers, antibody parameters were stable over time and correlated with the individual viral load. Viral suppression with ART led to a progressive decline in antibody responses after treatment induction that persisted for 5-7 years. Higher levels of HIV antibodies during suppressive therapy were associated with later initiation of ART after infection, with higher DNA and cell-associated RNA levels, and with lower expression of multiple anti-HIV host restriction factors.

Discussion

These findings suggest that declining antibody levels during ART reflect lower levels of antigen production and/or viral replication in the persistent HIV reservoir. Results of relatively inexpensive and quantitative HIV antibody assays may be useful indirect markers that enable efficient monitoring of the viral reservoir and suppression during functional-cure interventions.