This chapter focuses on the NIH Toolbox List Sorting Working Memory Test, which was developed to assess processing speed within the NIH Toolbox Cognition Battery (CB). This test is a sequencing task requiring children and adults to process stimuli (presented both visually and auditorily) and sequence the stimuli according to size. We describe the development of the NIH Toolbox List Sorting Working Memory Test, highlighting its utility in children. We examine descriptive data, test-retest reliability, and convergent and discriminant validity. Results indicated that List Sorting performance was positively correlated with age indicating that performance on the task improved throughout childhood and early adolescence. Further, test-retest reliability coefficients were high and there was support for both convergent and discriminant validity. These data suggest that the NIH Toolbox List Sorting Working Memory Test is reliable and shows evidence of construct validity.

One of the most significant domains of cognition is episodic memory, which allows for rapid acquisition and long-term storage of new information. For purposes of the NIH Toolbox, we devised a new test of episodic memory. The nonverbal NIH Toolbox Picture Sequence Memory Test (TPSMT) requires participants to reproduce the order of an arbitrarily ordered sequence of pictures presented on a computer. To adjust for ability, sequence length varies from 6 to 15 pictures. Multiple trials are administered to increase reliability. Pediatric data from the validation study revealed the TPSMT to be sensitive to age-related changes. The task also has high test-retest reliability and promising construct validity. Steps to further increase the sensitivity of the instrument to individual and age-related variability are described.

Background

Kidney transplant is the best treatment for most end-stage renal disease (ESRD) patients, but proportionally few ESRD patients receive kidney transplant. To make an informed choice about whether to pursue kidney transplant, patients must be knowledgeable of its risks and benefits. To reliably and validly measure ESRD patients' kidney transplant knowledge, rigorously tested measures are required. This article describes the development and psychometric testing of the Knowledge Assessment of Renal Transplantation (KART).

Methods

We administered 17 transplant knowledge items to a sample of 1294 ESRD patients. Item characteristics and scale scores were estimated using an Item Response Theory graded response model. Construct validity was tested by examining differences in scale scores between patients who had spent less than 1 and 1 hour or longer receiving various types of transplant education.

Results

Item Response Theory modeling suggested that 15 items should be retained for the KART. This scale had a marginal reliability of 0.75 and evidenced acceptable reliability (>0.70) across most of its range. Construct validity was supported by the KART's ability to distinguish patients who had spent less than 1 and 1 hour or longer receiving different types of kidney transplant education, including talking to doctors/medical staff (effect size [ES], 0.61; P < 0.001), reading brochures (ES, 0.45; P < 0.001), browsing the internet (ES, 0.56; P < 0.001), and watching videos (ES, 0.56; P < 0.001).

Conclusions

The final 15-item KART can be used to determine the kidney transplant knowledge levels of ESRD patients and plan appropriate interventions to ensure informed transplant decision making occurs.

The List Sorting Working Memory Test was designed to assess working memory (WM) as part of the NIH Toolbox Cognition Battery. List Sorting is a sequencing task requiring children and adults to sort and sequence stimuli that are presented visually and auditorily. Validation data are presented for 268 participants ages 20 to 85 years. A subset of participants (N=89) was retested 7 to 21 days later. As expected, the List Sorting Test had moderately high correlations with other measures of working memory and executive functioning (convergent validity) but a low correlation with a test of receptive vocabulary (discriminant validity). Furthermore, List Sorting demonstrates expected changes over the age span and has excellent test-retest reliability. Collectively, these results provide initial support for the construct validity of the List Sorting Working Memory Measure as a measure of working memory. However, the relationship between the List Sorting Test and general executive function has yet to be determined.

Rationale & objective

Compared with others, black and low-income patients receiving dialysis are less likely to receive kidney transplantation (KT) education within dialysis centers. We examined the efficacy of 2 supplementary KT education approaches delivered directly to patients.

Study design

Prospective, 3-arm parallel-group, randomized, controlled trial.

Settings & participants

Adult, black, and white low-income patients receiving dialysis in Missouri.

Intervention

Patients were randomly assigned to 1 of 3 educational conditions: (1) standard of care, usual KT education provided in dialysis centers (control); (2) Explore Transplant @ Home patient-guided, 4 modules of KT education sent directly to patients using print, video, and text messages; and (3) Explore Transplant @ Home educator-guided, the patient-guided intervention plus 4 telephonic discussions with an educator.

Outcomes

Primary: patient knowledge of living (LDKT) and deceased donor KT (DDKT). Secondary: informed decision making, change in attitudes in favor of LDKT and DDKT, and change in the number of new steps taken toward KT.

Results

In intent-to-treat analyses, patients randomly assigned to educator- and patient-guided interventions had greater knowledge gains (1.4 point increase) than control patients (0.8 point increase; P=0.02 and P=0.01, respectively). Compared with control patients, more patients randomly assigned to educator- and patient-guided interventions were able to make informed decisions about starting KT evaluation (82% vs 91% and 95%; P=0.003), pursuing DDKT (70% vs 84% and 84%; P=0.003), and pursuing LDKT (73% vs 91% and 92%; P<0.001).

Limitations

Potential contamination because of patient-level randomization; no assessment of clinical end points.

Conclusions

Education presented directly to dialysis patients, with or without coaching by telephone, increased dialysis patients' KT knowledge and informed decision making without increasing educational burden on providers.

Funding source

This project was funded by the National Institutes of Health and Health Resources and Services Administration.

Trial registration

Registered at ClinicalTrials.gov with study number NCT02268682.

Socioeconomic barriers can prevent successful kidney transplant (KT) but are difficult to measure efficiently in clinical settings. We created and validated an individual-level, single score Kidney Transplant Derailers Index (KTDI) and assessed its association with waitlisting and living donor KT (LDKT) rates.

Methods

The dataset included 733 patients presenting for KT evaluation in a transplant center in California. Exploratory factor analysis was used to identify socioeconomic barriers to KT (derailers) to include in the index. Potential KT derailers included health insurance, employment, financial insecurity, educational attainment, perception of neighborhood safety, access to a vehicle, having a washer/dryer, and quality of social support. Validity was tested with associations between KTDI scores and the following: (1) the Area Deprivation Index (ADI) and (2) time to KT waitlisting and LDKT.

Results

Nine derailers were retained, omitting only social support level from the original set. The KTDI was scored by summing the number of derailers endorsed (mean: 3.0; range: 0-9). Black patients had higher estimated KTDI scores than other patient groups (versus White patients, 3.8 versus 2.1; P < 0.001, effect size = 0.81). In addition, the KTDI was associated with the ADI (γ = 0.70, SE = 0.07; P < 0.001). Finally, in comparison to the lower tertile, patients in the upper and middle KTDI tertiles had lower hazard of waitlisting (upper tertile hazard ratio [HR]: 0.34, 95% confidence interval [CI]: 0.25-0.45; middle tertile HR: 0.54, 95% CI: 0.40-0.72) and receiving an LDKT (upper tertile HR: 0.15, 95% CI: 0.08-0.30; middle tertile HR: 0.35, 95% CI: 0.20-0.62). These associations remained significant when adjusting for the ADI and other patient characteristics.

Conclusions

The KTDI is a valid indicator of socioeconomic barriers to KT for individual patients that can be used to identify patients at risk for not receiving a KT.

Language facilitates communication and efficient encoding of thought and experience. Because of its essential role in early childhood development, in educational achievement and in subsequent life adaptation, language was included as one of the subdomains in the NIH Toolbox for the Assessment of Neurological and Behavioral Function Cognition Battery (NIHTB-CB). There are many different components of language functioning, including syntactic processing (i.e., morphology and grammar) and lexical semantics. For purposes of the NIHTB-CB, two tests of language--a picture vocabulary test and a reading recognition test--were selected by consensus based on literature reviews, iterative expert input, and a desire to assess in English and Spanish. NIHTB-CB's picture vocabulary and reading recognition tests are administered using computer adaptive testing and scored using item response theory. Data are presented from the validation of the English versions in a sample of adults ages 20-85 years (Spanish results will be presented in a future publication). Both tests demonstrated high test-retest reliability and good construct validity compared to corresponding gold-standard measures. Scores on the NIH Toolbox measures were consistent with age-related expectations, namely, growth in language during early development, with relative stabilization into late adulthood.

Objectives

To evaluate the validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function measures using longitudinal data collected in six chronic health conditions.

Study design and setting

Individuals with rheumatoid arthritis (RA), major depressive disorder (MDD), back pain, chronic obstructive pulmonary disease (COPD), chronic heart failure (CHF), and cancer completed the PROMIS Physical Function computerized adaptive test or fixed-length short form at baseline and at the end of clinically relevant follow-up intervals. Anchor items were also administered to assess change in physical function and general health. Linear mixed-effects models and standardized response means were estimated at baseline and follow-up.

Results

A total of 1,415 individuals participated (COPD n = 121; CHF n = 57; back pain n = 218; MDD n = 196; RA n = 521; cancer n = 302). The PROMIS Physical Function scores improved significantly for treatment of CHF and back pain patients but not for patients with MDD or COPD. Most of the patient subsamples that reported improvement or worsening on the anchors showed a corresponding positive or negative change in PROMIS Physical Function.

Conclusion

This study provides evidence that the PROMIS Physical Function measures are sensitive to change in intervention studies where physical function is expected to change and able to distinguish among different clinical samples. The results inform the estimation of meaningful change, enabling comparative effectiveness research.