Background

Microscale environmental features are usually evaluated using direct on-street observations. This study assessed inter-rater reliability of the Microscale Audit of Pedestrian Streetscapes, Global version (MAPS-Global), in an international context, comparing on-street with more efficient online observation methods in five countries with varying levels of walkability.

Methods

Data were collected along likely walking routes of study participants, from residential starting points toward commercial clusters in Melbourne (Australia), Ghent (Belgium), Curitiba (Brazil), Hong Kong (China), and Valencia (Spain). In-person on the street and online using Google Street View audits were carried out by two independent trained raters in each city. The final sample included 349 routes, 1228 street segments, 799 crossings, and 16 cul-de-sacs. Inter-rater reliability analyses were performed using Kappa statistics or Intraclass Correlation Coefficients (ICC).

Results

Overall mean assessment times were the same for on-street and online evaluations (22 ± 12 min). Only a few subscales had Kappa or ICC values < 0.70, with aesthetic and social environment variables having the lowest overall reliability values, though still in the "good to excellent" category. Overall scores for each section (route, segment, crossing) showed good to excellent reliability (ICCs: 0.813, 0.929 and 0.885, respectively), and the MAPS-Global grand score had excellent reliability (ICC: 0.861) between the two methods.

Conclusions

MAPS-Global is a feasible and reliable instrument that can be used both on-street and online to analyze microscale environmental characteristics in diverse international urban settings.

Background

The IPEN International Physical Activity and Environment Network Adolescent project was conducted using common study protocols to document the strength, shape, and generalizability of associations of perceived neighborhood environment attributes with adolescents' physical activity and overweight/obesity using data from 15 countries. Countries did not use identical versions of the Neighborhood Environment Walkability Scale for Youth (NEWS-Y) to measure perceived neighborhood environment attributes. Therefore, this study derived a measurement model for NEWS-Y items common to all IPEN Adolescent countries and developed a scoring protocol for the IPEN Adolescent version of the NEWS-Y (NEWS-Y-IPEN) that maximizes between-country comparability of responses. Additionally, this study examined between- and within-country variability, and construct validity of the NEWS-Y-IPEN subscales in relation to neighborhood-level socio-economic status and walkability.

Methods

Adolescents and one of their parents (N = 5714 dyads) were recruited from neighborhoods varying in walkability and socio-economic status. To measure perceived neighborhood environment, 14 countries administered the NEWS-Y to parents and one country to adolescents. Confirmatory factor analysis was used to derive comparable country-specific measurement models of the NEWS-Y-IPEN. Country-specific standard deviations quantified within-country variability in the NEWS-Y-IPEN subscales, while linear mixed models determined the percentage of subscale variance due to between-country differences. To examine the construct validity of NEWS-Y-IPEN subscales, we estimated their associations with the categorical measures of area-level walkability and socio-economic status.

Results

Final country-specific measurement models of the factor-analyzable NEWS-Y-IPEN items provided acceptable levels of fit to the data and shared the same factorial structure with five latent factors (Accessibility and walking facilities; Traffic safety; Pedestrian infrastructure and safety; Safety from crime; and Aesthetics). All subscales showed sufficient levels of within-country variability. Residential density had the highest level of between-country variability. Associations between NEWS-Y-IPEN subscales and area-level walkability and socio-economic status provided strong evidence of construct validity.

Conclusions

A robust measurement model and common scoring protocol of NEWS-Y for the IPEN Adolescent project (NEWS-Y-IPEN) were derived. The NEWS-Y-IPEN possesses good factorial and construct validity, and is able to capture between-country variability in perceived neighborhood environments. Future studies employing NEWS-Y-IPEN should use the proposed scoring protocol to facilitate cross-study comparisons and interpretation of findings.