Online versus in-person comparison of Microscale Audit of Pedestrian Streetscapes (MAPS) assessments

Reliability of alternate methods

Christine B. Phillips, Jessa K. Engelberg, Carrie M. Geremia, Wenfei Zhu, Jonathan M. Kurka, Kelli L. Cain, James F. Sallis, Terry L. Conway, Marc Adams

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Background: An online version of the Microscale Audit of Pedestrian Streetscapes (Abbreviated) tool was adapted to virtually audit built environment features supportive of physical activity. The current study assessed inter-rater reliability of MAPS Online between in-person raters and online raters unfamiliar with the regions. Methods: In-person and online audits were conducted for a total of 120 quarter-mile routes (60 per site) in Phoenix, AZ and San Diego, CA. Routes in each city included 40 residential origins stratified by walkability and SES, and 20 commercial centers. In-person audits were conducted by raters residing in their region. Online audits were conducted by raters in the alternate location using Google Maps (Aerial and Street View) images. The MAPS Abbreviated Online tool consisted of four sections: overall route, street segments, crossings and cul-de-sacs. Items within each section were grouped into subscales, and inter-rater reliability (ICCs) was assessed for subscales at multiple levels of aggregation. Results: Online and in-person audits showed excellent agreement for overall positive microscale (ICC = 0.86, 95% CI [0.80, 0.90]) and grand scores (ICC = 0.93, 95% CI [0.89, 0.95]). Substantial to near-perfect agreement was found for 21 of 30 (70%) subscales, valence, and subsection scores, with ICCs ranging from 0.62, 95% CI [0.50, 0.72] to 0.95, 95% CI [0.93, 0.97]. Lowest agreement was found for the aesthetics and social characteristics scores, with ICCs ranging from 0.07, 95% CI [-0.12, 0.24] to 0.27, 95% CI [0.10, 0.43]. Conclusions: Results support use of the MAPS Abbreviated Online tool to reliably assess microscale neighborhood features that support physical activity and may be used by raters residing in different geographic regions and unfamiliar with the audit areas.

Original languageEnglish (US)
Article number27
JournalInternational Journal of Health Geographics
Volume16
Issue number1
DOIs
StatePublished - Aug 4 2017

Fingerprint

Exercise
Agglomeration
Esthetics
Antennas
Pedestrians
Audit
Pedestrian
Sociological Factors
Interrater reliability
Physical activity

Keywords

  • Built environment
  • Direct observation
  • Measurement
  • Physical activity
  • Virtual observation
  • Walkability
  • Walking

ASJC Scopus subject areas

  • Computer Science(all)
  • Business, Management and Accounting(all)
  • Public Health, Environmental and Occupational Health

Cite this

Online versus in-person comparison of Microscale Audit of Pedestrian Streetscapes (MAPS) assessments : Reliability of alternate methods. / Phillips, Christine B.; Engelberg, Jessa K.; Geremia, Carrie M.; Zhu, Wenfei; Kurka, Jonathan M.; Cain, Kelli L.; Sallis, James F.; Conway, Terry L.; Adams, Marc.

In: International Journal of Health Geographics, Vol. 16, No. 1, 27, 04.08.2017.

Research output: Contribution to journalArticle

Phillips, Christine B. ; Engelberg, Jessa K. ; Geremia, Carrie M. ; Zhu, Wenfei ; Kurka, Jonathan M. ; Cain, Kelli L. ; Sallis, James F. ; Conway, Terry L. ; Adams, Marc. / Online versus in-person comparison of Microscale Audit of Pedestrian Streetscapes (MAPS) assessments : Reliability of alternate methods. In: International Journal of Health Geographics. 2017 ; Vol. 16, No. 1.
@article{e48455f75e744c949a5d2d80f407bbed,
title = "Online versus in-person comparison of Microscale Audit of Pedestrian Streetscapes (MAPS) assessments: Reliability of alternate methods",
abstract = "Background: An online version of the Microscale Audit of Pedestrian Streetscapes (Abbreviated) tool was adapted to virtually audit built environment features supportive of physical activity. The current study assessed inter-rater reliability of MAPS Online between in-person raters and online raters unfamiliar with the regions. Methods: In-person and online audits were conducted for a total of 120 quarter-mile routes (60 per site) in Phoenix, AZ and San Diego, CA. Routes in each city included 40 residential origins stratified by walkability and SES, and 20 commercial centers. In-person audits were conducted by raters residing in their region. Online audits were conducted by raters in the alternate location using Google Maps (Aerial and Street View) images. The MAPS Abbreviated Online tool consisted of four sections: overall route, street segments, crossings and cul-de-sacs. Items within each section were grouped into subscales, and inter-rater reliability (ICCs) was assessed for subscales at multiple levels of aggregation. Results: Online and in-person audits showed excellent agreement for overall positive microscale (ICC = 0.86, 95{\%} CI [0.80, 0.90]) and grand scores (ICC = 0.93, 95{\%} CI [0.89, 0.95]). Substantial to near-perfect agreement was found for 21 of 30 (70{\%}) subscales, valence, and subsection scores, with ICCs ranging from 0.62, 95{\%} CI [0.50, 0.72] to 0.95, 95{\%} CI [0.93, 0.97]. Lowest agreement was found for the aesthetics and social characteristics scores, with ICCs ranging from 0.07, 95{\%} CI [-0.12, 0.24] to 0.27, 95{\%} CI [0.10, 0.43]. Conclusions: Results support use of the MAPS Abbreviated Online tool to reliably assess microscale neighborhood features that support physical activity and may be used by raters residing in different geographic regions and unfamiliar with the audit areas.",
keywords = "Built environment, Direct observation, Measurement, Physical activity, Virtual observation, Walkability, Walking",
author = "Phillips, {Christine B.} and Engelberg, {Jessa K.} and Geremia, {Carrie M.} and Wenfei Zhu and Kurka, {Jonathan M.} and Cain, {Kelli L.} and Sallis, {James F.} and Conway, {Terry L.} and Marc Adams",
year = "2017",
month = "8",
day = "4",
doi = "10.1186/s12942-017-0101-0",
language = "English (US)",
volume = "16",
journal = "International Journal of Health Geographics",
issn = "1476-072X",
publisher = "BioMed Central",
number = "1",

}

TY - JOUR

T1 - Online versus in-person comparison of Microscale Audit of Pedestrian Streetscapes (MAPS) assessments

T2 - Reliability of alternate methods

AU - Phillips, Christine B.

AU - Engelberg, Jessa K.

AU - Geremia, Carrie M.

AU - Zhu, Wenfei

AU - Kurka, Jonathan M.

AU - Cain, Kelli L.

AU - Sallis, James F.

AU - Conway, Terry L.

AU - Adams, Marc

PY - 2017/8/4

Y1 - 2017/8/4

N2 - Background: An online version of the Microscale Audit of Pedestrian Streetscapes (Abbreviated) tool was adapted to virtually audit built environment features supportive of physical activity. The current study assessed inter-rater reliability of MAPS Online between in-person raters and online raters unfamiliar with the regions. Methods: In-person and online audits were conducted for a total of 120 quarter-mile routes (60 per site) in Phoenix, AZ and San Diego, CA. Routes in each city included 40 residential origins stratified by walkability and SES, and 20 commercial centers. In-person audits were conducted by raters residing in their region. Online audits were conducted by raters in the alternate location using Google Maps (Aerial and Street View) images. The MAPS Abbreviated Online tool consisted of four sections: overall route, street segments, crossings and cul-de-sacs. Items within each section were grouped into subscales, and inter-rater reliability (ICCs) was assessed for subscales at multiple levels of aggregation. Results: Online and in-person audits showed excellent agreement for overall positive microscale (ICC = 0.86, 95% CI [0.80, 0.90]) and grand scores (ICC = 0.93, 95% CI [0.89, 0.95]). Substantial to near-perfect agreement was found for 21 of 30 (70%) subscales, valence, and subsection scores, with ICCs ranging from 0.62, 95% CI [0.50, 0.72] to 0.95, 95% CI [0.93, 0.97]. Lowest agreement was found for the aesthetics and social characteristics scores, with ICCs ranging from 0.07, 95% CI [-0.12, 0.24] to 0.27, 95% CI [0.10, 0.43]. Conclusions: Results support use of the MAPS Abbreviated Online tool to reliably assess microscale neighborhood features that support physical activity and may be used by raters residing in different geographic regions and unfamiliar with the audit areas.

AB - Background: An online version of the Microscale Audit of Pedestrian Streetscapes (Abbreviated) tool was adapted to virtually audit built environment features supportive of physical activity. The current study assessed inter-rater reliability of MAPS Online between in-person raters and online raters unfamiliar with the regions. Methods: In-person and online audits were conducted for a total of 120 quarter-mile routes (60 per site) in Phoenix, AZ and San Diego, CA. Routes in each city included 40 residential origins stratified by walkability and SES, and 20 commercial centers. In-person audits were conducted by raters residing in their region. Online audits were conducted by raters in the alternate location using Google Maps (Aerial and Street View) images. The MAPS Abbreviated Online tool consisted of four sections: overall route, street segments, crossings and cul-de-sacs. Items within each section were grouped into subscales, and inter-rater reliability (ICCs) was assessed for subscales at multiple levels of aggregation. Results: Online and in-person audits showed excellent agreement for overall positive microscale (ICC = 0.86, 95% CI [0.80, 0.90]) and grand scores (ICC = 0.93, 95% CI [0.89, 0.95]). Substantial to near-perfect agreement was found for 21 of 30 (70%) subscales, valence, and subsection scores, with ICCs ranging from 0.62, 95% CI [0.50, 0.72] to 0.95, 95% CI [0.93, 0.97]. Lowest agreement was found for the aesthetics and social characteristics scores, with ICCs ranging from 0.07, 95% CI [-0.12, 0.24] to 0.27, 95% CI [0.10, 0.43]. Conclusions: Results support use of the MAPS Abbreviated Online tool to reliably assess microscale neighborhood features that support physical activity and may be used by raters residing in different geographic regions and unfamiliar with the audit areas.

KW - Built environment

KW - Direct observation

KW - Measurement

KW - Physical activity

KW - Virtual observation

KW - Walkability

KW - Walking

UR - http://www.scopus.com/inward/record.url?scp=85026847401&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85026847401&partnerID=8YFLogxK

U2 - 10.1186/s12942-017-0101-0

DO - 10.1186/s12942-017-0101-0

M3 - Article

VL - 16

JO - International Journal of Health Geographics

JF - International Journal of Health Geographics

SN - 1476-072X

IS - 1

M1 - 27

ER -