TY - JOUR
T1 - Reliability between online raters with varying familiarities of a region
T2 - Microscale Audit of Pedestrian Streetscapes (MAPS)
AU - Zhu, Wenfei
AU - Sun, Yuliang
AU - Kurka, Jonathan
AU - Geremia, Carrie
AU - Engelberg, Jessa K.
AU - Cain, Kelli
AU - Conway, Terry
AU - Sallis, James F.
AU - Hooker, Steven P.
AU - Adams, Marc
N1 - Funding Information:
The authors would like to acknowledge Justin Martinez for his assistantce in data collection. This work is supported in part from grants by the Fundamental Research Funds for the Central Universities ( GK201603128 , GK201603129 ) and National Institutes of Health ( R01HL109222 , R01CA198915 ).
Publisher Copyright:
© 2017 Elsevier B.V.
PY - 2017/11
Y1 - 2017/11
N2 - Background To test inter-rater reliability of the online Microscale Audit of Pedestrian Streetscapes (MAPS) tool between raters with varying familiarities of Phoenix, Arizona. Methods The online MAPS tool, based on the MAPS in-field audit tool and scoring system, was used for audits. Sixty route pairs, 141 segment pairs, and 92 crossing pairs in Phoenix were included. Each route, segment or crossing was audited by two independent raters: one rater in Phoenix and the other in San Diego, California, respectively. Item, subscale scores, and total scores reliability analyses were computed using Kappa or intra-class correlation coefficient (ICC). Results The route overall score had substantial reliability (ICC: 0.832). Of the route subscale and overall scores, sixteen out of twenty had moderate to substantial reliability (ICC: 0.616–0.906), and the four subscales had fair reliability (ICC: 0.409–0.563). Sixteen out of twenty scores in segment and crossing sections demonstrated fair to substantial reliability (ICC: 0.448–0.897), and the remaining four had slight reliability (ICC: 0.348–0.364). Conclusions Most of the online MAPS items, subscales, and overall scores demonstrated fair to substantial reliability between raters with varied familiarities of the Phoenix area. Results support use of online MAPS to measure microscale elements of the built environment by raters unfamiliar with a region.
AB - Background To test inter-rater reliability of the online Microscale Audit of Pedestrian Streetscapes (MAPS) tool between raters with varying familiarities of Phoenix, Arizona. Methods The online MAPS tool, based on the MAPS in-field audit tool and scoring system, was used for audits. Sixty route pairs, 141 segment pairs, and 92 crossing pairs in Phoenix were included. Each route, segment or crossing was audited by two independent raters: one rater in Phoenix and the other in San Diego, California, respectively. Item, subscale scores, and total scores reliability analyses were computed using Kappa or intra-class correlation coefficient (ICC). Results The route overall score had substantial reliability (ICC: 0.832). Of the route subscale and overall scores, sixteen out of twenty had moderate to substantial reliability (ICC: 0.616–0.906), and the four subscales had fair reliability (ICC: 0.409–0.563). Sixteen out of twenty scores in segment and crossing sections demonstrated fair to substantial reliability (ICC: 0.448–0.897), and the remaining four had slight reliability (ICC: 0.348–0.364). Conclusions Most of the online MAPS items, subscales, and overall scores demonstrated fair to substantial reliability between raters with varied familiarities of the Phoenix area. Results support use of online MAPS to measure microscale elements of the built environment by raters unfamiliar with a region.
KW - Microscale audit
KW - Pedestrian
KW - Physical activity
KW - Streetscapes
KW - walkability
UR - http://www.scopus.com/inward/record.url?scp=85026847663&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85026847663&partnerID=8YFLogxK
U2 - 10.1016/j.landurbplan.2017.06.014
DO - 10.1016/j.landurbplan.2017.06.014
M3 - Article
AN - SCOPUS:85026847663
SN - 0169-2046
VL - 167
SP - 240
EP - 248
JO - Landscape and Urban Planning
JF - Landscape and Urban Planning
ER -