Mode Effects in Free-list Elicitation

Comparing Oral, Written, and Web-based Data Collection

Clarence C. Gravlee, Harvey Bernard, Chad R. Maxwell, Aryeh Jacobsohn

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

The growth of the Internet opens new possibilities for web-based data collection in cognitive anthropology. This study examines whether free-list data collected online are comparable to those collected with face to face interviews or with self-administered paper questionnaires. We collected free lists for two cultural domains in the United States: one diffuse (things that mothers do) and one relatively well defined (racial and ethnic groups). We selected a purposive sample of 318 university students and randomly assigned participants to provide free lists for one of these domains using a web-based survey, a face to face interview, or a self-administered paper questionnaire. All three modes identified the same set of salient concepts in each domain. Median list length per respondent varied across modes in response to a standard free-list question and to supplementary probes. For the well-defined domain of "racial and ethnic groups," supplementary probes widened differences among modes; for the more diffuse domain of "things that mothers do," probes erased evidence of mode effects. Collecting free lists online is viable but may yield different results depending on the study population and attributes of the cultural domains.

Original languageEnglish (US)
Pages (from-to)119-132
Number of pages14
JournalSocial Science Computer Review
Volume31
Issue number1
DOIs
StatePublished - Feb 1 2013
Externally publishedYes

Fingerprint

ethnic group
questionnaire
interview
anthropology
Internet
university
Students
evidence
student

Keywords

  • cognitive anthropology
  • free listing
  • mode effects
  • Web surveys

ASJC Scopus subject areas

  • Social Sciences(all)
  • Computer Science Applications
  • Library and Information Sciences
  • Law

Cite this

Mode Effects in Free-list Elicitation : Comparing Oral, Written, and Web-based Data Collection. / Gravlee, Clarence C.; Bernard, Harvey; Maxwell, Chad R.; Jacobsohn, Aryeh.

In: Social Science Computer Review, Vol. 31, No. 1, 01.02.2013, p. 119-132.

Research output: Contribution to journalArticle

Gravlee, Clarence C. ; Bernard, Harvey ; Maxwell, Chad R. ; Jacobsohn, Aryeh. / Mode Effects in Free-list Elicitation : Comparing Oral, Written, and Web-based Data Collection. In: Social Science Computer Review. 2013 ; Vol. 31, No. 1. pp. 119-132.
@article{49e8f3ca39664a1f8953e829461fbb27,
title = "Mode Effects in Free-list Elicitation: Comparing Oral, Written, and Web-based Data Collection",
abstract = "The growth of the Internet opens new possibilities for web-based data collection in cognitive anthropology. This study examines whether free-list data collected online are comparable to those collected with face to face interviews or with self-administered paper questionnaires. We collected free lists for two cultural domains in the United States: one diffuse (things that mothers do) and one relatively well defined (racial and ethnic groups). We selected a purposive sample of 318 university students and randomly assigned participants to provide free lists for one of these domains using a web-based survey, a face to face interview, or a self-administered paper questionnaire. All three modes identified the same set of salient concepts in each domain. Median list length per respondent varied across modes in response to a standard free-list question and to supplementary probes. For the well-defined domain of {"}racial and ethnic groups,{"} supplementary probes widened differences among modes; for the more diffuse domain of {"}things that mothers do,{"} probes erased evidence of mode effects. Collecting free lists online is viable but may yield different results depending on the study population and attributes of the cultural domains.",
keywords = "cognitive anthropology, free listing, mode effects, Web surveys",
author = "Gravlee, {Clarence C.} and Harvey Bernard and Maxwell, {Chad R.} and Aryeh Jacobsohn",
year = "2013",
month = "2",
day = "1",
doi = "10.1177/0894439312455312",
language = "English (US)",
volume = "31",
pages = "119--132",
journal = "Social Science Computer Review",
issn = "0894-4393",
publisher = "SAGE Publications Inc.",
number = "1",

}

TY - JOUR

T1 - Mode Effects in Free-list Elicitation

T2 - Comparing Oral, Written, and Web-based Data Collection

AU - Gravlee, Clarence C.

AU - Bernard, Harvey

AU - Maxwell, Chad R.

AU - Jacobsohn, Aryeh

PY - 2013/2/1

Y1 - 2013/2/1

N2 - The growth of the Internet opens new possibilities for web-based data collection in cognitive anthropology. This study examines whether free-list data collected online are comparable to those collected with face to face interviews or with self-administered paper questionnaires. We collected free lists for two cultural domains in the United States: one diffuse (things that mothers do) and one relatively well defined (racial and ethnic groups). We selected a purposive sample of 318 university students and randomly assigned participants to provide free lists for one of these domains using a web-based survey, a face to face interview, or a self-administered paper questionnaire. All three modes identified the same set of salient concepts in each domain. Median list length per respondent varied across modes in response to a standard free-list question and to supplementary probes. For the well-defined domain of "racial and ethnic groups," supplementary probes widened differences among modes; for the more diffuse domain of "things that mothers do," probes erased evidence of mode effects. Collecting free lists online is viable but may yield different results depending on the study population and attributes of the cultural domains.

AB - The growth of the Internet opens new possibilities for web-based data collection in cognitive anthropology. This study examines whether free-list data collected online are comparable to those collected with face to face interviews or with self-administered paper questionnaires. We collected free lists for two cultural domains in the United States: one diffuse (things that mothers do) and one relatively well defined (racial and ethnic groups). We selected a purposive sample of 318 university students and randomly assigned participants to provide free lists for one of these domains using a web-based survey, a face to face interview, or a self-administered paper questionnaire. All three modes identified the same set of salient concepts in each domain. Median list length per respondent varied across modes in response to a standard free-list question and to supplementary probes. For the well-defined domain of "racial and ethnic groups," supplementary probes widened differences among modes; for the more diffuse domain of "things that mothers do," probes erased evidence of mode effects. Collecting free lists online is viable but may yield different results depending on the study population and attributes of the cultural domains.

KW - cognitive anthropology

KW - free listing

KW - mode effects

KW - Web surveys

UR - http://www.scopus.com/inward/record.url?scp=84873857917&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84873857917&partnerID=8YFLogxK

U2 - 10.1177/0894439312455312

DO - 10.1177/0894439312455312

M3 - Article

VL - 31

SP - 119

EP - 132

JO - Social Science Computer Review

JF - Social Science Computer Review

SN - 0894-4393

IS - 1

ER -