Substantive and operational issues of response bias across levels of analysis

An example of climate-satisfaction relationships

Cheri Ostroff, Angelo J. Kinicki, Mark A. Clark

Research output: Contribution to journalArticle

148 Citations (Scopus)

Abstract

Two studies tested whether method variance is present at multiple levels of analysis and whether methodological procedures can minimize its impact. In Study 1, 8,052 employees from 71 hotels completed measures of climate, work environment characteristics, and satisfaction. A comparison of correlations at the individual level, cross-level, cross-level split, aggregate level, and aggregate-split level of analysis revealed that response bias was present across multiple levels. Results suggest that samples should be split in half when cross-level and aggregate correlations are computed to ameliorate response bias problems that arise from individual-level method variance. In Study 2, results indicated that the temporal spacing of measures of climate and satisfaction influenced response bias. Implications and recommendations for future research are discussed.

Original languageEnglish (US)
Pages (from-to)355-368
Number of pages14
JournalJournal of Applied Psychology
Volume87
Issue number2
DOIs
StatePublished - 2002

Fingerprint

Climate

ASJC Scopus subject areas

  • Applied Psychology

Cite this

Substantive and operational issues of response bias across levels of analysis : An example of climate-satisfaction relationships. / Ostroff, Cheri; Kinicki, Angelo J.; Clark, Mark A.

In: Journal of Applied Psychology, Vol. 87, No. 2, 2002, p. 355-368.

Research output: Contribution to journalArticle

@article{dbb3bdd4c32949e58957df64363e9561,
title = "Substantive and operational issues of response bias across levels of analysis: An example of climate-satisfaction relationships",
abstract = "Two studies tested whether method variance is present at multiple levels of analysis and whether methodological procedures can minimize its impact. In Study 1, 8,052 employees from 71 hotels completed measures of climate, work environment characteristics, and satisfaction. A comparison of correlations at the individual level, cross-level, cross-level split, aggregate level, and aggregate-split level of analysis revealed that response bias was present across multiple levels. Results suggest that samples should be split in half when cross-level and aggregate correlations are computed to ameliorate response bias problems that arise from individual-level method variance. In Study 2, results indicated that the temporal spacing of measures of climate and satisfaction influenced response bias. Implications and recommendations for future research are discussed.",
author = "Cheri Ostroff and Kinicki, {Angelo J.} and Clark, {Mark A.}",
year = "2002",
doi = "10.1037//0021-9010.87.2.355",
language = "English (US)",
volume = "87",
pages = "355--368",
journal = "Journal of Applied Psychology",
issn = "0021-9010",
publisher = "American Psychological Association Inc.",
number = "2",

}

TY - JOUR

T1 - Substantive and operational issues of response bias across levels of analysis

T2 - An example of climate-satisfaction relationships

AU - Ostroff, Cheri

AU - Kinicki, Angelo J.

AU - Clark, Mark A.

PY - 2002

Y1 - 2002

N2 - Two studies tested whether method variance is present at multiple levels of analysis and whether methodological procedures can minimize its impact. In Study 1, 8,052 employees from 71 hotels completed measures of climate, work environment characteristics, and satisfaction. A comparison of correlations at the individual level, cross-level, cross-level split, aggregate level, and aggregate-split level of analysis revealed that response bias was present across multiple levels. Results suggest that samples should be split in half when cross-level and aggregate correlations are computed to ameliorate response bias problems that arise from individual-level method variance. In Study 2, results indicated that the temporal spacing of measures of climate and satisfaction influenced response bias. Implications and recommendations for future research are discussed.

AB - Two studies tested whether method variance is present at multiple levels of analysis and whether methodological procedures can minimize its impact. In Study 1, 8,052 employees from 71 hotels completed measures of climate, work environment characteristics, and satisfaction. A comparison of correlations at the individual level, cross-level, cross-level split, aggregate level, and aggregate-split level of analysis revealed that response bias was present across multiple levels. Results suggest that samples should be split in half when cross-level and aggregate correlations are computed to ameliorate response bias problems that arise from individual-level method variance. In Study 2, results indicated that the temporal spacing of measures of climate and satisfaction influenced response bias. Implications and recommendations for future research are discussed.

UR - http://www.scopus.com/inward/record.url?scp=0036333376&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036333376&partnerID=8YFLogxK

U2 - 10.1037//0021-9010.87.2.355

DO - 10.1037//0021-9010.87.2.355

M3 - Article

VL - 87

SP - 355

EP - 368

JO - Journal of Applied Psychology

JF - Journal of Applied Psychology

SN - 0021-9010

IS - 2

ER -