A note on the empirical futility of labor-intensive scoring permutations for assessing scholarly productivity

Implications for research, promotion/tenure, and mentoring

Christine Hanish, John J. Horan, Bethanne Keen, Ginger Clark

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

The measurement of scholarly productivity is embroiled in a controversy concerning the differential crediting of coauthors. Some researchers assign equivalent shares to each coauthor; others employ weighting systems based on authorship order. Horan and his colleagues use simple publication totals, arguing that the psychometric properties of labor-intensive alternatives are unknown, and relevant ethical guidelines for including coauthors are neither widely understood nor consistently followed. The PsycLIT and SSCI data bases provided exhaustive publication and citation frequencies for 323 counseling psychology faculty. All PsycLIT scoring permutations yielded essentially identical information; inter-correlations ranged from .96 to unity. Moreover, all PsycLIT methods correlated highly with SSCI within a very narrow band. Since attention to the number and/or ordinal position of coauthors yields no useful information, productivity should be defined parsimoniously in terms of simple publication counts. Implications for research, promotion/tenure, and the mentoring of graduate students are discussed.

Original languageEnglish (US)
JournalEducation Policy Analysis Archives
Volume6
StatePublished - Aug 19 1998

Fingerprint

mentoring
promotion
productivity
labor
counseling psychology
weighting
psychometrics
graduate
student

ASJC Scopus subject areas

  • Education

Cite this

A note on the empirical futility of labor-intensive scoring permutations for assessing scholarly productivity : Implications for research, promotion/tenure, and mentoring. / Hanish, Christine; Horan, John J.; Keen, Bethanne; Clark, Ginger.

In: Education Policy Analysis Archives, Vol. 6, 19.08.1998.

Research output: Contribution to journalArticle

@article{aa726fcf38dd4f4db657a6832a5beb1b,
title = "A note on the empirical futility of labor-intensive scoring permutations for assessing scholarly productivity: Implications for research, promotion/tenure, and mentoring",
abstract = "The measurement of scholarly productivity is embroiled in a controversy concerning the differential crediting of coauthors. Some researchers assign equivalent shares to each coauthor; others employ weighting systems based on authorship order. Horan and his colleagues use simple publication totals, arguing that the psychometric properties of labor-intensive alternatives are unknown, and relevant ethical guidelines for including coauthors are neither widely understood nor consistently followed. The PsycLIT and SSCI data bases provided exhaustive publication and citation frequencies for 323 counseling psychology faculty. All PsycLIT scoring permutations yielded essentially identical information; inter-correlations ranged from .96 to unity. Moreover, all PsycLIT methods correlated highly with SSCI within a very narrow band. Since attention to the number and/or ordinal position of coauthors yields no useful information, productivity should be defined parsimoniously in terms of simple publication counts. Implications for research, promotion/tenure, and the mentoring of graduate students are discussed.",
author = "Christine Hanish and Horan, {John J.} and Bethanne Keen and Ginger Clark",
year = "1998",
month = "8",
day = "19",
language = "English (US)",
volume = "6",
journal = "Education Policy Analysis Archives",
issn = "1068-2341",
publisher = "Arizona State University",

}

TY - JOUR

T1 - A note on the empirical futility of labor-intensive scoring permutations for assessing scholarly productivity

T2 - Implications for research, promotion/tenure, and mentoring

AU - Hanish, Christine

AU - Horan, John J.

AU - Keen, Bethanne

AU - Clark, Ginger

PY - 1998/8/19

Y1 - 1998/8/19

N2 - The measurement of scholarly productivity is embroiled in a controversy concerning the differential crediting of coauthors. Some researchers assign equivalent shares to each coauthor; others employ weighting systems based on authorship order. Horan and his colleagues use simple publication totals, arguing that the psychometric properties of labor-intensive alternatives are unknown, and relevant ethical guidelines for including coauthors are neither widely understood nor consistently followed. The PsycLIT and SSCI data bases provided exhaustive publication and citation frequencies for 323 counseling psychology faculty. All PsycLIT scoring permutations yielded essentially identical information; inter-correlations ranged from .96 to unity. Moreover, all PsycLIT methods correlated highly with SSCI within a very narrow band. Since attention to the number and/or ordinal position of coauthors yields no useful information, productivity should be defined parsimoniously in terms of simple publication counts. Implications for research, promotion/tenure, and the mentoring of graduate students are discussed.

AB - The measurement of scholarly productivity is embroiled in a controversy concerning the differential crediting of coauthors. Some researchers assign equivalent shares to each coauthor; others employ weighting systems based on authorship order. Horan and his colleagues use simple publication totals, arguing that the psychometric properties of labor-intensive alternatives are unknown, and relevant ethical guidelines for including coauthors are neither widely understood nor consistently followed. The PsycLIT and SSCI data bases provided exhaustive publication and citation frequencies for 323 counseling psychology faculty. All PsycLIT scoring permutations yielded essentially identical information; inter-correlations ranged from .96 to unity. Moreover, all PsycLIT methods correlated highly with SSCI within a very narrow band. Since attention to the number and/or ordinal position of coauthors yields no useful information, productivity should be defined parsimoniously in terms of simple publication counts. Implications for research, promotion/tenure, and the mentoring of graduate students are discussed.

UR - http://www.scopus.com/inward/record.url?scp=3042529827&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=3042529827&partnerID=8YFLogxK

M3 - Article

VL - 6

JO - Education Policy Analysis Archives

JF - Education Policy Analysis Archives

SN - 1068-2341

ER -