TY - JOUR
T1 - A new correlation coefficient for comparing and aggregating non-strict and incomplete rankings
AU - Yoo, Yeawon
AU - Escobedo, Adolfo R.
AU - Skolfield, J. Kyle
N1 - Funding Information:
The authors gratefully acknowledge funding support from the National Science Foundation (Award 1850355 ) and the Army Research Office (Award 74113NSII ).
Funding Information:
Sponsored by the National Science Foundation
Publisher Copyright:
© 2020 Elsevier B.V.
PY - 2020/9/16
Y1 - 2020/9/16
N2 - We introduce a correlation coefficient that is designed to deal with a variety of ranking formats including those containing non-strict (i.e., with-ties) and incomplete (i.e., unknown) preferences. The correlation coefficient is designed to enforce a neutral treatment of incompleteness whereby no assumptions are made about individual preferences involving unranked objects. The new measure, which can be regarded as a generalization of the seminal Kendall tau correlation coefficient, is proven to satisfy a set of metric-like axioms and to be equivalent to a recently developed ranking distance function associated with Kemeny aggregation. In an effort to further unify and enhance both robust ranking methodologies, this work proves the equivalence of an additional distance and correlation-coefficient pairing in the space of non-strict incomplete rankings. These connections induce new exact optimization methodologies: a specialized branch and bound algorithm and an exact integer programming formulation. Moreover, the bridging of these complementary theories reinforces the singular suitability of the featured correlation coefficient to solve the general consensus ranking problem. The latter premise is bolstered by an accompanying set of experiments on random instances, which are generated via a herein developed sampling technique connected with the classic Mallows distribution of ranking data. Associated experiments with the branch and bound algorithm demonstrate that, as data becomes noisier, the featured correlation coefficient yields relatively fewer alternative optimal solutions and that the aggregate rankings tend to be closer to an underlying ground truth shared by a majority.
AB - We introduce a correlation coefficient that is designed to deal with a variety of ranking formats including those containing non-strict (i.e., with-ties) and incomplete (i.e., unknown) preferences. The correlation coefficient is designed to enforce a neutral treatment of incompleteness whereby no assumptions are made about individual preferences involving unranked objects. The new measure, which can be regarded as a generalization of the seminal Kendall tau correlation coefficient, is proven to satisfy a set of metric-like axioms and to be equivalent to a recently developed ranking distance function associated with Kemeny aggregation. In an effort to further unify and enhance both robust ranking methodologies, this work proves the equivalence of an additional distance and correlation-coefficient pairing in the space of non-strict incomplete rankings. These connections induce new exact optimization methodologies: a specialized branch and bound algorithm and an exact integer programming formulation. Moreover, the bridging of these complementary theories reinforces the singular suitability of the featured correlation coefficient to solve the general consensus ranking problem. The latter premise is bolstered by an accompanying set of experiments on random instances, which are generated via a herein developed sampling technique connected with the classic Mallows distribution of ranking data. Associated experiments with the branch and bound algorithm demonstrate that, as data becomes noisier, the featured correlation coefficient yields relatively fewer alternative optimal solutions and that the aggregate rankings tend to be closer to an underlying ground truth shared by a majority.
KW - Correlation and distance functions
KW - Group decisions and negotiations
KW - Non-strict incomplete rankings
KW - Robust ranking aggregation
UR - http://www.scopus.com/inward/record.url?scp=85082474817&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85082474817&partnerID=8YFLogxK
U2 - 10.1016/j.ejor.2020.02.027
DO - 10.1016/j.ejor.2020.02.027
M3 - Article
AN - SCOPUS:85082474817
SN - 0377-2217
VL - 285
SP - 1025
EP - 1041
JO - European Journal of Operational Research
JF - European Journal of Operational Research
IS - 3
ER -