TY - GEN
T1 - A dilemma in assessing stability of feature selection algorithms
AU - Alelyani, Salem
AU - Zhao, Zheng
AU - Liu, Huan
PY - 2011
Y1 - 2011
N2 - In realm, feature selection is an effective means for handling high-dimensional data that becomes increasingly abundant. The stability of a feature selection algorithm is becoming crucial for determining the fitness of the algorithm. Below, we review existing methods of stability assessment and analyse how they assess the stability of a feature selection algorithm. A common approach is to evaluate the similarity between the selected subsets of features produced by that algorithm over different training samples or over distributed datasets. We point out challenges facing the existing evaluation methods and suggest how to improve stability assessment of feature selection algorithms.
AB - In realm, feature selection is an effective means for handling high-dimensional data that becomes increasingly abundant. The stability of a feature selection algorithm is becoming crucial for determining the fitness of the algorithm. Below, we review existing methods of stability assessment and analyse how they assess the stability of a feature selection algorithm. A common approach is to evaluate the similarity between the selected subsets of features produced by that algorithm over different training samples or over distributed datasets. We point out challenges facing the existing evaluation methods and suggest how to improve stability assessment of feature selection algorithms.
KW - Jaccard Index
KW - algorithm's stability
KW - distributed datasets
KW - feature selection
KW - stability assessment
UR - http://www.scopus.com/inward/record.url?scp=81555218602&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=81555218602&partnerID=8YFLogxK
U2 - 10.1109/HPCC.2011.99
DO - 10.1109/HPCC.2011.99
M3 - Conference contribution
AN - SCOPUS:81555218602
SN - 9780769545387
T3 - Proc.- 2011 IEEE International Conference on HPCC 2011 - 2011 IEEE International Workshop on FTDCS 2011 -Workshops of the 2011 Int. Conf. on UIC 2011- Workshops of the 2011 Int. Conf. ATC 2011
SP - 701
EP - 707
BT - Proc.- 2011 IEEE International Conference on HPCC 2011 - 2011 IEEE International Workshop on FTDCS 2011 - Workshops of the 2011 Int. Conf. on UIC 2011- Workshops of the 2011 Int. Conf. ATC 2011
T2 - 13th IEEE International Workshop on FTDCS 2011, the 8th International Conference on ATC 2011, the 8th International Conference on UIC 2011 and the 13th IEEE International Conference on HPCC 2011
Y2 - 2 September 2011 through 4 September 2011
ER -