Stability of feature ranking algorithms on binary data.

Aqsa  Shabbir; Kashif  Javed; Yasmin  Ansari; Haroon A  Babri

No Detail Found!

Stability of feature ranking algorithms on binary data.

Author(s)

Aqsa Shabbir Department of Electrical Engineering, Lahore College for Women University, Lahore, Pakistan

Kashif Javed Department of Electrical Engineering, University of Engineering and Technology, Lahore, Pakistan

Yasmin Ansari College of Computer Science and Engineering, Prince Muhammad Bin Fahad University, KSA

Haroon A Babri Department of Electrical Engineering, University of Engineering and Technology, Lahore, Pakistan

Abstract

Stability or robustness is a crucial yardstick for analyzing and evaluating feature selection algorithms which have become indispensible due to unprecedented advancements in knowledge data discovery and management. Stability of feature selection algorithms is taken as the insensitivity of the algorithm to perturbations in the training data with reference to the performance of the algorithm with all training data. In this work, we propose an algorithm for evaluating and quantifying the robustness of feature ranking algorithms and test three feature ranking algorithms: relief, diff-criterian and mutual information on four different real life binary data sets from text mining, handwriting recognition, medical diagnoses and medicinal sciences. We then analyze the stability profiles of feature selectors and determine how stability is a desirable characteristic of a feature ranking algorithm. We find that diff-criterian, and mutual information, outperform relief in stability.

Publication Details

Page(s) 76-86

DOI DOI not available

Published Journal: Pakistan Journal of Engineering and Applied Sciences, Volume: 15, Issue: 2, Year: 2014

Request the full text from PASTIC

Citations

Downloads

Views