PSA : a hybrid feature selection approach for Persian text classification

Bagheri, A, Saraee, MH and Nadi, S 2015, 'PSA : a hybrid feature selection approach for Persian text classification' , Journal of Computing and Security, 1 (4) , pp. 261-272.

[img] PDF - Published Version
Restricted to Repository staff only

Download (1MB) | Request a copy

Abstract

In recent decades, as enormous amount of data being accumulated, the number of text documents is increasing vastly. E-mails, web pages, texts, news and articles are only part of this grow. Thus the need for text mining techniques, including automatic text classification, is rising. In automatic text classification, feature selection from within any text appears to be the most important step. Since the feature space in textual data includes tens of thousands of words, feature selection is used for dimension reduction. Different techniques, from statistical to machine learning approaches for feature selection in text have been reported in literature, each with advantages and disadvantages. However up to now there have been very rare researches on utilizing advantages of both learning and statistical approaches. In this paper a new algorithm for feature selection in text is presented to improve the classification performance substantially. The proposed approach - PSA - is based on simulated annealing algorithm and document frequency method. So it can benefit from advantages of both statistical and learning techniques. The simulated annealing algorithm requires an appropriate function for fitness evaluation, where document frequency method as an evaluation function has low computational cost. In addition, a new Persian text dataset, i.e. Persian 7-NewsGroups Dataset, is introduced for evaluating the proposed approach. Therefore, to justify and evaluate our approach, the performance of the PSA is compared to famous methods such as chi-square and correlation coefficient on Persian 7-NewsGroups dataset. The results show that the PSA has overall better performance in comparison to the other methods.

Item Type: Article
Schools: Schools > School of Computing, Science and Engineering > Salford Innovation Research Centre (SIRC)
Journal or Publication Title: Journal of Computing and Security
Publisher: University of Isfahan and Iranian Society of Cryptology
ISSN: 2322-4460
Related URLs:
Depositing User: Dr Mo Saraee
Date Deposited: 31 Jul 2017 09:04
Last Modified: 09 Aug 2017 21:23
URI: http://usir.salford.ac.uk/id/eprint/43366

Actions (login required)

Edit record (repository staff only) Edit record (repository staff only)

Downloads

Downloads per month over past year