Linear discriminant analysis : a detailed tutorial

Gaber, T ORCID:, Tharwat, A, Ibrahim, A and Hassanien, AE 2017, 'Linear discriminant analysis : a detailed tutorial' , AI Communications, 30 (2) , pp. 169-190.

PDF - Accepted Version
Download (577kB) | Preview


Linear Discriminant Analysis (LDA) is a very common technique for dimensionality reduction problems as a preprocessing step for machine learning and pattern classification applications. At the same time, it is usually used as a black box, but (sometimes) not well understood. The aim of this paper is to build a solid intuition for what is LDA, and how LDA works, thus enabling readers of all levels be able to get a better understanding of the LDA and to know how to apply this technique in different applications. The paper first gave the basic definitions and steps of how LDA technique works supported with visual explanations of these steps. Moreover, the two methods of computing the LDA space, i.e. class-dependent and class-independent methods, were explained in details. Then, in a step-by-step approach, two numerical examples are demonstrated to show how the LDA space can be calculated in case of the class-dependent and class-independent methods. Furthermore, two of the most common LDA problems (i.e. Small Sample Size (SSS) and non-linearity problems) were highlighted and illustrated, and state-of-the-art solutions to these problems were investigated and explained. Finally, a number of experiments was conducted with different datasets to (1) investigate the effect of the eigenvectors that used in the LDA space on the robustness of the extracted feature for the classification accuracy, and (2) to show when the SSS problem occurs and how it can be addressed.

Item Type: Article
Schools: Schools > School of Computing, Science and Engineering > Salford Innovation Research Centre
Journal or Publication Title: AI Communications
Publisher: IOS Press
ISSN: 0921-7126
Related URLs:
Depositing User: Dr. Tarek Gaber
Date Deposited: 19 Aug 2019 09:21
Last Modified: 16 Feb 2022 02:31

Actions (login required)

Edit record (repository staff only) Edit record (repository staff only)


Downloads per month over past year