Correlation-SVM: A Multicollinearity-Aware Feature Selection Framework for SVM-Based Medical Diagnosis

Satish Kumar Kalagotla, Thoudam Basanta, Mutum Bidyarani Devi — Fri, 22 May 2026 00:00:00 +0000

Medical datasets often contain redundant or highly correlated features, leading to multicollinearity that adversely affects Support Vector Machine (SVM) classifiers by causing unstable decision boundaries, inflated coefficient variances, reduced interpretability, and degraded generalization performance, yet traditional feature selection methods inadequately address this issue. This paper proposes Correlation-SVM, a novel multicollinearity-aware feature selection framework that integrates Pearson correlation analysis and Variance Inflation Factor (VIF) computation within a hierarchical elimination process specifically optimized for SVM-based medical diagnosis. The framework operates in four stages: Pearson correlation analysis to identify highly correlated feature pairs; VIF computation to quantify multicollinearity severity; hierarchical feature elimination to iteratively remove redundant features while recomputing VIF after each removal; and SVM training with cross-validation evaluation. Evaluated on four benchmark medical datasets (Wisconsin Breast Cancer, PIMA Indian Diabetes, Hepatitis, and Mammographic Mass) and compared against six state-of-the-art methods (CFS, FCBF, mRMR, SVM-RFE, LASSO, and GA-SVM) using 10-fold cross-validation with five repeats, Correlation-SVM achieved 97.42% accuracy on the Wisconsin dataset with only 5 features (44.4% reduction), outperforming all comparison methods. Multicollinearity was substantially reduced, with maximum VIF decreasing from 8.3 to 2.3 (72.3% reduction) on Wisconsin, from 12.5 to 2.1 (83.2% reduction) on Hepatitis, and from 4.2 to 1.6 (61.9% reduction) on PIMA, achieving VIF values below the acceptable threshold of 2.5. The framework requires only 38.7 seconds of computational time, making it 84% faster than GA-SVM and 79% faster than SVM-RFE, thus achieving wrapper-like performance with filter-like speed. Additionally, the selected feature subsets align with established medical knowledge across all four datasets, enhancing clinical interpretability and trust. Correlation-SVM provides an effective, computationally efficient framework for multicollinearity-aware feature selection in SVM-based medical diagnosis, achieving substantial feature reduction, eliminating multicollinearity, and improving classification accuracy while maintaining interpretability.

Recent Trends in Artificial Intelligence & It’s Applications (e-ISSN: 2583-4819, p-ISSN: 3107-7234)

Correlation-SVM: A Multicollinearity-Aware Feature Selection Framework for SVM-Based Medical Diagnosis