A Novel Rotation Forest Modality Based on Hybrid NNs: RF (ScPSO-NN)

• Main Authors: Rahime Ceylan, Hasan Koyuncu
• Format: Article
• Language: English
• Published: Elsevier 2019-04-01
• Series: Journal of King Saud University: Computer and Information Sciences
• Online Access: http://www.sciencedirect.com/science/article/pii/S1319157817302446

Neural Network (NN), hybrid NN methods and Rotation Forest (RF) ensemble classifier are preferred in pattern analysis owing to their ability for finding efficient solutions on different problems. NN architecture usually includes backpropagation type algorithms in which error is exposed to fluctuations. Hybrid NN methods are generally designed to improve the classification performance of NN. Scout Particle Swarm Optimization (ScPSO) is one of these optimization algorithms including the effective parts of Particle Swarm Optimization (PSO) and Artificial Bee Colony Optimization (ABC). Moreover, RF algorithm usually indicates the same performance as in hybrid NN methods, although it is comprised of Decision Tree (DT) classifiers. At this point, our paper investigates whether RF using the hybrid NNs can outperform other ensemble classifiers in binary-medical pattern classification, or not. With this intention, PSO, ABC and ScPSO are placed in NN algorithms instead of back propagation, and hybrid methods (PSO-NN, ABC-NN and ScPSO-NN) are realized. As a result, RF (PSO-NN), RF (ABC-NN) and RF (ScPSO-NN) architectures are obtained. Classification Accuracy (CA), Area Under Curve (AUC), Sensitivity, Specificity, F-measure, Gmean and Precision metrics are used for a statistical performance comparison, and a test based on 2-fold cross validation method was realized on five medical datasets. Keywords: Rotation Forest, Particle Swarm Optimization, Artificial Bee Colony Optimization, Scout Particle Swarm Optimization, Hybrid classifiers