Journal of Soft Computing and Information Technology

Journal of Soft Computing and Information Technology

Semi-Supervised Classification of Imbalanced Data Streams Under Concept Drift Using Chaotic Sequences

Document Type : Persian Original Article

Authors
1 Faculty of Computer Engineering and Information Technology, Sadjad University, Mashhad, Iran.
2 Faculty of Computer Engineering and Information Technology, Sadjad University, Mashhad, Iran
Abstract
Real-world data stream classification remains a fundamental challenge in machine learning due to the simultaneous occurrence of concept drift, class imbalance, and the limited availability of labeled data. Existing semi-supervised learning methods typically address only one of these challenges. In this study, a semi-supervised active learning framework based on a Radial Basis Function Neural Network (RBFNN) is proposed for data stream classification under simultaneous concept drift and class imbalance. In the proposed framework, a sliding window mechanism is employed to retain newly arrived samples while gradually discarding outdated data, enabling the model to remain consistent with the current data distribution. Subsequently, an active learning strategy based on the combination of uncertainty and density criteria selects the most informative samples for labeling, thereby reducing labeling costs while improving training quality. Furthermore, a smooth pseudo-labeling mechanism based on feature-space similarity is adopted to effectively exploit unlabeled data. In the modeling stage, the RBFNN architecture is enhanced with an adaptive center adjustment mechanism and dynamic updating to cope with concept drift. The initial RBF centers are initialized using an improved K-means++ algorithm and are subsequently updated online according to incoming data. In addition, to address class imbalance, a synthetic sample generation method based on weighted combinations of minority-class samples and the Logistic Map chaotic sequence is proposed, increasing the diversity of generated samples. Moreover, a weighted Focal Loss function is employed to improve the model's sensitivity to difficult samples while dynamically adjusting class weights. The network parameters are optimized using the Adam algorithm. Experimental results demonstrate that the integration of active learning, adaptive RBF center adjustment, semi-supervised pseudo-labeling, and mechanisms for handling concept drift and class imbalance significantly improves the performance of data stream classification. Compared with state-of-the-art methods, including SSALD, SSALE-EIS, AACE-DI, LEPID, and CBAL, the proposed method achieves superior performance, with average improvements of 4% in F1-score, 3% in G-Mean, and 2.5% in Specificity. These results confirm the effectiveness and robustness of the proposed framework for real-world data stream classification under concept drift and class imbalance.
Keywords

[1] F. Ceschin, M. Botacin, H. M. Gomes, F. Pinage, L. S. Oliveira, and A. Gregio, “Fast & Furious: On the Modelling of Malware Detection as an Evolving Data Stream,” Expert Systems with Applications, vol. 212, Art. no. 118590, 2023, doi: 10.1016/j.eswa.2022.118590.
 [2] S. Wang, L. L. Minku, and X. Yao, “A Systematic Study of Online Class Imbalance Learning With Concept Drift,” IEEE Transactions on Neural Networks and Learning Systems, vol. 29, no. 10, pp. 4802–4820, Oct. 2018, doi: 10.1109/TNNLS.2017.2771290.
[3] Guo, J. Pu, B. Jiao, Y. Peng, D. Wang, and S. Yang, “Online Semi-Supervised Active Learning Ensemble Classification for Evolving Imbalanced Data Streams,” Applied Soft Computing, vol. 155, Art. no. 111452, 2024, doi: 10.1016/j.asoc.2024.111452.
[4] J.Hamidzadeh, N. Kashefi, and M. Moradi, “Instance Reduction Using Multi-Objective Chaotic Particle Swarm Optimization Algorithm,” Journal of Soft Computing and Information Technology (JSCIT), vol. 8, no. 1, pp. 39–49, 2019.
[5] R. Rastogi and S. Sharma, “Fast Laplacian Twin Support Vector Machine With Active Learning for Pattern Classification,” Applied Soft Computing, vol. 74, pp. 343–353, 2019, doi: 10.1016/j.asoc.2018.10.042.
[6] Y. Hu, P. Baraldi, F. Di Maio, and E. Zio, “A COMPOSE-Based Method for Fault Diagnostics in Evolving Environment,” in Proc. Prognostics and System Health Management Conf. (PHM), 2015.
[7] Z.Zhang and Q. Yang, “Unsupervised Feature Learning With Reconstruction Sparse Filtering for Intelligent Fault Diagnosis of Rotating Machinery,” Applied Soft Computing, vol. 115, Art. no. 108207, 2022, doi: 10.1016/j.asoc.2021.108207.
[8] Z. Feng, M. Liang, and F. Chu, “Recent Advances in Time–Frequency Analysis Methods for Machinery Fault Diagnosis: A Review With Application Examples,” Mechanical Systems and Signal Processing, vol. 38, no. 1, pp. 165–205, 2013, doi: 10.1016/j.ymssp.2013.01.017.
[9] W. Li, Z. Zhu, F. Jiang, G. Zhou, and G. Chen, “Fault Diagnosis of Rotating Machinery With a Novel Statistical Feature Extraction and Evaluation Method,” Mechanical Systems and Signal Processing, vol. 50–51, pp. 414–426, 2015, doi: 10.1016/j.ymssp.2014.05.034.
[10] F. Lu, Q. Tong, Z. Feng, and Q. Wan, “Unbalanced Bearing Fault Diagnosis Under Various Speeds Based on Spectrum Alignment and Deep Transfer Convolution Neural Network,” IEEE Transactions on Industrial Informatics, vol. 19, no. 7, pp. 8188–8198, Jul. 2023, doi: 10.1109/TII.2022.3217541.
[11] L. Jian, K. Shao, Y. Liu, J. Li, and X. Liang, “OEC: An Online Ensemble Classifier for Mining Data Streams With Noisy Labels,” Data Mining and Knowledge Discovery, vol. 38, 2024, doi: 10.1007/s10618-023-00990-0.
[12] D. Mulimani, P. Patil, S. Totad, and R. Benni, “Online Detection and Adaptation of Concept Drift in Streaming Data Classification,” Procedia Computer Science, vol. 235, pp. 2803–2811, 2024, doi: 10.1016/j.procs.2024.04.265.
[13] Z. Wu, H. Wang, J. Guo, Q. Yang, and J. Shao, “Learning Evolving Prototypes for Imbalanced Data Stream Classification With Limited Labels,” Information Sciences, vol. 679, Art. no. 120979, 2024, doi: 10.1016/j.ins.2024.120979.
[14] J. Li, K. Malialis, C. G. Panayiotou, and M. M. Polycarpou, “Unsupervised Incremental Learning With Dual Concept Drift Detection for Identifying Anomalous Sequences,” in Proc. Int. Joint Conf. Neural Networks (IJCNN), Yokohama, Japan, 2024.
[15] B. Jiao, H. M. Gomes, B. Xue, Y. Guo, and M. Zhang, “A Semi-Supervised Active Learning Neural Network for Data Streams With Concept Drift,” IEEE Computational Intelligence Magazine, vol. 20, no. 1, Feb. 2025, doi: 10.1109/MCI.2024.3486680.
[16] D. Himaja, V. Dondeti, S. Uppalapati, and S. Virupaksha, “Cluster-Based Active Learning for Classification of Evolving Streams,” Evolutionary Intelligence, vol. 17, 2024, doi: 10.1007/s12065-023-00879-3.
[17] B. Halder, K. M. A. Hasan, T. Amagasa, and M. M. Ahmed, “Autonomic Active Learning Strategy Using Cluster-Based Ensemble Classifier for Concept Drifts in Imbalanced Data Stream,” Knowledge and Information Systems, 2025, doi: 10.1007/s10115-025-02647-4.
[18] S. Li, W. Wang, X. Jiang, J. Hua, J. Mao, Y. Lu, X. Jia, D. Wang, Z. Wang, and Y. Lu, “DDAL: A Drift Detection Active Learning Mechanism,” in Proc. 11th Int. Conf. Advanced Cloud and Big Data (CBD), Ocean Flower Island, Hainan, China, 2023.