Using Curve Fitting in Error Correcting Output Codes

نویسندگان

1 Master of Artificial Intelligence, Computer Engineering Department, Alzahra University, Iran

2 Associative Professor, Computer Engineering Department, Alzahra University, Iran

چکیده

The Error Correcting Output Codes (ECOC) represent any number of the binary classifiers to model the multiclass problems successfully. In this paper, we have used Curve Fitting as a binary classifier in ECOC algorithm to solve multiclass classification problems. Curve Fitting is a classifier based on a nonlinear decision boundary that separates two pattern classes by the curves of the best fit, and arriving at optimal boundary points between two classes. Since we need a coding and a decoding strategy to design an ECOC system, this paper gives five coding and eight decoding strategies of ECOC and compares the results of Curve Fitting with Adaboost classification and Nearest Mean Classifier (NMC). This evaluation has been performed on different data sets of UCI machine learning repository. The results indicate that One-versus-one, ECOC-ONE coding and LAP, BDEN decoding having the best results in contrast with another coding and decoding strategies and Curve Fitting  is a good base classifier in ECOC, also it is comparable with the other ECOC approaches.

کلیدواژه‌ها

مراجع

[1]     V. Vapnik, The nature of statistical learning theory, Springer-Verlag, 1995.
[2]     J. Friedman, T. Hastie, R. Tibshirani, Additive logistic regression: a statistical view of boosting, The Annals of Statistics vol. 38 (2) 1998, pp. 337–374.
[3]     L. Breiman, J. Friedman, R. Olshen, C. Stone, Classification and Regression Trees, Wadsworth, 1984.
[4]     R.A. Jacobs, M.I. Jordan, S.E. Nowlan, G.E. Hinton, Adaptive mixture of experts, Neural Computation 3, 1991, pp 79–87.
[5]     T. G. Dietterich and G. Bakiri, Solving multi class learning problems via error correcting output codes, J. of Artificial Intelligence Research 2, 1995, pp263-286.
[6]     S. Escalera, O. Pujol, and P. Radeva. Boosted landmarks of contextual descriptors and forest-ecoc: A novel framework to detect and classify objects in clutter scenes. PatternRecognition Letters, vol. 28, no. 13, 2007, pp. 1759–1768.
[7]     E. Allwein, R. Schapire, Y. Singer, Reducing multi class to binary: A unifying approach for margin classifiers, Journal of Machine Learning Research vol. 1, 2002, pp. 113–141.
[8]     T.Windeatt, R. Ghaderi, Coding and decoding for multiclass learning problems, Information Fusion vol. 4, no. 1, 2003, pp. 11–21.
[9]     T. Dietterich, E. Kong, Error-correcting output codes corrects bias and variance, in: P. of the 21th ICML (Ed.), S. Prieditis and S. Russell, 1995, pp. 313–321.
[10]  Thomas G. Dietterich, GhulumBakiriSolvingMulti class Learning Problems via Error-Correcting Output Codes, Journal of Arti_cial Intelligence Research 2, 1995, pp. 263,286.
[11]  Sergio Escalera, OriolPujol, and PetiaRadeva, Error-Correcting Output Coding for Chagasic Patients Characterization, 19th International Conference on Pattern Recognition, vol. 17, 2008, pp. 1-4.
[12]  Sergio Escalera, David M.J. Tax, OriolPujol, PetiaRadeva, and Robert P.W. Duin, Multiclass Classification in Image Analysis via Error-Correcting Output Codes, H. Kwa´snicka& L.C. Jain (Eds.): Innovations in Intell. Image Analysis, SCI 339, springerlink.com _c Springer-Verlag Berlin Heidelberg, 2011, pp. 7–29.
[13]  Ganjeshvaidyanathan.s.DR.BibbasKar,DR.N.Kumaravel,A Curve Fitting  approach to separation of nonlinear separable pattern classes, applied to chromosome classification, IEEE international conference on signal processing, 2008.
[14]  C James; Truncating criteria for polynomial Curve Fitting ; 1971, J.Phys.D:Appl.Phys.4, pp 357-363.
[15]  Draper, N. R; smith,H. Applied regression Analysis; 3rdedition.Johnwiley& Sons, 1998.
[16]  White; Micromaths: Cubic Spline Curve Fitting, mathematics applications, 1986, pp 39-45.
[17]  E. Allwein, R. Schapire, Y. Singer, Reducing multi class to binary: A unifying approach for margin classifiers, Journal of Machine Learning Research, vol. 1, 2002, pp. 113–141.
[18]  T. Hastie, R. Tibshirani, Classification by pairwise grouping, The annals of statistics, vol. 26, no. 5, 1998, pp. 451–471.
[19]  T. Dietterich, G. Bakiri, Error-correcting output codes: A general method for improving multi class inductive learning programs, in: A. Press (Ed.), 9th CAI, 1991, pp. 572–577.
[20]  A Asuncion and D.J Newman UCI machine learning repository. http://www.ics.uci.edu/~mlearn/MLRepository.html, 2007, University of California, Irvine,school of Information and Computer Science.
[21]  A.Rocha, S. Goldenstein, Multiclass from Binary: Expanding One-vs-All, One-vs-One and ECOC-based Approaches, IEEE Transaction on neural networks and learning system, 2013, pp. 1757–1772.
[22]  Martine Pelikan, David E. Goldberg, and Erick Cantu-Pez. Learning machines, In McGraw-Hill, 1965.
[23]  E. Allwein, R. schapire, and Y, Singer, Reducing multi class to binary: A unifying approach for margine classifiers, volume 1, 2002, pp, 113-141.
[24]  O. PujolM.Rosales, and P.Radeva. Intravascular ultrasound images vessel characterization using Adaboost, Functional Imaging and Modeling of the Heart, 2003, pp. 242-251.
مجله علمی رایانش نرم و فناوری اطلاعات
دوره 5، شماره 1 - شماره پیاپی 1
69
فروردین 1395
صفحه 62-69

فایل ها

هم رسانی

ارجاع به این مقاله

آمار