Multiclass Support Vector Machines with Simultaneous Multi-Factors Optimization for Corporate Credit Ratings

Authors: Hyunchul Ahn, William X. S. Wong

Abstract:

Corporate credit rating prediction is one of the most important topics, which has been studied by researchers in the last decade. Over the last decade, researchers are pushing the limit to enhance the exactness of the corporate credit rating prediction model by applying several data-driven tools including statistical and artificial intelligence methods. Among them, multiclass support vector machine (MSVM) has been widely applied due to its good predictability. However, heuristics, for example, parameters of a kernel function, appropriate feature and instance subset, has become the main reason for the critics on MSVM, as they have dictate the MSVM architectural variables. This study presents a hybrid MSVM model that is intended to optimize all the parameter such as feature selection, instance selection, and kernel parameter. Our model adopts genetic algorithm (GA) to simultaneously optimize multiple heterogeneous design factors of MSVM.

Keywords: Corporate credit rating prediction, feature selection, genetic algorithms, instance selection, multiclass support vector machines.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1123929

References:

[1] H. Ahn, K.-j. Kim, and I. Han, “Intelligent credit rating model for Korean companies using multiclass support vector machines,” Korean Management Review, vol. 35, no. 5, pp. 1479–1496, 2006.
[2] H. Ahn and K.-j. Kim, “Corporate bond rating using various multiclass support vector machines,” Asia Pacific Journal of Information Systems, vol. 19, no. 2, pp. 157–178, 2009.
[3] K.-j. Kim and H. Ahn, “A corporate credit rating model using multi-class support vector machines with an ordinal pairwise partitioning approach,” Computers & Operations Research, vol. 39, no. 8, pp. 1800–1811, 2012.
[4] H. Ahn, “Optimization of multiclass support vector machine using genetic algorithm: Application to the prediction of corporate credit rating,” Information Systems Review, vol. 16, no. 3, pp. 161–177, 2014.
[5] Z. Huang, H. Chen, C.-J. Hsu, W-H. Chen, and S. Wu, “Credit rating analysis with support vector machines and neural networks: A market comparative study”, Decision Support Systems, vol. 37, no. 4, pp. 543–558, 2004.
[6] A. C. Lorena and A. P. L. F. de Carvalho, “Evolutionary tuning of SVM parameter values in multiclass problems,” Neurocomputing, vol. 71, nos. 16–18, pp. 3326–3334, 2008.
[7] M.-D. Shieh and C.-C. Yang, “Multiclass SVM-RFE for product from feature selection,” Expert Systems with Applications, vol. 35, nos. 1–2, pp. 531–541, 2008.
[8] S. Chatterjee, “Vision-based rock-type classification of limestone using multi-class support vector machine,” Neurocomputing, vol. 39, no. 1, pp. 14–27, 2013.
[9] J. Chen, C. Zhang, X. Xue, and C.-L. Liu, “Fast instance selection for speeding up support vector machines,” Knowledge-Based Systems, vol. 45, pp. 1–7, 2013.
[10] H. Ahn and K.-j. Kim, “Global optimization of case-based reasoning for breast cytology diagnosis,” Expert Systems with Applications, vol. 36, no. 1, pp. 724–734, 2009.
[11] H. Ahn and K.-j. Kim, “Bankruptcy prediction modeling with hybrid case-based reasoning and genetic algorithms approach,” Applied Soft Computing, vol. 9, no. 2, pp. 599–607, 2009.
[12] H. Ahn, K. Lee, and K.-j. Kim, “Global optimization of support vector machines using genetic algorithms for bankruptcy prediction,” Lecture Notes in Computer Science, vol. 4234, pp. 420–429, 2006.
[13] G. E. Pinches and K. A. Mingo, “A multivariate analysis of industrial bond ratings,” Journal of Finance, vol. 28, no. 1, 1973, pp. 1–18.
[14] A. Belkaoui, “Industrial bond ratings: A new look,” Financial Management, vol. 9, no. 3, pp. 44–51, 1980.
[15] L. H. Ederington, “Classification models and bond ratings,” The Financial Review, vol. 20, no. 4, pp. 237–262, 1985.
[16] J. W. Kim, “Expert systems for bond rating: a comparative analysis of statistical, rule-based and neural network systems,” Expert Systems, vol. 10, no. 3, pp. 167–171, 1993.
[17] J. Moody and J. Utans, “Architecture selection strategies for neural networks application to corporate bond rating,” in Neural Networks in the Capital Markets, A. Refenes, Ed., Chichester: Wiley, 1995, pp. 277–300.
[18] J. J. Maher and T. K. Sen, “Predicting bond ratings using neural networks: a comparison with logistic regression,” Intelligent Systems in Accounting, Finance and Management, vol. 6, no. 1, pp. 59–72, 1997.
[19] Y. S. Kwon, I. Han, and K. C. Lee, “Ordinal pairwise partitioning (OPP) approach to neural networks training in bond rating,” Intelligent Systems in Accounting, Finance and Management, vol. 6, no. 1, pp. 23–40, 1997.
[20] R. Chaveesuk, C. Srivaree-Ratana, and A. E. Smith, “Alternative neural network approaches to corporate bond rating,” Journal of Engineering Valuation and Cost Analysis, vol. 2, no. 2, pp. 117–131, 1999.
[21] K. S. Shin and I. Han, “A case-based approach using inductive indexing for corporate bond rating,” Decision Support Systems, vol. 32, no. 1, pp. 41–52, 2001.
[22] L. Cao, L. K. Guan, and Z. Jingqing, “Bond rating using support vector machine,” Intelligent Data Analysis, vol. 10, no. 3, pp. 285–296, 2006.
[23] W.-H. Chen and Shih J.-Y., “A study of Taiwan’s issuer credit rating systems using support vector machines,” Expert Systems with Applications, vol. 30, no. 3, pp. 427–435, 2006.
[24] Y.-C. Lee, “Application of support vector machines to corporate credit rating prediction,” Expert Systems with Applications, vol. 33, no. 1, pp. 67–74, 2007.
[25] V. Vapnik, The Nature of Statistical Learning Theory. New York, NY: Springer–Verlag, 1995.
[26] U. Kreβel, “Pairwise classification and support vector machines,” in Advances in Kernal Methods: Support Vector Learning, B. Scholkopf, C. Burges, and A. J. Smola, Eds., Cambridge, MA: MIT Press, 1999, pp. 255–268.
[27] A. Statnikov, C. F. Aliferis, I. Tsamardinos, D. Hardin, and S. Levy, “A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis,” Bioinformatics, vol. 21, no. 5, pp. 631–643, 2005.
[28] J. C. Platt, N. Cristianini, and J. Shawe-Taylor, “Large margin DAG’s for multiclass classification,” in Advances in Neural Information Processing Systems 12, S. A. Solla, T. K. Leen, and K.-R. Muller, Eds., Cambridge, MA: MIT Press, 2000, pp. 547–553.
[29] J. Weston and C. Watkins, “Support vector machines for multiclass pattern recognition,” in Proc. of the Seventh European Symposium on Artificial Neural Networks, 1999, pp. 219–224.
[30] C. W. Hsu and C. J. Lin, “A comparison of methods for multiclass support vector machines,” IEEE Transactions on Neural Networks, vol. 13, no. 2, pp. 415–425, 2002.
[31] T. Hong and J. Park, “Feature selection for multi-class support vector machines using an impurity measure of classification trees: An application to the credit rating of S&P 500 companies,” Asia Pacific Journal of Information Systems, vol. 21, no. 2, pp. 43–58, 2011.
[32] F. E. H. Tay and L. Cao, “Application of support vector machines in financial time series forecasting,” Omega, vol. 29, pp. 309-317, 2001.