On the Learning of Causal Relationships between Banks in Saudi Equities Market Using Ensemble Feature Selection Methods

Authors: Adel Aloraini

Abstract:

Financial forecasting using machine learning techniques has received great efforts in the last decide . In this ongoing work, we show how machine learning of graphical models will be able to infer a visualized causal interactions between different banks in the Saudi equities market. One important discovery from such learned causal graphs is how companies influence each other and to what extend. In this work, a set of graphical models named Gaussian graphical models with developed ensemble penalized feature selection methods that combine ; filtering method, wrapper method and a regularizer will be shown. A comparison between these different developed ensemble combinations will also be shown. The best ensemble method will be used to infer the causal relationships between banks in Saudi equities market.

Keywords: Causal interactions , banks, feature selection, regularizere,

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1086909

References:

[1] Adel Aloraini, James Cussens, and Richard Birnie. Extending prostate cancer kegg pathways using machine learning of graphical models. In Systemics and Informatics World Network,SIWN, volume 10, pages 56– 67, 2010.
[2] Jerome Friedman, Trevor Hastie, and Robert Tibshirani. Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 0(0):1–10, 2007.
[3] Dan Geiger and David Heckerman. Learning Gaussian networks. In UAI, volume 10, pages 235–243, 1994.
[4] Isabelle Guyon. Practical Feature Selection: from Correlation to Causality. IOS Press, January 16 2008.
[5] Trevor Hastie, Robert Tibshirani, and Jerome Friedman. The Elements of Statistical Learning. Springer New York Inc., 2009.
[6] Tim C Hesterberg, Nam H Choi, Lukas Meier, and Chris Fraley. Least angle and l1 penalized regression: A review. Statistics Surveys, 2:61–93, 2008.
[7] Y. Hiemstra. Modeling structured nonlinear knowledge to predict stock market returns. .R. Trippi (Ed.), Chaos and Nonlinear Dynamics in the Financial Markets: Theory, Evidence and Applications, pages 163–175, 1995.
[8] K. Kim and I. Han. Genetic algorithms approach to feature discretization in artificial neural networks for the prediction of stock price index. Expert Syst. Appl, 19:125–132, 2000.
[9] K. Kim and I. Han. Financial time series forecasting using support vector machines. Neurocomputing, 55:307–319, 2003.
[10] KAZUHIRO KOHARA, TSUTOMU ISHIKAWA, YOSHIMI FUKUHARA, and YUKIHIRO NAKAMURA. Stock price prediction using prior knowledge and neural networks. Intelligent Systems in Accounting, Finance and Management, 6:12–22, 1997.
[11] Florian Markowetz and Rainer Spang. Inferring cellular networks - a review. BMC Bioinformatics, 8(S-6), 2007.
[12] Jie Peng, Pei Wang, Nengfeng Zhou, and Ji Zhu. Partial correlation estimation by joint sparse regression models. American Statistical Association, 104(486):735–746, 2009.
[13] Yvan Saeys, In aki Inza, and Pedro Larran aga. A review of feature selection techniques in bioinformatics. Bioinformatics, 23:2507–2517, 2007.
[14] Robert J. Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B, 58(1):267–288, 1996.
[15] G. Zhang, B.E. Patuwo, and M.Y. Hu. Forecasting with artificial neural networksthe state of the art. J. Forecasting, 14:35–62, 1998.