A scientific review of soft-computing techniques and methods for stock market prediction

  • Authors

    • Muhammad R. Islam
    • I F.T. Al-Shaikhli
    • A Abdulkadir
    2018-03-10
    https://doi.org/10.14419/ijet.v7i2.5.10049
  • Web-Text Mining, Soft-Computing Methods, Stock Market Prediction

  • Abstract

    Information could be power if most technological approach engaged in the era of IT.  Web based text mining is one of the approach that could be analyzed in many ways through soft-computing methods and techniques. The analytical result has shown that different methods of text mining have several advantages with the gap of knowledge that is required to improve. This paper explores the performance of various methods and its impact on specific text mining field such as web based financial text analysis for stock prediction. Key research area of financial text mining is becoming one of the potential research field based on the source of online news, forums, blogs or social media.

  • References

    1. [1] Arman Khadjeh Nassirtoussi, Saeed Aghabozorgi, The Yign Wah, David Chek Ling Ngo. 2014, "Text Mining for Market Prediction: A systematic review" Expert Systems with Applications, Vol. 41, pp. 7653-7670, Available: www.elsevier.com/locate/eswa [Accessed 8 August 2016], DOI: 10.1016/j.eswa.2014.06.009.
      [2] D. K. Kirange, "Sentiment Analysis of News Headlines for Stock Sentiment Analysis of News Headlines for Stock Price Prediction," 2016, An International Journal of Advance Computer Technology. vol. 5, pp.1-6, . April 2016 pp. 1-6, DOI: 10.13140/RG.2.1.4606.3765
      [3] Schumaker, Robert P.Chen, Hsinchun, February 2009, "Textual analysis of stock market prediction using breaking financial news" , ACM Transactions on Information Systems, Vol.27, Available: http://dl.acm.org/citation.cfm?id=1462204 [Accessed: 10 August 2016], DOI: 10.1145/1462198.1462204.
      [4] Uysal, Alper Kursat Gunal, Serkan, 2014, "The impact of preprocessing on text classification", Information Processing and Management, Vol.50, Available : http://dx.doi.org/10.1016/j.ipm.2013.08.006, DOI: 10.1016/j.ipm.2013.08.006.
      [5] Wong, Felix Ming Fai, Liu, Zhenming, Chiang, Mung, 2014. "Stock Market Prediction from WSJ: Text Mining via Sparse Matrix Factorization", 2014 IEEE International Conference on Data Mining, 2014 pp. 430-439, DOI: 10.1109/ICDM.2014.116,
      [6] Thomas, James D. Sycara, Katia, 1999, "Integrating Genetic Algorithms and Text Learning for Financial Prediction", Data Mining with Evolutionary Algorithms, 2000, pp.72-75, Available:http://citeseer.ist.psu.edu/308554.html%5Cnhttp://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.34.8655&rep=rep1&type=pdf, Accessed: [10th Octobor'16]
      [7] Fama, Eugene F, "American Finance Association Efficient Capital Markets: A Review of Theory and Empirical Work", 7th Feb, 2007, Finance. 1970, Vol.25, N0.2, pp. 28-30, DOI:10.2307/2325486, MPID: 19724231
      [8] Schumaker, Robert P. Chen, Hsinchun, "Textual analysis of stock market prediction using breaking financial news", February 2009, ACM Transactions on Information Systems, 2009, Vol.27. pp.1-19. DOI: 10.1145/1462198.1462204, PMID: 20434961
      [9] Reboredo, Juan C. Rivera-Castro, Miguel A. Miranda, Josï¿© G V Garc?a-Rubio, Raquel,2013 "How fast do stock prices adjust to market efficiency? Evidence from a detrended fluctuation analysis", Physica A: Statistical Mechanics and its Applications, 2013, Vol.392, pp 1631-1637, DOI: 10.1016/j.physa.2012.11.038
      [10] Lo, Andrew W, 2004, "The Adaptive Markets Hypothesis", The Journal of Portfolio Management, 2005, Vol. 7, pp 15-29, DOI: 10.3905/jpm.2004.442611
      [11] Yu, Hao, Nartea, Gilbert V. Gan, Christopher Yao, Lee J. 2013 "Predictive ability and profitability of simple technical trading rules: Recent evidence from Southeast Asian stock markets", 2013, International Review of Economics and Finance, Vol.25, pp:356-371, DOI:10.1016/j.iref.2012.07.016
      [12] Morta, Rena, Morta, Shalini, Dadios, Elmer, 2015, "Modeling Market Data and Technical Indicators with Fuzzy Logic to develop a Trading Algorithm for an Individual Stock in the Philippines", 9-12 Decemper 2015, Philippines. IEEE International Conference Humanoid, Nanotechnology, Information Technology The Institute of Electrical and Electronics Engineers Inc. (IEEE) - Philippine Section Communication and Control, Environment and Management (HNICEM), pp:9-12.
      [13] Y. Hu, K. Liu, X. Zhang, L. Su, E. Ngai, and M. Liu, 2015, "Application of evolutionary computation for rule discovery in stock algorithmic trading," Applied Soft Computing Journal., vol. 36, no. C, pp. 534-551, Nov. 2015. DOI: 10.1016/j.asoc.2015.07.008.
      [14] Vijay Gaikwad, P. D. Y Patil, and P. Patil, January 2014 "Text Mining Methods and Techniques," Int. J. Comput. Appl., vol. 85, no. 17, pp. 42-45, 2014.
      [15] F. Beil, M. Ester, and X. Xu, 2002 "Frequent term-based text clustering," Proc. eighth ACM SIGKDD, Edmonton, Alberta, Canada,2002, KDD, Int. Conf. Knowl. Discov. data Min. KDD, pp. 436-442.
      [16] S. Chakrabarti, 2003, "Mining The Web Doscovering Knowledge from Hypertext Data",University of Illinois, Urbana-Champaign. 2003. ISBN: 1558607544
      [17] H. Ahonen, O. Heinonen, M. Klemettinen, and a. I. Verkamo, 1998,"Applying data mining techniques for descriptive phrase extraction in digital document collections," Proc. IEEE Int. Forum Res. Technol. Adv. Digit. Libr. -ADL'98-, pp. 2-11, Available from: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=670374,[Accessed 12 June'16] DOI:10.1109/ADL.1998.670374
      [18] S. Shehata, F. Karray, and M. Kamel, 2007, "A concept-based model for enhancing text categorization," Proc. 13th ACM SIGKDD Int. Conf. Knowl. Discov. data Min. - KDD, Sun Jose, California, USA, August 12-15, 2007 p. 629-637.
      [19] S.-T. W. S.-T. Wu, Y. L. Y. Li, Y. X. Y. Xu, B. P. B. Pham, and P. C. P. Chen, 2004, "Automatic Pattern-Taxonomy Extraction for Web Mining," IEEE/WIC/ACM Int. Conf. Web Intell., 2004,
      [20] G. a. Miller, 1995, "WordNet: a lexical database for English," Commun. ACM, 1995, vol. 38, no. 11, pp. 39-41, DOI: 10.1145/219717.219748, PMID: 17081734
      [21] C. S. Oyland, 2015 "Interday news-based prediction of stock prices and trading volume," Department of Applied Mechanis, Deficion of Vehicle Engineering and Autonomous System, Ahalmers University of Technology, Sweden 2015, vol. M, 2015. ISSN: 1652-8557.
      [22] U?uz, Harun, 2011, "A two-stage feature selection method for text categorization by using information gain, principal component analysis and genetic algorithm" Knowledge-Based Systems, 2011, Vol.24, pp: 1024-1032, DOI: 10.1016/j.knosys.2011.04.014.
      [23] Y. Yang, 1995, Noise reduction in a statistical approach to text categorization, in: Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'95), 1995, pp. 256-263.
      [24] Mladeni?, Dunja, Grobelnik, Marko, 2003, "Feature selection on hierarchy of web documents", Decision Support Systems, 2003, Vol.35, pp. 45-87, DOI: 10.1016/S0167-9236(02)00097-0.
      [25] Li, T. Zhang, C. Ogihara, M. 2004, "A comparative study of feature selection and multiclass classification methods for tissue classification based on gene expression" Bioinformatics, 2004, Vol. 20, pp. 2429-2437, DOI: 10.1093/bioinformatics/bth267, PMID: 15087314
      [26] Liu, Huawen, Sun, Jigui, Liu, Lei, Zhang, Huijie, 2009, "Feature selection with dynamic mutual information" Pattern Recognition 2009, Vol.42, pp: 1330-1339. DOI:10.1016/j.patcog.2008.10.028, PMID: 1443.
      [27] Chen, Yao Tsung, Chen, Meng Chang, 2011, "Using chi-square statistics to measure similarities for text categorization" Expert Systems with Applications 2011, Vol. 38, pp: 3085-3090, DOI: 10.1016/j.eswa.2010.08.100.
      [28] Saeys, Yvan, Inza, I?aki, Larra?aga, Pedro, 2007, "A review of feature selection techniques in Bioinformatics" Bioinformatics, 2007, Vo. 23, pp: 2507-2517, DOI:10.1093/bioinformatics/btm344, PMID: 17720704.
      [29] Shang, Wenqian, Huang, Houkuan, Zhu, Haibin, Lin, Yongmin, Qu, Youli, Wang, Zhihai, "A novel feature selection algorithm for text categorization", Expert Systems with Applications 2007, Vol. 33, pp: 1-5, DOI: 10.1016/j.eswa.2006.04.001.
      [30] M. Behrouzian, Said M.H, Aref Sayahi, 2014, "Feature Selection Techniques for Text Classification", International Journal of Computer Science and Network Solutions. 2014, Vol:2, pp: 90-94, Available: http://www.ijcsns.com.
      [31] Wu, Ke, Lu, Bao-Liang, Uchiyama, Masao, Isahara, Hitoshi, 2007, "A probabilistic approach to feature selection for multi-class text categorization", 2007, Advances in Neural Networks-ISNN 2007, 2007, pp: 1310-1317
      [32] S.S.R. Mengle, N. Goharian, 2013, "Ambiguity measure feature-selection algorithm, Journal of the American Society for Information Science and Technology", 2013, Vol. 14,pp: 90-103, 60 (5) (2009) 1037-1050. DOI: 10.1002/asi, PMID: 10.1002/asi.
      [33] J. Chen, H. Huang, S. Tian, Y. Qu, 2009, "Feature selection for text classification with Naive Bayes", Expert Systems with Applications, 2009, Vol.36, pp:5432-5435. DOI:10.1016/j.eswa.2008.06.054.
      [34] Shang, Wenqian Huang, Houkuan Zhu, Haibin, Lin Yongmin Qu, Youli Wang, Zhihai, 2007, "A novel feature selection algorithm for text categorization", Expert Syst. Appl. 2007, Vol. 33, pp: 1-5, DOI: http://dx.doi.org/10.1016/j.eswa.2006.04.001
      [35] Uysal, Alper Kursat Gunal, Serkan, 2014 "The impact of preprocessing on text classification", Information Processing and Management, 2014, Vol.50, pp: 104-112, DOI: 10.1016/j.ipm.2013.08.006, Available: http://dx.doi.org/10.1016/j.ipm.2013.08.006
      [36] Willett, Peter, 2006, "The porter Stemming Algorithm: Then and Now", Electronic Library and information Systems, 2006, Vol.40, pp: 219-223, DOI: 10.1145/1645953.1646241, PMID: 3800
      [37] K.-G. Aase and P. ?ztrk, 2011, "Text Mining of News Articles for Stock Price Predictions," Dep. Comput. Inf. Sci., 2011, vol. Msc., no. June, p. 82.
      [38] Navale, Prof G S Dudhwala, Nishant Jadhav, Kunal Gabda, Pawan Vihangam, Brij Kishor,2016, "Prediction of Stock Market Using Data Mining and Artificial Intelligence", Vol.134, pp. 6539-6544, DOI: 10.4010/2016.1571
      [39] Baharudin, BaharumLee, Lam Hong, Khan, Khairullah. February 2010, "A Review of Machine Learning Algorithms for Text-Documents Classification", Journal of Advances in Information Technology, Vol.1, pp. 4-20, DOI: 10.4304/jait.1.1.4-20
      [40] Rohit Choudhry and Kumkum Garg. March 29, 2008, "A Hybrid Machine Learning System for Stock Market Forecasting", World Academy of Science, Engineering and Technology. Vol.2, pp 315-318.
      [41] Ding, XiaoZhang, YueLiu, TingDuan, Junwen, 2015, "Deep Learning for Event-Driven Stock Prediction", Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence. (IJCAI ), China, 2015, pp: 2327-2333
      [42] M. Shrabanti and P. Anita, 2015, "New approach of text mining in r," GESJ: Computer Science and Telecommunications 2015 , vol. 1, no. 1(45), pp. 30-36, 2015.

  • Downloads

  • How to Cite

    R. Islam, M., F.T. Al-Shaikhli, I., & Abdulkadir, A. (2018). A scientific review of soft-computing techniques and methods for stock market prediction. International Journal of Engineering & Technology, 7(2.5), 27-31. https://doi.org/10.14419/ijet.v7i2.5.10049

    Received date: 2018-03-10

    Accepted date: 2018-03-10

    Published date: 2018-03-10