Open Access   Article Go Back

Stock Market Analysis and Prediction using Hadoop and Machine Learning

Piyush Jain1 , Kaustubh Bhat2 , HarshalKesharwani 3 , Pritesh Bhate4 , Khushboo P Khurana5

  1. Department of CSE, Shri Ramdeobaba College of Engineering and Management, Nagpur.
  2. Department of CSE, Shri Ramdeobaba College of Engineering and Management, Nagpur.
  3. Department of CSE, Shri Ramdeobaba College of Engineering and Management, Nagpur.
  4. Department of CSE, Shri Ramdeobaba College of Engineering and Management, Nagpur.
  5. Department of CSE, Shri Ramdeobaba College of Engineering and Management, Nagpur.

Section:Research Paper, Product Type: Journal Paper
Volume-6 , Issue-5 , Page no. 578-584, May-2018

CrossRef-DOI:   https://doi.org/10.26438/ijcse/v6i5.578584

Online published on May 31, 2018

Copyright © Piyush Jain, Kaustubh Bhat, HarshalKesharwani, Pritesh Bhate, Khushboo P Khurana . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

View this paper at   Google Scholar | DPI Digital Library

How to Cite this Paper

  • IEEE Citation
  • MLA Citation
  • APA Citation
  • BibTex Citation
  • RIS Citation

IEEE Style Citation: Piyush Jain, Kaustubh Bhat, HarshalKesharwani, Pritesh Bhate, Khushboo P Khurana, “Stock Market Analysis and Prediction using Hadoop and Machine Learning,” International Journal of Computer Sciences and Engineering, Vol.6, Issue.5, pp.578-584, 2018.

MLA Style Citation: Piyush Jain, Kaustubh Bhat, HarshalKesharwani, Pritesh Bhate, Khushboo P Khurana "Stock Market Analysis and Prediction using Hadoop and Machine Learning." International Journal of Computer Sciences and Engineering 6.5 (2018): 578-584.

APA Style Citation: Piyush Jain, Kaustubh Bhat, HarshalKesharwani, Pritesh Bhate, Khushboo P Khurana, (2018). Stock Market Analysis and Prediction using Hadoop and Machine Learning. International Journal of Computer Sciences and Engineering, 6(5), 578-584.

BibTex Style Citation:
@article{Jain_2018,
author = {Piyush Jain, Kaustubh Bhat, HarshalKesharwani, Pritesh Bhate, Khushboo P Khurana},
title = {Stock Market Analysis and Prediction using Hadoop and Machine Learning},
journal = {International Journal of Computer Sciences and Engineering},
issue_date = {5 2018},
volume = {6},
Issue = {5},
month = {5},
year = {2018},
issn = {2347-2693},
pages = {578-584},
url = {https://www.ijcseonline.org/full_paper_view.php?paper_id=2024},
doi = {https://doi.org/10.26438/ijcse/v6i5.578584}
publisher = {IJCSE, Indore, INDIA},
}

RIS Style Citation:
TY - JOUR
DO = {https://doi.org/10.26438/ijcse/v6i5.578584}
UR - https://www.ijcseonline.org/full_paper_view.php?paper_id=2024
TI - Stock Market Analysis and Prediction using Hadoop and Machine Learning
T2 - International Journal of Computer Sciences and Engineering
AU - Piyush Jain, Kaustubh Bhat, HarshalKesharwani, Pritesh Bhate, Khushboo P Khurana
PY - 2018
DA - 2018/05/31
PB - IJCSE, Indore, INDIA
SP - 578-584
IS - 5
VL - 6
SN - 2347-2693
ER -

VIEWS PDF XML
628 413 downloads 171 downloads
  
  
           

Abstract

The share market is the new business for many individuals and companies.The stock market attracts many as there is a huge profitinvolved. But there can be huge loss as well. The world suffered from many economic crises due to itsdownfall, which may have cost lives and way of living of many. If the share prices couldbe predicted, this can help in avoiding the economic crisis.Many business analysts said that the share market cannot be predicted and it is completelyrandom, but there is no common opinion about that. Many also said that it can bepredicted but with using different measures. In this paper, we have proposed a technique to perform stock market data analysis to find if there exists a relation between stock price change of two companies- TCS and Infosys. This is done using Big data technique by performing sentiment analysis of Tweets from Twitter and finding the correlation. Also, machine learning techniques are applied on the BSE data of the companies to predict the stock prices of next day. The results of allthe factors like sentiments, similar industrial shares, and index shares are combined to get to the conclusion. We found that the share market depends on the numerous factors and considering only certain factorsare insufficient for analysis.

Key-Words / Index Term

Hadoop, Map-reduce, Machine learning, Sentiment analysis, Stock Market

References

[1] B. G. Malkiel, “A Random Walk Down Wall Street”, W. W. Norton,
New York. 1973.
[2] R. Iacomin, “Stock Market Prediction,”2015 19th International Conference on System Theory, Control and Computing (ICSTCC), October 14-16, CheileGradistei, Romania
[3] S., Kamath, “Stock Market Analysis,” Master`s Projects, pp. 326, 2012.
[4] V. Rajput, S.Bobde, “Stock Market Forecasting Techniques: Literature Survey,” International Journal of Computer Science and Mobile Computing, 5(6), June 2016, 500-506.
[5] G. S., Navale, N., Dudhwala, K., Jadhav, P., Gabda, & B. J., Vihangam. , “Prediction of Stock Market using Data Mining and Artificial Intelligence,” International Journal of Computer Science and MobileComputing, 134(12), January 2012, pp 9-11.
[6] A. Gupta and B. Dhingra, "Stock market prediction using Hidden Markov Models," 2012 Students Conference on Engineering and Systems, Allahabad, Uttar Pradesh, 2012, pp. 1-4.
[7] P. Somani, S. Talele and S. Sawant, "Stock market prediction using Hidden Markov Model," 2014 IEEE 7th Joint International Information Technology and Artificial Intelligence Conference, Chongqing, 2014, pp. 89-92.
[8] Z. Zhang, Y. Shen, G. Zhang, Y. Song and Y. Zhu, "Short-term prediction for opening price of stock market based on self-adapting variant PSO-Elman neural network," 2017 8th IEEE International Conference on Software Engineering and Service Science (ICSESS), Beijing, China, 2017, pp. 225-228.
[9] M. Naeini, H. Taremian and H. Hashemi, “Stock Market Value Prediction Using Neural Networks,” International Conference on Computer InformationSystems and Industrial Management Applications (CISIM) 2010.
[10] A. Rao, S. Hule, H. Shaikh, E. Nirwan and P. M. Daflapurkar, "Survey: Stock Predictive Models Using Multilayer Perceptron", International Journal of Computer Sciences and Engineering, Vol.4, Issue.5, pp.111-113, 2016.
[11] S. Asadifar and M. Kahani, "Semantic association rule mining: A new approach for stock market prediction," 2017 2nd Conference on Swarm Intelligence and Evolutionary Computation (CSIEC), Kerman, 2017, pp. 106-111.
[12] M. R. Vargas, B. S. L. P. de Lima and A. G. Evsukoff, "Deep learning for stock market prediction from financial news articles," 2017 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), Annecy, 2017, pp. 60-65.
[13] Jiahong Li, Hui Bu and Junjie Wu, "Sentiment-aware stock market prediction: A deep learning method," 2017 International Conference on Service Systems and Service Management, Dalian, 2017, pp. 1-6.
[14] W. Chen, Y. Zhang, C. K. Yeo, C. T. Lau and B. S. Lee, "Stock market prediction using neural network through news on online social networks," 2017 International Smart Cities Conference (ISC2), Wuxi, 2017, pp. 1-6.
[15] S. Gour, "Developing Decision Model by Mining Historical Prices Data of Infosys for Stock Market Prediction", International Journal of Computer Sciences and Engineering, Vol.4, Issue.10, pp.92-97, 2016.
[16] J.K.Sharma, “Business Statistics,” Pearson Education, India, pp. 454-455, 2007.
[17] P.Domingos, “A Few Useful Things to Know about Machine Learning,” Communications of the ACM, Vol. 55 No. 10, October 2012, Pages 78-87.