The advent of machine learning has brought about a revolution and has become key to classification and prediction problems encompassing a variety of application domains. There are a number of machine learning techniques with Naïve Bayes, Artificial Neural Networks (ANN) and decision tree being the more popular ones. This paper reviews the aforementioned machine learning algorithms in terms of their suitability for particular problem domains. It presents a comprehensive discussion on the strengths and weaknesses of each of these machine learning algorithms. Uncertainty prevails in data as learning data is usually imprecise, incomplete or noisy. The uncertainities in data mining affect the quality of results which are based on the data.The traditional data mining approaches are not suitable to handle some forms of uncertainty and vagueness. Several forms of vagueness and ambiguities are handled successfully by hybrid machine learning techniques.The paper further studies the efficacy of hybrid machine learning algorithms used in different application domains. It presents a discusssion on how uncertainty in data analyses can be addressed in an effective manner by the usage of hybrid machine learning techniques.

Naïve Bayes, artificial neural networks, decision tree, hybrid machine learning, uncertainty

[1] U. M. Fayyad, G. P.Shapiro, P. Smyth, R. Uthurusamy, “Advances in Knowledge Discovery and Data Mining”, AAAI/MIT Press, Menlo park, pp. 1-34, 1996, ISBN 0-262-56097-6.
[2] Y. Li, J. Chen, L. Feng, “Dealing with Uncertainty: A Survey of Theories and Practices”, IEEE transactions on knowledge and data engineering, Vol. 25, No. 11, 2013. DOI: 10.1109/TKDE.2012.179
[3] D. C. Psichogios, L. H. Ungar, “A hybrid neural network-first principles approach to process modeling”, AIChE Journal, Vol. 38, No. 10, pp. 1499-1511, 1992. DOI: 10.1002/aic.690381003
[4] M. L.Thompson, M. A. Kramer, “Modeling chemical processes using prior knowledge and neural networks”, AIChE Journal, Vol. 40, No. 8, pp. 1328-1340, 1994. DOI : 10.1002/aic.690400806
[5] A. Buczak, E. Guven, “A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection”, IEEE COMMUNICATIONS SURVEYS & TUTORIALS, Vol. 18, No. 2, pp. 1153-1174, 2016. DOI: 10.1109/COMST.2015.2494502
[6] K. Kushwaha, P. Mishra, “A Survey on Data Mining using Machine Learning Techniques”, International Journal of Advanced Research in Computer and Communication Engineering, Vol. 5, No. 9, pp. 177-180, 2016. DOI: 10.17148/IJARCCE.2016.5940
[7] G. kumar, R. Kalra, “A survey on Machine Learning Techniques in Health Care Industry”, International Journal of Recent Research Aspects, Vol. 3, No. 2, pp. 128-132, 2016.
[8] M. Rambhajani, W. Deepanker, N. Pathak, “A Survey On Implementation Of Machine Learning Techniques For Dermatology Diseases Classification”, International Journal of Advances in Engineering & Technology, Vol. 8, No. 2, pp. 194-200, 2015.
[9] W. Y. Lin, Y. H. Hu, C. F. Tsai, “Machine Learning in Financial Crisis Prediction: A Survey”, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), Vol. 42, No. 4, pp. 421-436, 2012. DOI: 10.1109/TSMCC.2011.2170420
[10] N. Haq, A. Onik, M. Hridoy, M. Rafni, F. Shah and D. Farid, “Application of Machine Learning Approaches in Intrusion Detection System: A Survey”, International Journal of Advanced Research in Artificial Intelligence, Vol. 4, No. 3, pp. 9-17, 2015.
[11] Q. Do, J. Chen, “A Neuro-Fuzzy Approach in the Classification of Students’ Academic Performance”, Computational Intelligence and Neuroscience, Vol. 2013, pp. 1-7, 2013.
[12] A. Ganivada, S. Dutta, S. Pal, “Fuzzy rough granular neural networks, fuzzy granules, and classification”, Theoretical Computer Science, vol. 412, no. 42, pp. 5834-5853, 2011.
[13] D. Kaul, H. Raju, B. Tripathy, “Comparative Analysis of Pure and Hybrid Machine Learning Algorithms for Risk Prediction of Diabetes Mellitus”, Helix, vol. 7, no. 5, pp. 2029-2033, 2017.
[14] A. Marconato, A. Boni, D. petri, “Estimating and Controlling the Uncertainty of Learning Machines”, Proceedings of the 2006 IEEE International Workshop on Advanced Methods for Uncertainty Estimation in Measurement, AMUEM 2006, Sardagna, pp. 46-50, 2006. DOI: 10.1109/AMYEM.2006.1650747
[15] D. L. Shrestha, D. P. Solomatine, “Comparing machine learning methods in estimation of model uncertainty”, IEEE International Joint Conference on Neural Networks, IJCNN 2008, (IEEE World Congress on Computational Intelligence), Hong Kong, pp. 1410 – 1416, 2008. DOI: 10.1109/IJCNN.2008.4633982
[16] Y. Jiang, C. Xu, J. Gou, Z. Li, “Research on rough set theory extension and rough reasoning”, IEEE International Conference on Systems, Man and Cybernetic,The Hague, Vol. 6, pp. 5888 – 5893, 2004. DOI: 10.1109/ICSMC.2004.1401135
[17] J. L. Rong, L. S. Feng, “The grey rough measure of knowledge based on rough membership function”, IEEE International Conference on Systems, Man and Cybernetics, ISIC, Montreal, pp. 2191 – 2195, 2007. DOI: 10.1109/ICSMC.2007.4413632
[18] M. Bit, T. Beaubouef, “Rough set uncertainty for robotic systems”, Journal of Computing Sciences in Colleges, Vol. 23, No. 6, pp. 126-132, 2008.
[19] A. Basiri, P. Amirian, A. Winstanley, C. Kuntzsch, M. Sester, “Uncertainty handling in navigation services using rough and fuzzy set theory”, QUeST `12:Proceedings of the Third ACM SIGSPATIAL International Workshop on Querying and Mining Uncertain Spatio-Temporal Data, Redondo Beach, California, pp. 38-41, 2012. DOI:10.1145/2442985.2442991
[20] Y. Lu, Y. J. Lei, Y. Lei, “Intuitionistic fuzzy rough set based on intuitionistic similarity relation”, Control and Decision Conference, CCDC 2008, Yantai, pp. 794-799, 2008. DOI: 10.1109/CCDC.2008.4597422
[21] S. J. Simoff, “Handling uncertainty in neural networks: an interval approach”, IEEE International Conference on Neural Networks, Washington, Vol. 1, pp. 606 – 610, 1996.
DOI: 10.1109/ICNN.1996.548964
[22] J. Gong, S. Sun, “Research of Attribute Value Rough Equality Based-on the Hopfield Neural Network and Rough Set Theory”, Fifth International Conference on Natural Computation, ICNC `09, Tianjin, Vol. 1, pp. 256 – 260. DOI: 10.1109/ICNC.2009.424
[23] C. S. Lee, “A rough-fuzzy hybrid approach on a Neuro-Fuzzy classifier for high dimensional data”, The 2011 International Joint Conference on Neural Networks (IJCNN), pp. 2764 – 2769, 2011. DOI: 10.1109/IJCNN.2011.6033582
[24] X. M. Huang, J. K. Yi, Y. H. Zhang, “A method of constructing fuzzy neural network based on rough set theory”, International Conference on Machine Learning and Cybernetics, Xi’an,Vol. 3, pp. 1723 – 1728, 2003. DOI: 10.1109/ICMLC.2003.1259775
[25] R. Full´er, “Neural Fuzzy Systems”, Abo ISBN 951-650-624-0, ISSN 0358-5654, 1995.
[26] J. Zhao and Z. Zhang, “Fuzzy Rough Neural Network and Its Application to Feature Selection”, in Fourth International Workshop on Advanced Computational Intelligence, Wuhan, pp. 684-687, 2011. DOI: 10.1109/ICMLC.2003.1259775
[27] S. Maitra and S.Madan, “Intelligent Cyber Security Solutions through High Performance Computing And Data Sciences : An Integrated Approach”, Advances In High Performance Computing, Data Sciences & Cyber Security (NCETIT’2017), New Delhi, pp. 3-9.
[28] S.J. Nasti, M. Asgar, M.A. Butt , "Analysis of Customer Behaviour using Modern Data Mining Techniques", International Journal of Computer Sciences and Engineering, Vol.5, Issue.12, pp.64-66, 2017.