Automatic question-answering (QA) system is a typical problem in natural language processing task to automatically produce relevant answer to a posed question. This work provides an overview of various techniques and methods employed to solve this typical question-answering problem. The basic idea behind QA system is to support the urge for information. This paper provides a brief review of different types of QA systems and work done so far. It is observed that the lexical gap and semantics with respect to context poses new challenges in question answer system. An attempt is made to provide a review of traditional and deep learning techniques employed for solving the research problem is made in order to bring an insight to research scope in this direction. We provide a proposed framework of question answer system using deep learning approach. The paper also discusses limitation and considerations for the said system.

Question Answer system, knowledge base, deep learning

[1]. L. Hirschman and R. Gaizauskas, "Natural language question answering: the view from here," Natural Language Engineering, vol. 7, no. 4, pp. 275-300, 2001
[2]. Green BF, Wolf AK, Chomsky C, and Laughery K. “Baseball: An automatic question answerer”, In Proceedings of Western Computing Conference, Vol. 19, 1961, pp. 219–224.
[3]. Woods W. “Progress in Natural Language Understanding - An Application to Lunar Geology”, In Proceedings of AFIPS Conference, Vol. 42, 1973, pp. 441–450.
[4]. Ittycheriah A, Franz M, Zhu WJ, Ratnaparkhi A and Mammone RJ,“IBM’s statistical question answering system” In Proceedings of the Text Retrieval Conference TREC-9, 2000.
[5]. Moschitti A. “Answer filtering via text categorization in question answering systems”, In Proceedings of the 15th IEEE International Conference on Tools with Artificial Intelligence, 2003, pp. 241-248.
[6]. Zhang K, Zhao J. “A Chinese question answering system with question classification and answer clustering” in Proceedings of IEEE International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), Vol.6, 2010, pp. 2692-2696.
[7]. Han L, Yu ZT, Qiu YX, Meng XY, Guo JY and Si ST. “Research on passage retrieval using domain knowledge in Chinese question answering system”, In Proceedings of IEEE International Conference on Machine Learning and Cybernetics, Vol. 5, 2008, pp. 2603-2606.
[8]. Suzuki J, Sasaki Y, Maeda E. “SVM answer selection for open domain question answering”, In Proceedings of 19th International Conference on Computational linguistics, COLING’02, Vol. 1, 2002, pp. 1-7.
[9]. Fu J, Xu J, and Jia K. “Domain ontology based automatic question answering”, In IEEE International Conference on Computer Engineering and Technology, Vol. 2, 2009, pp. 346-349.
[10]. Ying-wei L, Zheng-tao Y, Xiang-yan M, Wen-gang C, Cun-li M. “Question Classification Based on Incremental Modified Bayes”, In Proceedings of IEEE Second International Conference on Future Generation Communication and Networking, Vol. 2, 2008, pp. 149-152.
[11]. Zhang D and Lee WS. “Web based pattern mining and matching approach to question answering”, Proceedings of the 11th Text Retrieval Conference, 2002.
[12]. Greenwood M. and Gaizauskas R. “Using a Named Entity Tagger to Generalise Surface Matching Text Patterns for Question Answering”, In Proceedings of the Workshop on Natural Language Processing for Question Answering (EACL03), 2003, pp. 29-34.
[13]. Saxena AK, Sambhu GV, Kaushik S, and Subramaniam LV, “Iitd-ibmirl system for question answering using pattern matching, semantic type and semantic category recognition”, Proceedings of the TREC, Vol. 2007, 2007.
[14]. Cui H, Kan MY and Chua TS. “Soft pattern matching models for definitional question answering”, In ACM Transactions on Information Systems (TOIS), Vol. 25(2): 8, 2007.
[15]. Sneiders E. “Automated question answering using question templates that cover the conceptual model of the database”, In Natural Language Processing and Information Systems, Springer Berlin Heidelberg, 2002, pp. 235-239.
[16]. Gunawardena T, Lokuhetti M, Pathirana N, Ragel R, Deegalla S, “An automatic answering system with template matching for natural language questions” In Proceedings of 5th IEEE International Conference on Information and Automation for Sustainability (ICIAFs), 2010, pp. 353-358.
[17]. Unger C, Bühmann L, Lehmann J, NgongaNgomo AC, Gerber D and Cimiano P, “Template-based question answering over RDF data”, Proceedings of the ACM 21st international conference on World Wide Web, 2012, pp. 639-648.
[18]. M Iyyer, JL Boyd-Graber, LMB Claudino, R Socher, IH Daume, “A Neural Network for Factoid Question Answering over Paragraphs”, In Conference on Empirical Methods on Natural Language Processing, 2014.
[19]. J Weston, S Chopra, A Bordes, “Memory networks”. arXiv preprint arXiv:1410.3916, 2014.
[20]. M Tan, B Xiang, B Zhou, “LSTM-based Deep Learning Models for non-factoid answer selection”, arXiv preprint arXiv:1511.04108, 2015.1
[21]. S Hochreiter, J Schmidhuber, “Long short-term memory”, Neural computation 9.8: 1735-1780, 1997
[22]. N Kalchbrenner, E Grefenstette, P Blunsom, “A convolutional neural network for modelling sentences”, In Proceedingsof the 52nd Annual Meeting of the Association for Computational Linguistics. June, 2014.
[23]. M Feng, B Xiang, MR Glass, L Wang, B Zhou, “Applying deep learning to answer selection: A study and an open task”, IEEE Workshop on Automatic Speech recognition and Understanding, 2015.
[24]. Martin Gleize and Brigitte Grau. 2015.” A Unified Kernel Approach for Learning Typed Sentence Rewritings”, In Proceedings of ACL-IJCNLP.
[25]. Mengqiu Wang and Christopher D Manning. 2010. “Probabilistic tree-edit models with structured latent variables for textual entailment and question answering.” In COLING.
[26]. Xuchen Yao, Benjamin Van Durme, Chris Callison-Burch, and Peter Clark. 2013 “A Lightweight and High-Performance Monolingual Word Aligner” In Proceedings of ACL. 702–707.
[27]. Xuchen Yao, Benjamin Van Durme, Chris Callison-Burch, and Peter Clark. 2013 “Semi-Markov Phrase-Based Monolingual Alignment”, In Proceedings of EMNLP.590–600.
[28]. Lei Yu, Karl Moritz Hermann, Phil Blunsom, and StephenPulman. 2014, “Deep Learning for Answer Sentence Selection” Computer Science (2014).
[29]. Aliaksei Severyn and Alessandro Moschitti. 2015. “Learning to Rank Short Text Pairs with Convolutional Deep Neural Network”, In the International ACM SIGIR Conference, 373–382.
[30]. Di Wang and Eric Nyberg. 2015 “A Long Short-Term Memory Model for Answer Sentence Selection in Question Answering”, In Meeting of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing, 707–712.
[31]. Wenhui Wang, Nan Yang, Furu Wei, Baobao Chang, and Ming Zhou. 2017, “Gated Self-Matching Networks for Reading Comprehension and Question Answering”, 189–198. DOI: https://doi.org/10.18653/v1/P17-1018
[32]. Baoxun Wang, Bingquan Liu, Xiaolong Wang, Chengjie Sun, And Deyuan Zhang ,“Deep Learning Approaches to Semantic Relevance Modeling for Chinese Question-Answer Pairs”, ACM Transactions on Asian Language Information Processing, Vol. 10, No. 4, Article 21, Publication date: December 2011.
[33]. Ying Shen, Yang Deng, Min Yang, Yaliang Li, Nan Du, Wei Fan, Kai Lei1, “Knowledge-aware Attentive Neural Network for Ranking Question Answer Pairs” SIGIR’ 18, July 8–12, 2018, Ann Arbor, MI, USA 2018 Association for Computing Machinery.ACM ISBN 978-1-4503-5657-2/18/07
[34]. Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. “Squad: 100,000+ questions for machine comprehension of text” arXiv preprint arXiv:1606.05250 (2016).
[35]. Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. “Semantic parsing on freebase from question-answer pairs”, In Proceedings of the 2013Conference on Empirical Methods in Natural Language Processing. 1533–1544.
[36]. Son N. Tran and Artur S. d’Avila Garcez, “Deep Logic Networks: Inserting and Extracting Knowledge from Deep Belief Networks”, IEEE Transactions on neural networks and learning systems, vol. 29, no. 2, February 2018
[37]. C. L. A. Clarke, G. V. Cormack, and T. R. Lynam. “Exploiting redundancy in question answering”, 24thACM SIGIR Conference, pages 358–365, 2001.
[38]. G. V. Cormack, O. Lhotak, and C. R. Palmer “Estimating precision by random sampling”, 22rd ACM SIGIR Conference, pages 273–274, 1999.
[39]. C. L. A. Clarke G. V. Cormack M. Laszlo T. R. Lynam E. L. Terra, “The Impact of Corpus Size on Question Answering Performance”, SIGIR’02, August 11-15, 2002, Tampere, Finland.ACM 1-58113-561-0/02/0008.
[40]. Priyanka R.R., Mahesh M., Pallavi S.S., Jayapala G., Pooja M.R., "Crop Protection by an alert Based System using Deep Learning Concept", International Journal of Scientific Research in Computer Science and Engineering, Vol.6, Issue.6, pp.47-49, 2018
[41]. Shubham Billus, Shivam Billus, Rishab Behl, "Weather Prediction through Sliding Window Algorithm and Deep Learning", International Journal of Scientific Research in Computer Science and Engineering, Vol.6, Issue.5, pp.20-24, 2018