Open Access   Article Go Back

Using Proximity and Semantic Similarity in Question Answering

Shaunak S. Phaldessai1 , Amey D. S. Kerkar2

Section:Research Paper, Product Type: Journal Paper
Volume-06 , Issue-10 , Page no. 9-17, Nov-2018

CrossRef-DOI:   https://doi.org/10.26438/ijcse/v6si10.917

Online published on Nov 30, 2018

Copyright © Shaunak S. Phaldessai, Amey D. S. Kerkar . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

View this paper at   Google Scholar | DPI Digital Library

XML View
PDF Download

How to Cite this Paper

IEEE Style Citation: Shaunak S. Phaldessai, Amey D. S. Kerkar, “Using Proximity and Semantic Similarity in Question Answering,” International Journal of Computer Sciences and Engineering, Vol.06, Issue.10, pp.9-17, 2018.

MLA Style Citation: Shaunak S. Phaldessai, Amey D. S. Kerkar "Using Proximity and Semantic Similarity in Question Answering." International Journal of Computer Sciences and Engineering 06.10 (2018): 9-17.

APA Style Citation: Shaunak S. Phaldessai, Amey D. S. Kerkar, (2018). Using Proximity and Semantic Similarity in Question Answering. International Journal of Computer Sciences and Engineering, 06(10), 9-17.

BibTex Style Citation:
@article{Phaldessai_2018,
author = {Shaunak S. Phaldessai, Amey D. S. Kerkar},
title = {Using Proximity and Semantic Similarity in Question Answering},
journal = {International Journal of Computer Sciences and Engineering},
issue_date = {11 2018},
volume = {06},
Issue = {10},
month = {11},
year = {2018},
issn = {2347-2693},
pages = {9-17},
url = {https://www.ijcseonline.org/full_spl_paper_view.php?paper_id=518},
doi = {https://doi.org/10.26438/ijcse/v6i10.917}
publisher = {IJCSE, Indore, INDIA},
}

RIS Style Citation:
TY - JOUR
DO = {https://doi.org/10.26438/ijcse/v6i10.917}
UR - https://www.ijcseonline.org/full_spl_paper_view.php?paper_id=518
TI - Using Proximity and Semantic Similarity in Question Answering
T2 - International Journal of Computer Sciences and Engineering
AU - Shaunak S. Phaldessai, Amey D. S. Kerkar
PY - 2018
DA - 2018/11/30
PB - IJCSE, Indore, INDIA
SP - 9-17
IS - 10
VL - 06
SN - 2347-2693
ER -

           

Abstract

This paper deals with the process of Question Answering, using news articles crawled from ‘THE HINDU’ newspaper website of the year 2017. We make use of corpus of close to 10,000 articles/documents crawled categorically into Sports, Science and Tech., Business and Entertainment. We have implemented a system that extracts documents based on relevance to the question a user asks through the tf-idf ranking. For the processing phase, we made use of methods initially implemented for simpler systems, such as document extraction and checking sentence similarity between two short sentences. We managed to implement the techniques to extract coherent answers by extracting the passages with the best likelihood of containing the answer and the process these passages for the answer based on their similarity with the question. To implement these, we have made use of various Natural Language Processing (NLP) techniques along with the Wordnet knowledge base. We have tested the system with different corpus sizes and different coefficient of cosine similarity to explore this technique.

Key-Words / Index Term

Question-Answering, Proximity, Semantic Similarity, Natural Language Processing and Synonyms

References

[1] Yuhua Li, David McLean, Zuhair A. Bandar, James D. O’Shea, and Keeley Crockett, “Sentence Similarity Based on Semantic Nets and Corpus Statistics”, in IEEE Transactions on Knowledge and Data Engineering, VOL. 18, NO. 8, AUGUST 2006.
[2] Daniel Jurafsky & James H. Martin, “Speech and Language Processing”,
[3] Man-Hung Jong, Chong-Han Ri, Hyok-Chol Choe, Chol-Jun Hwang, A Method of Passage-Based Document Retrieval in Question Answering System. https://arxiv.org/ftp/arxiv/papers/1512/1512.05437.pdf.
[4] Apra Mishra, Santosh Vishwakarma, Analysis of TF-IDF Model and its Variant for Document Retrieval, ,2015.
[5] Vicedo, Jose Luis & Ferrández, Antonio, A Semantic approach to Question Answering systems.