Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

Question Answering Survey: Directions, Challenges, Datasets, Evaluation Matrices

Version 1 : Received: 7 December 2021 / Approved: 8 December 2021 / Online: 8 December 2021 (14:34:00 CET)

How to cite: Pandya, H.; Bhatt, B. Question Answering Survey: Directions, Challenges, Datasets, Evaluation Matrices. Preprints 2021, 2021120136 (doi: 10.20944/preprints202112.0136.v1). Pandya, H.; Bhatt, B. Question Answering Survey: Directions, Challenges, Datasets, Evaluation Matrices. Preprints 2021, 2021120136 (doi: 10.20944/preprints202112.0136.v1).

Abstract

The usage and amount of information available on the internet increase over the past decade. This digitization leads to the need for automated answering system to extract fruitful information from redundant and transitional knowledge sources. Such systems are designed to cater the most prominent answer from this giant knowledge source to the user’s query using natural language understanding (NLU) and thus eminently depends on the Question-answering(QA) field. Question answering involves but not limited to the steps like mapping of user’s question to pertinent query, retrieval of relevant information, finding the best suitable answer from the retrieved information etc. The current improvement of deep learning models evince compelling performance improvement in all these tasks. In this review work, the research directions of QA field are analyzed based on the type of question, answer type, source of evidence-answer, and modeling approach. This detailing followed by open challenges of the field like automatic question generation, similarity detection and, low resource availability for a language. In the end, a survey of available datasets and evaluation measures is presented.

Keywords

question answering; deep learning; transformers; squad

Subject

ENGINEERING, Other

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our diversity statement.

Leave a public comment
Send a private comment to the author(s)
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.