Accuracy of basic question answering model | Coursera Community
Coursera Header
Question

Accuracy of basic question answering model

  • 25 October 2019
  • 3 replies
  • 86 views

Badge +2

i am implementing a basic question answering model without attention layer.how much accuracy i can expect ?


3 replies

Badge

As I understand the accuracy of the model depends on the DataSet quality, and the algorithm which you pick to train the data model. 

Badge +2

i am using SQUAD dataset and i want to know the minimum accuracy one can expect from a vary basic QA model.

Userlevel 5
Badge +4

Hi @Kaushik Roy  I guess the final model which you’ve built has a F1 score of 75 on the test set, then it is Not bad!

Reply