Currently, we are running a competition on the end to end task of conversational question answering based on ShARC.
Planning to submit a model for the end to end task? Submit your code on codalab.
In the future, we will also have competitions for subtasks (classification of answer, generating follow-up questions and scenario resolution). Stay tuned!
|#||Model / Reference||Affiliation||Date||Micro Accuracy[%]||Macro Accuracy[%]||BLEU-1||BLEU-4|
|1||Baseline-CM||Bloomsbury AI||May 2018||62||69||54||34|
|2||Baseline-NMT||Bloomsbury AI||May 2018||45||43||34||8|