Currently, we are running a competition on the end to end task of conversational question answering based on ShARC.
Planning to submit a model for the end to end task? Submit your code on codalab.
In the future, we will also have competitions for subtasks (classification of answer, generating follow-up questions and scenario resolution). Stay tuned!
|#||Model / Reference||Affiliation||Date||Micro Accuracy[%]||Macro Accuracy[%]||BLEU-1||BLEU-4|
|#||E3||University of Washington||Feb 2019||67.6||73.3||54.1||38.7|
|#||BiSon (single model)||NEC Laboratories Europe||Aug 2019||66.9||71.6||58.8||44.3|
|#||UrcaNet (single model)||[Anonymous]||Aug 2019||65.1||71.2||60.5||46.1|
|#||BERT-QA||University of Washington||Feb 2019||63.6||70.8||46.2||36.3|
|#||Baseline-CM||Bloomsbury AI||May 2018||61.9||68.9||54.4||34.4|
|#||Baseline-NMT||Bloomsbury AI||May 2018||44.8||42.8||34.0||7.8|