The ShARC Leaderboard

Currently, we are running a competition on the end to end task of conversational question answering based on ShARC. Planning to submit a model for the end to end task? Submit your code on codalab.

In the future, we will also have competitions for subtasks (classification of answer, generating follow-up questions and scenario resolution). Stay tuned!

ShARC - End to End Task

# Model / Reference Affiliation Date Micro Accuracy[%] Macro Accuracy[%] BLEU-1 BLEU-4
1 Baseline-CM Bloomsbury AI May 2018 62 69 54 34
2 Baseline-NMT Bloomsbury AI May 2018 45 43 34 8