An Evaluation of Chinese Human-Computer Dialogue Technology
收藏资源简介:
Seven tables of this paper. Table 1 shows an example of air ticket booking. Table 2 presents some examples in training set of Task 1. Table 3 shows statistics of the intent data set in Task 1. Table 4 presents the top 8 teams of Task 1 ranked by F1 score. Table 5 shows the top 5 teams of Task 2. Note: C denotes task completion ratio, T denotes average dialogue turns, Sa denotes user satisfaction score, F denotes fluency degree of response, and G denotes uncovered data guidance capability. All these indicators are average scores of all test cases. Table A1 is the complete leaderboard of Task 1 ranking by F1 score. Table A2 shows the complete leaderboard of Task 2. Note: C denotes task completion ratio, T denotes average dialogue turns, Sa denotes user satisfaction score, F denotes fluency degree of response, and G denotes uncovered data guidance capability. All these indicators are average scores of all test cases.



