Japanese FAQ dataset for e-learning system

This dataset includes FAQ data and their categories to train a chatbot specialized for e-learning system used in Tokyo Metropolitan University. We report accuracies of the chatbot in the following paper.

<em>Yasunobu Sumikawa, Masaaki Fujiyoshi, Hisashi Hatakeyama, and Masahiro Nagai "Supporting Creation of FAQ Dataset for E-learning Chatbot", Intelligent Decision Technologies, Smart Innovation, IDT'19, Springer, 2019, to appear.</em>

This dataset is based on real Q&amp;A data about how to use the e-learning system asked by students and teachers who use it in practical classes. The duration we collected the Q&amp;A data is from April 2015 to July 2018.

<strong>File contents</strong>:

FAQ data (*.csv)

Answer2Category.csv: Categories of answers.
Answer2Tag.csv: Titles of answers.
Answers.csv: IDs for answers and texts of answers.
Categories.csv: Names of categories for answers.
Questions.csv: Texts of questions and their corresponding answer IDs.

<br>
Statistics (*.tsv)
Results of statistical analyses for the dataset. We used Calinski and Harabaz method, mutual information, Jaccard Index, TF-IDF+KL divergence, and TF-IDF+JS divergence in order to measure qualities of the dataset. In the analyses, we regard each answer as a cluster for questions. We also perform the same analyses for categories by regarding them as clusters for answers.

<strong>Grants</strong>: JSPS KAKENHI Grant Number 18H01057