arthurmluz/temario_data-wiki_cstnews_results

---
dataset_info:
features:
- name: id
dtype: string
- name: text
dtype: string
- name: summary
dtype: string
- name: gen_summary
dtype: string
- name: rouge
struct:
- name: rouge1
dtype: float64
- name: rouge2
dtype: float64
- name: rougeL
dtype: float64
- name: rougeLsum
dtype: float64
- name: bert
struct:
- name: f1
sequence: float64
- name: hashcode
dtype: string
- name: precision
sequence: float64
- name: recall
sequence: float64
- name: moverScore
dtype: float64
splits:
- name: validation
num_bytes: 219281
num_examples: 25
download_size: 175736
dataset_size: 219281
configs:
- config_name: default
data_files:
- split: validation
path: data/validation-*
---
# Dataset Card for "temario_data-wikilingua_cstnews_results"

Results of the model arthurmluz/ptt5-wikilingua-cstnews on the dataset godoyj/temario.

'gen_summary' is the generated summary, and both bertScore and Rouge metrics calculated.

mean metrics:

rouge= {'rouge1': 0.3800757744192324, 'rouge2': 0.1539001654491066, 'rougeL': 0.2346540497659127, 'rougeLsum': 0.2346540497659127}

bert= {'precision': 0.7361391615867615, 'recall': 0.6891939973831177, 'f1': 0.711702299118042}

mover = 0.6075434818512242

原始信息汇总

数据集概述

数据集信息

特征

• id: 字符串类型
• text: 字符串类型
• summary: 字符串类型
• gen_summary: 字符串类型
• rouge: 结构体
  • rouge1: 浮点数类型
  • rouge2: 浮点数类型
  • rougeL: 浮点数类型
  • rougeLsum: 浮点数类型
• bert: 结构体
  • f1: 浮点数序列
  • hashcode: 字符串类型
  • precision: 浮点数序列
  • recall: 浮点数序列
• moverScore: 浮点数类型

数据分割

• validation: 25个样本，219281字节

数据大小

• 下载大小: 175736字节
• 数据集大小: 219281字节

配置

• default
  • 数据文件:
    • validation: data/validation-*

模型结果

生成摘要

• gen_summary: 生成的摘要

评估指标

• rouge:
  • rouge1: 0.3800757744192324
  • rouge2: 0.1539001654491066
  • rougeL: 0.2346540497659127
  • rougeLsum: 0.2346540497659127
• bert:
  • precision: 0.7361391615867615
  • recall: 0.6891939973831177
  • f1: 0.711702299118042
• mover: 0.6075434818512242