asoria/pandas_test

This is a test on how to upload a dataset using pandas:

```python
import pandas as pd

# First read from another repo or create your dataframe
df = dd.read_parquet("hf://datasets/asoria/columns_test@~parquet/default/test/0000.parquet")

# And finally, push to HF repo
df.to_parquet('hf://datasets/asoria/pandas_test/0000.parquet')
```

This dataset is created from a dataframe using the pandas library, either from an external repository or locally, and then converted to parquet format for uploading to the HuggingFace repository.

原始信息汇总

数据集概述

数据集名称

• pandas_test

数据集创建者

• asoria

数据集存储位置

• hf://datasets/asoria/pandas_test/0000.parquet

数据集格式

• Parquet

数据集创建过程

1. 从另一个仓库或创建数据框读取数据。
2. 使用Dask库读取Parquet格式的数据集。
3. 将处理后的数据推送到Hugging Face仓库。