tylerjthomas9/JuliaCode

---
dataset_info:
features:
- name: licenses
sequence: string
- name: version
dtype: string
- name: tree_hash
dtype: string
- name: path
dtype: string
- name: type
dtype: string
- name: size
dtype: string
- name: text
dtype: string
- name: package_name
dtype: string
- name: repo
dtype: string
splits:
- name: train
num_bytes: 1243314010
num_examples: 190042
download_size: 410095007
dataset_size: 1243314010
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
task_categories:
- text-generation
tags:
- code
---

# JuliaCode

This dataset includes all Julia code (with permissive licenses) and some documentation from the libraries in the General registry, and the Julia Base library. The data was collected using [PackageAnalyzer.jl](https://github.com/JuliaEcosystem/PackageAnalyzer.jl).

## Licenses

The current version of the dataset uses code with the following licenses:

```
[
"MIT",
"Apache-2.0",
"MPL-2.0",
"BSD-3-Clause",
"Zlib",
"ISC",
"CC0-1.0",
"0BSD",
"BSL-1.0"
]
```

This dataset includes all Julia code (with permissive licenses) and some documentation from the libraries in the General registry, and the Julia Base library. The data was collected using PackageAnalyzer.jl.

原始信息汇总

数据集概述

数据集信息

• 特征列表:

  • licenses: 许可证序列，类型为字符串。
  • version: 版本信息，类型为字符串。
  • tree_hash: 树哈希值，类型为字符串。
  • path: 路径信息，类型为字符串。
  • type: 类型信息，类型为字符串。
  • size: 大小信息，类型为字符串。
  • text: 文本内容，类型为字符串。
  • package_name: 包名，类型为字符串。
  • repo: 仓库信息，类型为字符串。

• 数据分割:

  • train: 训练集，包含1,243,314,010字节，190,042个样本。

• 下载大小: 410,095,007字节。

• 数据集大小: 1,243,314,010字节。

配置信息

• 配置名称: default
  • 数据文件:
    • train: 路径为data/train-*。

任务类别

• text-generation: 文本生成。

标签

• code: 代码。

许可证

• 数据集使用的许可证包括：
  • MIT
  • Apache-2.0
  • MPL-2.0
  • BSD-3-Clause
  • Zlib
  • ISC
  • CC0-1.0
  • 0BSD
  • BSL-1.0