Core-S2L1C

# Core-S2L1C

Contains a global coverage of Sentinel-2 (Level 1C) patches, each of size 1,068 x 1,068 pixels.

| Source | Sensing Type | Number of Patches | Patch Size | Total Pixels |
|--------|--------------|-------------------|------------|--------------|
|Sentinel-2 Level-1C |Optical Multispectral|2,245,886|1,068x1,068|2.56 Trillion|

## Content

| Column | Details | Resolution |
|--------|---------|------------|
| B01 | Coastal aerosol, 442.7 nm (S2A), 442.3 nm (S2B) | 60m |
| B02 | Blue, 492.4 nm (S2A), 492.1 nm (S2B) | 10m |
| B03 | Green, 559.8 nm (S2A), 559.0 nm (S2B) | 10m |
| B04 | Red, 664.6 nm (S2A), 665.0 nm (S2B) | 10m |
| B05 | Vegetation red edge, 704.1 nm (S2A), 703.8 nm (S2B) | 20m |
| B06 | Vegetation red edge, 740.5 nm (S2A), 739.1 nm (S2B) | 20m |
| B07 | Vegetation red edge, 782.8 nm (S2A), 779.7 nm (S2B) | 20m |
| B08 | NIR, 832.8 nm (S2A), 833.0 nm (S2B) | 10m |
| B8A | Narrow NIR, 864.7 nm (S2A), 864.0 nm (S2B) | 20m |
| B09 | Water vapour, 945.1 nm (S2A), 943.2 nm (S2B) | 60m |
| B10 | SWIR – Cirrus, 1373.5 nm (S2A), 1376.9 nm (S2B) | 60m |
| B11 | SWIR, 1613.7 nm (S2A), 1610.4 nm (S2B) | 20m |
| B12 | SWIR, 2202.4 nm (S2A), 2185.7 nm (S2B) | 20m |
| cloud_mask | Cloud Mask produced by [SEnSeI](https://huggingface.co/aliFrancis/SEnSeIv2) | 10m |
| thumbnail | RGB composite [B04, B03, B02] saved as png | 10m |

## Spatial Coverage
This is a global monotemporal dataset. Nearly every piece of Earth captured by Sentinel-2 is contained at least once in this dataset (and only once, excluding some marginal overlaps).

The following figure demonstrates the spatial coverage (only black pixels are absent):

## Example Use

Interface scripts are available at https://github.com/ESA-PhiLab/Major-TOM

Here's a sneak peek with a thumbnail image:
```python
from fsspec.parquet import open_parquet_file
import pyarrow.parquet as pq
from io import BytesIO
from PIL import Image

PARQUET_FILE = 'part_03900' # parquet number
ROW_INDEX = 42 # row number (about 500 per parquet)

url = "https://huggingface.co/datasets/Major-TOM/Core-S2L1C/resolve/main/images/{}.parquet".format(PARQUET_FILE)
with open_parquet_file(url,columns = ["thumbnail"]) as f:
with pq.ParquetFile(f) as pf:
first_row_group = pf.read_row_group(ROW_INDEX, columns=['thumbnail'])

stream = BytesIO(first_row_group['thumbnail'][0].as_py())
image = Image.open(stream)
```

## Cite
[](https://arxiv.org/abs/2402.12095/)
```latex
@inproceedings{Major_TOM,
title={Major TOM: Expandable Datasets for Earth Observation},
author={Alistair Francis and Mikolaj Czerkawski},
year={2024},
booktitle={IGARSS 2024 - 2024 IEEE International Geoscience and Remote Sensing Symposium},
eprint={2402.12095},
archivePrefix={arXiv},
primaryClass={cs.CV}
}
```

Powered by [Φ-lab, European Space Agency (ESA) 🛰️](https://huggingface.co/ESA-philab)

# Core-S2L1C

本数据集包含覆盖全球的哨兵2号（Sentinel-2）Level-1C影像块，每块尺寸为1068×1068像素。

| 数据源 | 传感类型 | 影像块数量 | 影像块尺寸 | 总像素数 |
|--------|--------------|-------------------|------------|--------------|
| 哨兵2号（Sentinel-2）Level-1C | 光学多光谱 | 2,245,886 | 1,068×1,068 | 2.56万亿 |

## 数据集详情

| 波段代号 | 详细信息 | 空间分辨率 |
|--------|---------|------------|
| B01 | 海岸气溶胶波段，对应Sentinel-2A星波长442.7 nm、Sentinel-2B星442.3 nm | 60 m |
| B02 | 蓝光波段，对应Sentinel-2A星波长492.4 nm、Sentinel-2B星492.1 nm | 10 m |
| B03 | 绿光波段，对应Sentinel-2A星波长559.8 nm、Sentinel-2B星559.0 nm | 10 m |
| B04 | 红光波段，对应Sentinel-2A星波长664.6 nm、Sentinel-2B星665.0 nm | 10 m |
| B05 | 植被红边波段，对应Sentinel-2A星波长704.1 nm、Sentinel-2B星703.8 nm | 20 m |
| B06 | 植被红边波段，对应Sentinel-2A星波长740.5 nm、Sentinel-2B星739.1 nm | 20 m |
| B07 | 植被红边波段，对应Sentinel-2A星波长782.8 nm、Sentinel-2B星779.7 nm | 20 m |
| B08 | 近红外（NIR）波段，对应Sentinel-2A星波长832.8 nm、Sentinel-2B星833.0 nm | 10 m |
| B8A | 窄带近红外（Narrow NIR）波段，对应Sentinel-2A星波长864.7 nm、Sentinel-2B星864.0 nm | 20 m |
| B09 | 水汽波段，对应Sentinel-2A星波长945.1 nm、Sentinel-2B星943.2 nm | 60 m |
| B10 | 短波红外（SWIR）卷云波段，对应Sentinel-2A星波长1373.5 nm、Sentinel-2B星1376.9 nm | 60 m |
| B11 | 短波红外（SWIR）波段，对应Sentinel-2A星波长1613.7 nm、Sentinel-2B星1610.4 nm | 20 m |
| B12 | 短波红外（SWIR）波段，对应Sentinel-2A星波长2202.4 nm、Sentinel-2B星2185.7 nm | 20 m |
| cloud_mask | 由[SEnSeI](https://huggingface.co/aliFrancis/SEnSeIv2)生成的云掩膜产品 | 10 m |
| thumbnail | 以波段[B04, B03, B02]合成的RGB影像，存储为PNG格式 | 10 m |

## 空间覆盖范围
本数据集为全球单时相遥感影像集，几乎所有被哨兵2号捕获的地球地表区域均至少包含于本数据集中一次（仅存在少量边缘重叠区域，各区域仅出现一次）。
下图展示了该数据集的空间覆盖范围（仅黑色像素区域为无数据区域）：

## 示例应用
接口脚本可于https://github.com/ESA-PhiLab/Major-TOM 获取。以下为缩略图预览示例代码：
python
from fsspec.parquet import open_parquet_file
import pyarrow.parquet as pq
from io import BytesIO
from PIL import Image

PARQUET_FILE = 'part_03900' # parquet文件编号
ROW_INDEX = 42 # 行索引（每个parquet文件约含500行）

url = "https://huggingface.co/datasets/Major-TOM/Core-S2L1C/resolve/main/images/{}.parquet".format(PARQUET_FILE)
with open_parquet_file(url, columns = ["thumbnail"]) as f:
with pq.ParquetFile(f) as pf:
first_row_group = pf.read_row_group(ROW_INDEX, columns=['thumbnail'])

stream = BytesIO(first_row_group['thumbnail'][0].as_py())
image = Image.open(stream)

## 引用
[](https://arxiv.org/abs/2402.12095/)
latex
@inproceedings{Major_TOM,
title={Major TOM：面向对地观测的可扩展数据集},
author={Alistair Francis and Mikolaj Czerkawski},
year={2024},
booktitle={IGARSS 2024 - 2024 IEEE国际地球科学与遥感研讨会},
eprint={2402.12095},
archivePrefix={arXiv},
primaryClass={cs.CV}
}

本数据集由Φ-lab、欧洲空间局（European Space Agency, ESA）🛰️ 提供支持，详情见https://huggingface.co/ESA-philab