Hyperspectral benchmark dataset on soil moisture

该数据集是关于土壤湿度的超光谱基准数据集，提供了详细的土壤湿度相关信息。

This dataset is a hyperspectral benchmark dataset concerning soil moisture, providing detailed information related to soil moisture.

原始信息汇总

数据集概述

农业

• Hyperspectral benchmark dataset on soil moisture
  • 链接: https://doi.org/10.5281/zenodo.1227837
• U.S. Department of Agricultures Nutrient Database
  • 链接: https://www.ars.usda.gov/northeast-area/beltsville-md/beltsville-human-nutrition-research-center/nutrient-data-laboratory/docs/sr28-download-files/
• U.S. Department of Agricultures PLANTS Database
  • 链接: http://www.plants.usda.gov/dl_all.html

生物学

• American Gut (Microbiome Project)
  • 链接: https://github.com/biocore/American-Gut
• Broad Bioimage Benchmark Collection (BBBC)
  • 链接: https://www.broadinstitute.org/bbbc
• Broad Cancer Cell Line Encyclopedia (CCLE)
  • 链接: http://www.broadinstitute.org/ccle/home
• Cell Image Library
  • 链接: http://www.cellimagelibrary.org
• Complete Genomics Public Data
  • 链接: http://www.completegenomics.com/public-data/69-genomes/
• EBI ArrayExpress
  • 链接: http://www.ebi.ac.uk/arrayexpress/
• EBI Protein Data Bank in Europe
  • 链接: http://www.ebi.ac.uk/pdbe/emdb/index.html/
• ENCODE project
  • 链接: https://www.encodeproject.org
• Electron Microscopy Pilot Image Archive (EMPIAR)
  • 链接: http://www.ebi.ac.uk/pdbe/emdb/empiar/
• Ensembl Genomes
  • 链接: http://ensemblgenomes.org/info/genomes
• Gene Expression Omnibus (GEO)
  • 链接: http://www.ncbi.nlm.nih.gov/geo/
• Gene Ontology (GO)
  • 链接: http://geneontology.org/docs/download-go-annotations/
• Global Biotic Interactions (GloBI)
  • 链接: https://github.com/jhpoelen/eol-globi-data/wiki#accessing-species-interaction-data
• Harvard Medical School (HMS) LINCS Project
  • 链接: http://lincs.hms.harvard.edu
• Human Genome Diversity Project
  • 链接: http://www.hagsc.org/hgdp/files.html
• Human Microbiome Project (HMP)
  • 链接: http://www.hmpdacc.org/reference_genomes/reference_genomes.php
• ICOS PSP Benchmark
  • 链接: http://ico2s.org/datasets/psp_benchmark.html
• International HapMap Project
  • 链接: http://hapmap.ncbi.nlm.nih.gov/downloads/index.html.en
• KEGG
  • 链接: http://www.genome.jp/kegg/
• MIT Cancer Genomics Data
  • 链接: http://www.broadinstitute.org/cgi-bin/cancer/datasets.cgi
• NCBI Proteins
  • 链接: http://www.ncbi.nlm.nih.gov/guide/proteins/#databases
• NCBI Taxonomy
  • 链接: http://www.ncbi.nlm.nih.gov/taxonomy
• NCI Genomic Data Commons
  • 链接: https://gdc.cancer.gov/access-data/gdc-data-portal
• NIH Microarray data
  • 链接: ftp://ftp.ncbi.nih.gov/pub/geo/DATA/supplementary/series/GSE6532/
• OpenSNP genotypes data
  • 链接: https://opensnp.org/
• Pathguid - Protein-Protein Interactions Catalog
  • 链接: http://www.pathguide.org/
• Protein Data Bank
  • 链接: http://www.rcsb.org/
• Psychiatric Genomics Consortium
  • 链接: https://www.med.unc.edu/pgc/downloads
• PubChem Project
  • 链接: https://pubchem.ncbi.nlm.nih.gov/
• PubGene (now Coremine Medical)
  • 链接: https://www.coremine.com/
• Sanger Catalogue of Somatic Mutations in Cancer (COSMIC)
  • 链接: http://cancer.sanger.ac.uk/cosmic
• Sanger Genomics of Drug Sensitivity in Cancer Project (GDSC)
  • 链接: http://www.cancerrxgene.org/
• Sequence Read Archive(SRA)
  • 链接: http://www.ncbi.nlm.nih.gov/Traces/sra/
• Stanford Microarray Data
  • 链接: http://smd.stanford.edu/
• Stowers Institute Original Data Repository
  • 链接: http://www.stowers.org/research/publications/odr
• Systems Science of Biological Dynamics (SSBD) Database
  • 链接: http://ssbd.qbic.riken.jp
• The Cancer Genome Atlas (TCGA), available via Broad GDAC
  • 链接: https://gdac.broadinstitute.org/
• The Catalogue of Life
  • 链接: http://www.catalogueoflife.org/content/annual-checklist-archive
• The Personal Genome Project
  • 链接: http://www.personalgenomes.org/
• UCSC Public Data
  • 链接: http://hgdownload.soe.ucsc.edu/downloads.html
• UniGene
  • 链接: https://ftp.ncbi.nlm.nih.gov/repository/UniGene/
• Universal Protein Resource (UnitProt)
  • 链接: http://www.uniprot.org/downloads

气候+天气

• Actuaries Climate Index
  • 链接: http://actuariesclimateindex.org/data/
• Australian Weather
  • 链接: http://www.bom.gov.au/climate/dwo/
• Aviation Weather Center
  • 链接: https://aviationweather.gov/adds/dataserver
• Brazilian Weather - Historical data (In Portuguese)
  • 链接: http://sinda.crn.inpe.br/PCD/SITE/novo/site/historico/index.php
• Canadian Meteorological Centre
  • 链接: http://weather.gc.ca/grib/index_e.html
• Climate Data from UEA (updated monthly)
  • 链接: http://www.cru.uea.ac.uk/data/
• Dutch Weather
  • 链接: https://data.knmi.nl/datasets
• European Climate Assessment & Dataset
  • 链接: https://www.ecad.eu/
• Global Climate Data Since 1929
  • 链接: http://en.tutiempo.net/climate
• Charting The Global Climate Change News Narrative 2009-2020
  • 链接: https://blog.gdeltproject.org/four-massive-datasets-charting-the-global-climate-change-news-narrative-2009-2020/
• NASA Global Imagery Browse Services
  • 链接: https://wiki.earthdata.nasa.gov/display/GIBS
• NOAA Bering Sea Climate
  • 链接: http://www.beringclimate.noaa.gov/
• NOAA Climate Datasets
  • 链接: http://www.ncdc.noaa.gov/data-access/quick-links
• NOAA Realtime Weather Models
  • 链接: http://www.ncdc.noaa.gov/data-access/model-data/model-datasets/numerical-weather-prediction
• NOAA SURFRAD Meteorology and Radiation Datasets
  • 链接: https://www.esrl.noaa.gov/gmd/grad/stardata.html
• The World Bank Open Data Resources for Climate Change
  • 链接: http://data.worldbank.org/developers/climate-data-api
• UEA Climatic Research Unit
  • 链接: http://www.cru.uea.ac.uk/data
• WU Historical Weather Worldwide
  • 链接: https://www.wunderground.com/history/index.html
• WorldClim - Global Climate Data
  • 链接: http://www.worldclim.org

复杂网络

• AMiner Citation Network Dataset
  • 链接: http://aminer.org/citation
• CrossRef DOI URLs
  • 链接: https://archive.org/details/doi-urls
• DBLP Citation dataset
  • 链接: https://kdl.cs.umass.edu/display/public/DBLP
• DIMACS Road Networks Collection
  • 链接: http://www.dis.uniroma1.it/challenge9/download.shtml
• NBER Patent Citations
  • 链接: http://nber.org/patents/
• NIST complex networks data collection
  • 链接: http://math.nist.gov/~RPozo/complex_datasets.html
• Network Repository with Interactive Exploratory Analysis Tools
  • 链接: http://networkrepository.com/
• Protein-protein interaction network
  • 链接: http://vlado.fmf.uni-lj.si/pub/networks/data/bio/Yeast/Yeast.htm
• PyPI and Maven Dependency Network
  • 链接: https://ogirardot.wordpress.com/2013/01/31/sharing-pypimaven-dependency-data/
• Scopus Citation Database
  • 链接: https://www.elsevier.com/solutions/scopus
• Small Network Data
  • 链接: http://www-personal.umich.edu/~mejn/netdata/
• Stanford GraphBase
  • 链接: http://www3.cs.stonybrook.edu/~algorith/implement/graphbase/implement.shtml
• Stanford Large Network Dataset Collection
  • 链接: http://snap.stanford.edu/data/
• The Koblenz Network Collection
  • 链接: http://konect.uni-koblenz.de/
• The Laboratory for Web Algorithmics (UNIMI)
  • 链接: http://law.di.unimi.it/datasets.php
• UCI Network Data Repository
  • 链接: https://networkdata.ics.uci.edu/resources.php
• UFL sparse matrix collection
  • 链接: http://www.cise.ufl.edu/research/sparse/matrices/
• WSU Graph Database
  • 链接: http://www.eecs.wsu.edu/mgd/gdb.html

计算机网络

• 3.5B Web Pages from CommonCrawl 2012
  • 链接: http://www.bigdatanews.com/profiles/blogs/big-data-set-3-5-billion-web-pages-made-available-for-all-of-us
• 53.5B Web clicks of 100K users in Indiana Univ.
  • 链接: http://cnets.indiana.edu/groups/nan/webtraffic/click-dataset/
• CAIDA Internet Datasets
  • 链接: http://www.caida.org/data/overview/
• CRAWDAD Wireless datasets from Dartmouth Univ.
  • 链接: https://crawdad.cs.dartmouth.edu/
• ClueWeb09 - 1B web pages
  • 链接: http://lemurproject.org/clueweb09/
• ClueWeb12 - 733M web pages
  • 链接: http://lemurproject.org/clueweb12/
• CommonCrawl Web Data over 7 years
  • 链接: http://commoncrawl.org/the-data/get-started/
• Criteo click-through data
  • 链接: http://labs.criteo.com/2015/03/criteo-releases-its-new-dataset/
• Internet-Wide Scan Data Repository
  • 链接: https://scans.io/
• MIRAGE-2019
  • 链接: http://traffic.comics.unina.it/mirage/
• OONI: Open Observatory of Network Interference
  • 链接: https://ooni.torproject.org/data/
• Open Mobile Data by MobiPerf
  • 链接: https://console.developers.google.com/storage/openmobiledata_public/
• The Peer-to-Peer Trace Archive
  • 链接: http://p2pta.ewi.tudelft.nl/
• Rapid7 Sonar Internet Scans
  • 链接: https://sonar.labs.rapid7.com/
• UCSD Network Telescope, IPv4 /8 net
  • 链接: http://www.caida.org/projects/network_telescope/

数据挑战

• Bruteforce Database
  • 链接: https://github.com/duyetdev/bruteforce-database
• Challenges in Machine Learning
  • 链接: http://www.chalearn.org/
• CrowdANALYTIX dataX
  • 链接: http://data.crowdanalytix.com
• DrivenData Competitions for Social Good
  • 链接: http://www.drivendata.org/
• ICWSM Data Challenge (since 2009)
  • 链接: https://www.icwsm.org/2018/datasets/datasets/#obtaining
• KDD Cup by Tencent 2012
  • 链接: http://www.kddcup2012.org/
• Kaggle Competition Data
  • 链接: https://www.kaggle.com/
• Localytics Data Visualization Challenge
  • 链接: https://github.com/localytics/data-viz-challenge
• Netflix Prize
  • 链接: http://netflixprize.com/leaderboard.html
• Space Apps Challenge
  • 链接: https://2015.spaceappschallenge.org
• Telecom Italia Big Data Challenge
  • 链接: https://dandelion.eu/datamine/open-big-data/
• TravisTorrent Dataset - MSR2017 Mining Challenge
  • 链接: https://travistorrent.testroots.org/
• TunedIT - Data mining & machine learning data sets, algorithms, challenges
  • 链接: http://tunedit.org/challenges/
• Yelp Dataset Challenge
  • 链接: http://www.yelp.com/dataset_challenge

地球科学

• 38-Cloud (Cloud Detection)
  • 链接: https://github.com/SorourMo/38-Cloud-A-Cloud-Segmentation-Dataset
• AQUASTAT - Global water resources and uses
  • 链接: http://www.fao.org/nr/water/aquastat/data/query/index.html?lang=en
• BODC - marine data of ~22K vars
  • 链接: https://www.bodc.ac.uk/data/
• EOSDIS - NASAs earth observing system data
  • 链接: http://sedac.ciesin.columbia.edu/data/sets/browse
• **Earth

搜集汇总

数据集介绍

构建方式

Hyperspectral benchmark dataset on soil moisture 是一个针对土壤湿度的高光谱图像数据集，它通过收集具有不同土壤湿度条件的高光谱图像来构建，旨在为土壤湿度监测和评估提供标准数据集。

特点

该数据集的特点在于包含了多种土壤湿度条件下的高光谱图像，具有丰富的光谱信息和细致的标签，能够为相关研究提供有力支持，同时，数据集的开放性使得研究者可以轻松获取并进行二次开发。

使用方法

用户可以通过数据集的官方网站或相关科研平台下载该数据集。在获取数据后，用户需要遵循数据使用协议，合理使用数据，例如，不得用于商业目的，且需在研究成果中引用数据集的来源。

背景与挑战

背景概述

Hyperspectral benchmark dataset on soil moisture 是一个针对土壤湿度检测的高光谱图像数据集。该数据集的创建旨在为研究人员提供一个标准化的平台，以评估和比较不同高光谱图像处理算法在土壤湿度估计方面的性能。该数据集由多个场景组成，每个场景都包含了与土壤湿度相关的多个高光谱图像。这些数据最早可追溯至2018年，由相关领域的研究人员或机构整理和发布。该数据集对农业遥感领域产生了重要影响，推动了土壤湿度监测技术的发展。

当前挑战

在数据集构建过程中，研究人员面临了多个挑战。首先，高光谱图像数据通常具有高维性和复杂性，这要求在处理和分析数据时需要高效的算法。其次，土壤湿度是一个动态变化的参数，受多种环境因素的影响，如温度、湿度、植被等，这增加了数据标注和建模的难度。此外，高光谱图像的获取和存储成本较高，限制了数据集的规模和可用性。在解决的领域问题方面，该数据集面临的挑战包括如何准确地从高光谱图像中提取土壤湿度信息，以及如何构建鲁棒的高光谱图像分类或回归模型。

常用场景

经典使用场景

该数据集被广泛应用于土壤湿度监测与研究中，特别是在农业领域，其提供了高光谱图像和对应的土壤湿度标签，使得研究者能够开展基于图像的土壤湿度估计算法开发和验证工作。

实际应用

在实际应用中，该数据集可用于指导农业灌溉决策，优化水资源使用，同时对于环境保护和灾害预防也具有重要作用，如洪水预警和干旱监测。

衍生相关工作

基于该数据集，研究者衍生出了一系列相关工作，包括土壤湿度估计算法的改进、高光谱图像处理技术的研究以及农业大数据分析模型的开发等。