Field Applied Research (FAR) Australia High Yielding Wheat Data 2015-2022 v1.0

This dataset compiles experimental results from FAR Australia's research into wheat, from medium and high yielding environments in Australia, between 2015 and 2022.

The data has been gathered to improve the validation of APSIM-wheat at high yield levels (>8 t/ha; a component of GRDC Project FAR2304-002RTX). The ultimate aim is to incorporate much of it into the APSIM NextGen wheat model validation dataset (https://github.com/APSIMInitiative/ApsimX/tree/master/Tests/Validation/Wheat).

Yield was the initial criteria for including experiments, along with availability of explanatory data such as dry matter and NDVI, and availability of soil and weather data. The criteria have been relaxed to include lower yielding experiments with phenology data that will assist in the parameterisation of cultivars not already in APSIM. 

We will be continuing to collate information about the experiments as we build associated simulations. This repository represents progress to date.

Sharing/access information (D-3.1*)

There is no restriction on the use of this data.

Most of the work has not been published previously in peer-reviewed literature.

If you plan to publish work based to any substantial degree off this dataset, FAR Australia would appreciate being offered the opportunity to be involved early. Our aim is to make a constructive contribution to the work and be included as a co-author.

Where possible, Portable Document Format (pdf) copies of the most recent report on each experiment are included to faciliate interpretation. Many of these can also be found on the FAR Australia website (https://faraustralia.com.au/resource ), or by searching online for GRDC update papers that mention "hyper yielding".

A subset of this data (2022 Hyper-Yielding Wheat experiments) has been published on Zenodo previously, at https://zenodo.org/record/7851239 .

Recommended citation:

Jones, Ben, Nick Poole, Darcy Warren, Maxwell Bloomfield, and Aaron Vague. ‘Field Applied Research (FAR) Australia High Yielding Wheat Data 2015-2022 v1.0’. Zenodo, 3 July 2023. https://doi.org/10.5281/zenodo.8106751.

Data and file overview (D-3.2)

Data files

The data are organised by approximate site, year, and trial ID.

For example, the Albany folder contains folders for each year between 2020 and 2022. The 2020 folder contains folders for two trials: FAR WAA W20-01a, and FAR WAA W20-01b. These were adjacent experiments with the same treatments, on clayed (a) and unclayed (b) soils.

Each folder contains:

The most recent version of the excel data sheet(s) that record original data and contains related calculations (eg. plant density from plant counts). These are in similar formats for most trials, and typically contain at least one version of the trial design (map), assessment worksheets (typically Plot, Serp = serpentine, and/or Full), and often statistical analysis and results tables.

The pdf copy of the most recent report on the experiment.

A JSON object with a unique integer ID that contains site, year, and FAR trial ID.

 The Trials.json object in the root directory contains an array of all the JSON objects, including the paths of the pdf and data files relative to the root directory, in order that files in the dataset can easily be manipulated programmatically. For example:

{"Valid":true,"Id":51,"Trial":"FAR WAA W20-01a","Site":"Albany","Year":2020,"Notes":"","Files":[{"Path":"Albany\\2020\\FAR WAA W20-01a\\200423 FAR WAA W20-01a (clay) ex TW.xlsx","Type":"data"},{"Path":"Albany\\2020\\FAR WAA W20-01a\\210316 HRZ 2020 Cereal Results - FINAL.pdf","Type":"doc"}],"TimeStamp":"2023-07-03T01:40:25.72264Z"}

Location and weather information

The Site_Year_LatLng.xlsx spreadsheet in the root directory lists the latitude and longitude of each trial, where possible determined from the EXIF information attached to photographs of trial plots.

The Weather folder contains downloads of data from weather stations at research sites. The Stations_list.xlsx spreadsheet in the Weather folder indicates which stations are associated with which sites.

Soil and management (ancillary) information

The Ancillary folder contains an initial attempt to draw together soil, management and other information that may be useful for modeling/interpretation but not available in the excel data sheet. This has some basic organisation, but no specific data format. In some cases these are tables copied from the research report.

Where available, these are excel spreadsheets named by site and year, containing one worksheet per trial for information specific to that trial, and remaining worksheets that are relevant to the site as a whole.

For example the  Albany_2020.xlsx spreadsheet in the Ancillary/Albany/2020 folder contains a FAR WAA W20 worksheet with information about the site as a whole, a number of other worksheets imported from site soil samples, and FAR WAA W20-01a and FAR WAA W20-01b worksheets with trial-specific information.

Dataset version

This is the first version of the dataset, uploaded on July 3, 2023.

Methodological information (D-3.3)

A number of processes were used to "discover" the data included in this dataset. Several exhaustive processes were used on files within the FAR Australia dropbox folder. These included:

Survey of all Agricultural Research Manager (ARM) files

Collation of all Microsoft Word (*.doc/x) and Excel (*.xls/x) files

Collation of all image (*.jpg/jpeg) files

Collation of all wheat phenological data

While the initial screen of data to be included focused on wheat yield, dry matter and NDVI (hand-held Greenseeker) data, additional experiments were included based on availability of phenology data.

The trial coding used within FAR Australia systems has remained relatively consistent over most of the period, and has assisted with finding related data. For the example FAR WAA W20-01a, WAA is generally location-related (WA Albany), W is wheat (D is Durum Wheat), 20 is the year 2020, 01 is protocol 1. A further suffixed number is used to indicate time of sowing (W20-01-2 would be a second time of sowing after W20-01-1). Protocol numbering typically remains consistent within a project, but may differ from the sequential numbering given to trials in a report to make them more readable.

No special software should be required, and standards/calibration information is not currently available beyond what is reported for each trial.

Environmental/experimental conditions (D-3.4)

There has been no quality assurance procedure performed on the data. This will be a subject for the FAR2304-002RTX project.

People involved with sample collection, processing, analysis and/or submission are acknowledged in the report associated with each trial.

The trial reports describe experimental or environmental conditions affecting the interpretation of the relevant trial data. Some spreadsheets also contains notes on the data.

Where trial(s) are obviously missing, this is usually related to environmental conditions that rendered the data unusable. An example of this is severe waterlogging at the Gnarwarre site in 2021.

Data-specific information (D-3.5)

The data spreadsheets are self-describing. The rows above the data typically contain the date, crop growth stage, a brief description of the assessment made, initials of the people making the assessment, and any notes.

*D- references refer to the GRDC RD&E Data Capture and Storage Guidelines for Research Partners, Version 1.0

https://grdc.com.au/__data/assets/pdf_file/0033/584259/GRDC-RD-and-E-Data-Capture-and-Storage-Guidelines-for-Research-Partners.pdf

本数据集汇集了澳大利亚田间应用研究（FAR Australia）于2015年至2022年间在澳大利亚中高产环境下开展的小麦研究实验结果。

本数据集的采集旨在优化高产水平（>8吨/公顷）下的APSIM小麦模型（APSIM-wheat）验证工作，该工作为澳大利亚谷物研究与开发公司（GRDC）项目FAR2304-002RTX的组成部分。最终目标是将本数据集的大部分内容整合至APSIM NextGen小麦模型验证数据集（https://github.com/APSIMInitiative/ApsimX/tree/master/Tests/Validation/Wheat）。

实验入选的初始标准为产量数据、干物质与归一化植被指数（NDVI）等解释性数据的可获取性，以及土壤与气象数据的可获取性。后续放宽了入选标准，纳入了带有物候数据的低产实验，这些数据可用于辅助APSIM模型中未覆盖品种的参数化工作。

在构建相关模拟模型的过程中，我们将持续整理各实验的相关信息。本数据集仓库仅展示截至目前的工作进展。

共享与获取说明（D-3.1*）
本数据集无使用限制。
本数据集的大部分内容此前未在同行评议文献中发表。
若您计划基于本数据集开展实质性研究并发表成果，澳大利亚田间应用研究（FAR Australia）希望能够提前参与相关工作，以期为研究提供建设性贡献并以共同作者身份署名。
为便于解读，本数据集尽可能包含各实验最新报告的可移植文档格式（PDF）副本。其中多数报告也可在澳大利亚田间应用研究（FAR Australia）官网（https://faraustralia.com.au/resource ）查询获取，或通过在线搜索提及“超高产”的GRDC更新论文获取。
本数据集的一个子集（2022年超高产小麦实验数据）此前已发布于Zenodo平台，链接为https://zenodo.org/record/7851239。
推荐引用格式：
琼斯（Jones）、本（Ben）、普尔（Poole）、达西·沃伦（Darcy Warren）、麦克斯韦·布卢姆菲尔德（Maxwell Bloomfield）与亚伦·瓦古（Aaron Vague）：《2015-2022年澳大利亚田间应用研究（FAR Australia）超高产小麦数据集v1.0》，Zenodo，2023年7月3日，https://doi.org/10.5281/zenodo.8106751。

数据与文件概览（D-3.2）
数据文件
数据集按照近似试验地点、年份与试验编号进行组织。
例如，奥尔巴尼（Albany）文件夹下包含2020年至2022年各年份的子文件夹。2020年文件夹下包含两个试验的子文件夹：FAR WAA W20-01a与FAR WAA W20-01b。二者为相邻试验，处理方案一致，分别设置于黏壤土（a组）与非黏壤土（b组）中。
每个试验子文件夹包含以下内容：
1. 记录原始数据并包含相关计算（例如通过植株计数推导种植密度）的最新版Excel数据表。多数试验的表格格式较为统一，通常至少包含1份试验设计图、若干评估工作表（一般为Plot、Serp即蛇形区组或Full即全区工作表），且多数包含统计分析与结果表格。
2. 该试验最新报告的PDF副本。
3. 包含唯一整数ID的JSON对象，该对象记录试验地点、年份与FAR试验编号信息。
根目录下的Trials.json文件包含所有上述JSON对象组成的数组，其中包含PDF与数据文件相对于根目录的路径，以便于通过编程方式便捷操作数据集内的文件。例如：
{"Valid":true,"Id":51,"Trial":"FAR WAA W20-01a","Site":"Albany","Year":2020,"Notes":"","Files":[{"Path":"Albany\2020\FAR WAA W20-01a\200423 FAR WAA W20-01a (clay) ex TW.xlsx","Type":"data"},{"Path":"Albany\2020\FAR WAA W20-01a\210316 HRZ 2020 Cereal Results - FINAL.pdf","Type":"doc"}],"TimeStamp":"2023-07-03T01:40:25.72264Z"}

位置与气象信息
根目录下的Site_Year_LatLng.xlsx工作表列出了各试验的经纬度信息，若可行，经纬度信息将从试验地块照片附带的EXIF元数据中提取。
Weather文件夹包含研究站点气象站的下载数据。Weather文件夹内的Stations_list.xlsx工作表说明了各试验站点对应的气象站信息。

土壤与管理（辅助）信息
Ancillary文件夹为初步整合的土壤、管理及其他辅助信息，这些信息可用于模型构建或结果解读，但Excel数据表中未包含。该文件夹具备基础的组织架构，但未限定特定数据格式。部分信息为从研究报告中复制的表格。
若条件允许，辅助信息将以按试验地点与年份命名的Excel工作表形式存储，其中每个试验对应一个工作表，用于记录该试验的专属信息，其余工作表则记录与整个试验站点相关的通用信息。
例如，Ancillary/Albany/2020文件夹下的Albany_2020.xlsx工作表包含FAR WAA W20工作表（记录站点整体信息）、若干从站点土壤样品导入的工作表，以及记录试验专属信息的FAR WAA W20-01a与FAR WAA W20-01b工作表。

数据集版本
本数据集为首次发布版本，上传于2023年7月3日。

方法学说明（D-3.3）
本数据集收录的数据通过多种方式“发掘”得到。我们对澳大利亚田间应用研究（FAR Australia）云盘文件夹内的文件开展了多轮全面梳理工作，具体包括：
- 梳理所有农业研究管理器（ARM）文件
- 整理所有Microsoft Word（*.doc/x）与Excel（*.xls/x）文件
- 整理所有图像（*.jpg/jpeg）文件
- 整理所有小麦物候数据
尽管初始入选数据筛选以小麦产量、干物质与归一化植被指数（NDVI，手持Greenseeker设备采集）数据为核心，但后续基于物候数据的可获取性纳入了更多试验。
FAR澳大利亚系统内使用的试验编码规则在多数时期保持相对统一，有助于快速定位相关数据。以FAR WAA W20-01a为例：WAA通常代表试验地点相关信息（西澳大利亚州奥尔巴尼），W代表小麦（D代表硬粒小麦），20代表2020年，01代表方案1。后缀数字用于区分播种时间（例如W20-01-2代表W20-01-1试验的第二次播种）。方案编号在同一项目内通常保持一致，但可能与报告中为提升可读性而赋予试验的连续编号有所差异。
本数据集无需特殊软件即可打开，且目前除各试验报告中已说明的内容外，无额外的标准或校准信息可供使用。

环境与实验条件说明（D-3.4）
本数据集尚未开展任何质量保证流程，相关工作将作为GRDC项目FAR2304-002RTX的研究内容之一。
参与样品采集、处理、分析及提交的相关人员信息将在各试验附带的报告中予以致谢。
试验报告将说明影响相关试验数据解读的实验或环境条件，部分工作表也包含数据相关备注。
若部分试验数据明显缺失，通常是因为相关环境条件导致数据无法使用，例如2021年格纳尔瓦尔（Gnarwarre）试验站点遭遇严重涝灾。

数据专属说明（D-3.5）
本数据集的Excel数据表均具备自说明性。数据上方的行通常包含日期、作物生长阶段、评估内容简要说明、评估人员姓名缩写及相关备注。

*D-引用均指《澳大利亚谷物研究与开发公司（GRDC）研发数据采集与存储指南（研究伙伴版）v1.0》，链接为https://grdc.com.au/__data/assets/pdf_file/0033/584259/GRDC-RD-and-E-Data-Capture-and-Storage-Guidelines-for-Research-Partners.pdf