Crown-BERT: A crown-morphology-aware deep learning framework for individual tree species classification using UAV LiDAR and hyperspectral Data

The dataset includes the unmanned aerial vehicle (UAV) LiDAR and hyperspectral data for ten sample plots in Maoershan Forest Farm of Northeast Forestry University.Crown-BERT key code and demo data:Code and reproducibility resources for Crown-BERT for individual tree species classification using UAV hyperspectral and LiDAR data. Crown-BERT is a deep learning framework for individual tree species classification using UAV hyperspectral and LiDAR data. It is designed for crown-level classification by jointly leveraging spectral and structural information. The framework integrates Dynamic Crown Masking (DCM), Crown Positional Encoding (CPE), and Crown Masked Pixel Modeling (CMPM) within a BERT-style architecture. This repository provides the main implementation of Crown-BERT together with the associated resources for training, evaluation, and reproducibility.Data OrganizationThe input dataset is organized in <b>HDF5 (</b><code><strong>.h5</strong></code><b>)</b> format. Each HDF5 file contains four keys corresponding to the crown-level inputs and labels used by Crown-BERT:<code>inputs</code>: hyperspectral patch data, with shape <code>(N, B, H, W)</code> and data type <code>float32</code><code>attention_mask</code>: crown-region mask, with shape <code>(N, H, W)</code> and data type <code>float32</code><code>position_encoding</code>: crown positional encoding map, with shape <code>(N, H, W)</code> and data type <code>float32</code><code>labels</code>: one-hot encoded class labels, with shape <code>(N, C)</code> and data type <code>float32</code>Here, <code>N</code> denotes the number of crown samples, <code>B</code> denotes the spectral dimension, <code>H × W</code> denotes the spatial patch size, and <code>C</code> denotes the number of classes. The <code>inputs</code> key stores the hyperspectral crown patches, <code>attention_mask</code> indicates valid crown regions, <code>position_encoding</code> provides the crown positional prior, and <code>labels</code> stores the class annotations for supervised training and evaluation.Code StructureThe repository mainly consists of modules for data loading, model definition, training, and testing.<code>load_data.py</code>: functions for reading HDF5 files and preparing the crown-level inputs used by Crown-BERT<code>model.py</code>: implementation of the Crown-BERT network architecture<code>train.py</code>: training script for model optimization<code>test.py</code>: evaluation script for model testing and performance assessment<code>main.py</code>: main script for organizing the overall workflow, including data loading, model construction, training, and evaluationUsageThe environment configuration, dependency settings, and key hyperparameters used in this project are provided directly in the code. Please refer to <code>train.py</code>, <code>test.py</code>, and the related implementation files for details.