Individual identification of brown bears using pose-aware metric learning

# Individual identification of brown bears sing pose-aware metric learning Multi-year re-identification for brown bears collected at McNeil River, Alaska USA (2017–2022). Identifying individuals within a species is a cornerstone of ecological and biological research, holding the key to understanding behavior, population dynamics, and conservation needs. However, conventional identification methods such as genetic sampling and physical tags come with significant trade-offs, including invasiveness, high costs, and limited scalability. Despite remarkable advances in computer vision that have transformed the identification of patterned species, reliably distinguishing individuals in unmarked species remains an open challenge. Here, we curate a novel dataset of visually identified individual Alaskan coastal brown bears (Ursus arctos). This 72K image dataset contains high-resolution images of 109 known individuals from multiple seasons and in varied conditions (e.g., fur shed, substantial weight gain). Identification of these bears is notoriously difficult, yet our new pose-aware metric-learning-based AI model is able to leverage biometric information that enables individual re-identification (ReID) with promising accuracy for future research and conservation efforts. Our findings indicate that it is possible to reidentify individual brown bears across years and to detect unknown individuals in a 'real-world' open dataset. PoseSwin presents a promising approach to the challenge of non-invasive ReID of other unmarked species, as well, and points toward an expanded range of possible questions in wildlife and ecological research. > ⚠️ Data can be found at [https://zenodo.org/records/xxx](https://zenodo.org/records/xxx) ## General information * **Authors**: Beth Rosenberg, Mu Zhou, Nathan Wolf, Mackenzie W. Mathis, Bradley P. Harris, Alexander Mathis * **Affiliations**: Fisheries, Aquatic Science, and Technology Laboratory, Alaska Pacific University, USA (B.R., N.W., B.P.H.) Brain Mind Institute and Neuro-X Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne (EPFL), Switzerland (M.Z., M.W.M., A.M.) B.R. and M.Z. contributed equally. Correspondence: [e-mail] and [e-mail] ## Dataset availability * **License**: This dataset is released under the non-commercial [CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/legalcode) license. * **Citation**: Please consider citing the associated publication when using our data. * **Repository URL**: [https://github.com/amathislab/BrownBear_ReID](https://github.com/amathislab/BrownBear_ReID) * **Dataset version**: v1 ## Data and files overview * **Data preparation**: unzip `Public_release.zip` * **Repository structure**: ``` Public_release ├── checkpoints │ ├── preprocessing_ckpts │ │ ├── detectors │ │ │ ├── body_detector/ │ │ │ └── face_detector/ │ │ └── pose/ │ │ │ └── reid_ckpts │ ├── 2017_2022_six_exps │ │ ├── test_on_2017 │ │ │ └── net_xx.pth │ │ ├── test_on_2018/ │ │ ├── test_on_2019/ │ │ ├── test_on_2020/ │ │ ├── test_on_2021/ │ │ └── test_on_2022/ │ │ │ └── katmai_exps │ ├── 1y_model │ │ └── net_xx.pth │ ├── 3y_model/ │ └── 6y_model/ │ ├── data │ ├── GT │ │ ├── coco_bearface_new/ │ │ ├── head_orientation/ │ │ ├── mmpose_faceposeestimation/ │ │ └── superface_data/ │ │ │ └── train_test_reid │ ├── test_on_2017/ │ │ ├── train_iid.csv │ │ ├── val_iid.csv │ │ ├── test_iid.csv │ │ └── test_ood.csv │ ├── test_on_2018/ │ ├── test_on_2019/ │ ├── test_on_2020/ │ ├── test_on_2021/ │ └── test_on_2022/ │ └── README.md ``` ### Checkpoints Overview It contains the checkpoints for all processing and re-identification models used in the project. Including: (1) Preprocessing models (body detector, head detector, pose estimator), (2) ReID models: six-year ReID experiments, Katmai cross-site experiments. ### Data Overview It contains the preprocessing annotations (including head detection, face pose estimation) and the ReID dataset (6 experiments with train/val/iid/ood splits). > We refer the reader to the associated publication for details about data processing and splits description. ## Acknowledgements We thank Steven A. Rosenberg and members of the Mathis group for feedback on earlier versions of this manuscript. We thank Maxime Vidal for preliminary data processing and analysis; Julia Ditto and Felipe Restrepo for help with figures; Larry Aumiller, Kelly Debure and Teresa Fish for preliminary study design; MB, LB, JH for citizen science images. BR, NW and BPH are grateful for Alaska Education Tax Credit funding donated by the At-Sea Processors Association. We are grateful to EPFL’s School of Life Sciences PTECH fund for providing funding (A.M.). ## Change log (DD.MM.YYYY) [28.11.2025]: First data release. [04.12.2025]: Minor changes to readme.