Abstract

We present the first work where re-identification ofthe Giant Sunfish (Mola alexandrini) is automated using computer vision and deep learning. We propose a pipeline that scores an mAP of 60.34% on a full rank of the novel TinyMola dataset which includes 31 IDs and 91 images. The method requires no domain-adaptation or training which makes it especially suited for low-budget or volunteer-based projects, like Match My Mola, as part of a human-in-the-loop model.

The pipeline includes segmentation, keypoint detection and description, keypoint matching, and ranking. The choice of feature descriptor has the largest impact on the performance and we show that the deep learning based SuperPoint descriptor greatly outperforms handcrafted descriptors like SIFT and RootSIFT independent of the segmentation level and matching method. Combining SuperPoint and the graph neural network based SuperGlue matching method produces the best results.
OriginalsprogEngelsk
TidsskriftProceedings of the Northern Lights Deep Learning Workshop
Vol/bind3
Antal sider9
ISSN2703-6928
DOI
StatusUdgivet - 28 mar. 2022
BegivenhedNorthern Lights Deep Learning Workshop - Tromsø, Norge
Varighed: 10 jan. 202212 jan. 2022
https://www.nldl.org/

Workshop

WorkshopNorthern Lights Deep Learning Workshop
Land/OmrådeNorge
ByTromsø
Periode10/01/202212/01/2022
Internetadresse

Fingeraftryk

Dyk ned i forskningsemnerne om 'Re-Identification of Giant Sunfish using Keypoint Matching'. Sammen danner de et unikt fingeraftryk.

Citationsformater