Abstrakt

In this work we present a novel publicly available stereo based 3D RGB dataset for multi object zebrafish tracking, called 3D-ZeF. Zebrafish is an increasingly popular model organism used for studying neurological disorders, drug addiction, and more. Behavioral analysis is often a critical part of such research.
However, the high occlusion frequency, visual similarity, and erratic movement of the zebrafish makes robust 3D tracking a challenging and unsolved problem.
The proposed dataset consists of eight sequences with a duration between 15-120 seconds and 1-10 free moving zebrafish. The videos have been annotated with a total of 86,400 points and bounding boxes; and a complexity measure, based on the level of occlusions, is provided for all the sequences. Furthermore, we present a novel open-source modular baseline system for 3D tracking of zebrafish. The performance of the system is measured on behalf of two detectors: a naive approach and a Faster R-CNN based fish head detector. The system reaches a MOTA of up to 77.6% but there are indications that the trained head detector do not generalize well between different cohorts of zebrafish.
OriginalsprogEngelsk
Titel2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
ForlagIEEE
StatusAccepteret/In press - 2020
Begivenhed2020 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) - Seattle, USA
Varighed: 14 jun. 202019 jun. 2020

Konference

Konference2020 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
LandUSA
BySeattle
Periode14/06/202019/06/2020
NavnI E E E Conference on Computer Vision and Pattern Recognition. Proceedings
ISSN1063-6919

Fingeraftryk Dyk ned i forskningsemnerne om '3D-ZeF: A 3D Zebrafish Tracking Benchmark Dataset'. Sammen danner de et unikt fingeraftryk.

  • Projekter

    • 1 Igangværende

    Marine Analytics using Computer Vision

    Pedersen, M.

    01/01/202001/01/2023

    Projekter: ProjektForskning

    Forskningsdatasæt

    3D-ZeF

    Pedersen, M. (Ophavsmand), Haurum, J. B. (Ophavsmand), Bengtson, S. H. (Ophavsmand) & Moeslund, T. B. (Ophavsmand), MOTChallenge, 2020

    Datasæt

    Citationsformater

    Pedersen, M., Haurum, J. B., Bengtson, S. H., & Moeslund, T. B. (Accepteret/In press). 3D-ZeF: A 3D Zebrafish Tracking Benchmark Dataset. I 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) IEEE. I E E E Conference on Computer Vision and Pattern Recognition. Proceedings http://openaccess.thecvf.com/content_CVPR_2020/papers/Pedersen_3D-ZeF_A_3D_Zebrafish_Tracking_Benchmark_Dataset_CVPR_2020_paper.pdf