1 Citation (Scopus)


Drowning in harbors and along waterfronts is a serious problem, worsened by the challenge of achieving timely rescue efforts. To address this problem, we propose a privacy-friendly assistant surveillance system for identifying potentially hazardous situations (human activities near the water’s edge) in order to give early warning. This will allow lifeguards and first responders to react proactively with a basis in accurate information. In order to achieve this, we develop and compare two vision-based solutions. One is a supervised approach based on the popular object detection framework, which allows us to detect humans in a defined area near the water’s edge. The other is a self-supervised approach where anomalies are detected based on the reconstruction error from an autoencoder. To best comply with privacy requirements both solutions rely on thermal imaging captured in an active harbor environment. With a dataset having both safe and risky scenes, the two solutions are evaluated and compared, showing that the detector-based method wins in terms of performances, while the autoencoder-based method has the benefit of not requiring expensive annotations.

Original languageEnglish
Title of host publicationVISIGRAPP 2021 - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications
EditorsGiovanni Maria Farinella, Petia Radeva, Jose Braz, Kadi Bouatouch
Number of pages8
PublisherSCITEPRESS – Science and Technology Publications
Publication date2021
ISBN (Electronic)9789897584886
Publication statusPublished - 2021
EventInternational Conference on Computer Vision Theory and Applications -
Duration: 8 Feb 202110 Feb 2021
Conference number: 16


ConferenceInternational Conference on Computer Vision Theory and Applications
Internet address


  • Safety, Drowning, Surveillance, Thermal Imaging, Deep Learning, Human Detection, Anomaly Detection


Dive into the research topics of 'Supervised versus Self-supervised Assistant for Surveillance of Harbor Fronts'. Together they form a unique fingerprint.

Cite this