Abstract
Rainfall is a problem in automated traffic surveillance. Rain streaks occlude the road users and degrade the overall visibility which in turn decrease object detection performance. One way of alleviating this is by artificially removing the rain from the images. This requires knowledge of corresponding rainy and rain-free images. Such images are often produced by overlaying synthetic rain on top of rain-free images. However, this method fails to incorporate the fact that rain fall in the entire three-dimensional volume of the scene. To overcome this, we introduce training data from the SYNTHIA virtual world that models rain streaks in the entirety of a scene. We train a conditional Generative Adversarial Network for rain removal and apply it on traffic surveillance images from SYNTHIA and the AAU RainSnow datasets. To measure the applicability of the rain-removed images in a traffic surveillance context, we run the YOLOv2 object detection algorithm on the original and rain-removed frames. The results on SYNTHIA show an 8% increase in detection accuracy compared to the original rain image. Interestingly, we find that high PSNR or SSIM scores do not imply good object detection performance.
Original language | English |
---|---|
Title of host publication | Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications |
Editors | Andreas Kerren, Christophe Hurter, Jose Braz |
Number of pages | 8 |
Volume | 4 |
Publisher | SCITEPRESS Digital Library |
Publication date | 2019 |
Pages | 123-130 |
ISBN (Electronic) | 9789897583544 |
DOIs | |
Publication status | Published - 2019 |
Event | 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (Visigrapp 2019) - Prague, Czech Republic Duration: 25 Feb 2019 → 27 Feb 2019 |
Conference
Conference | 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (Visigrapp 2019) |
---|---|
Country/Territory | Czech Republic |
City | Prague |
Period | 25/02/2019 → 27/02/2019 |
Keywords
- Image Denoising
- Rain Removal
- Traffic Surveillance