Towards Semantic Understanding of Surrounding Vehicular Maneuvers: A Panoramic Vision-Based Framework for Real-World Highway Studies

Miklas Strøm Kristoffersen; Jacob Velling Dueholm; Ravi K. Satzoda; Mohan M. Trivedi; Andreas Møgelmose; Thomas B. Moeslund

doi:10.1109/CVPRW.2016.197

Towards Semantic Understanding of Surrounding Vehicular Maneuvers: A Panoramic Vision-Based Framework for Real-World Highway Studies

Miklas Strøm Kristoffersen, Jacob Velling Dueholm, Ravi K. Satzoda, Mohan M. Trivedi, Andreas Møgelmose, Thomas B. Moeslund

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

12 Citations (Scopus)

565 Downloads (Pure)

Abstract

This paper proposes the use of multiple low-cost visual sensors to obtain a surround view of the ego-vehicle for semantic understanding. A multi-perspective view will assist the analysis of naturalistic driving studies (NDS), by automating the task of data reduction of the observed sequences into events. A user-centric vision-based framework is presented using a vehicle detector and tracker in each separate perspective. Multi-perspective trajectories are estimated and analyzed to extract 14 different events, including potential dangerous behaviors such as overtakes and cut-ins. The system is tested on ten sequences of real-world data collected on U. S. highways. The results show the potential use of multiple low-cost visual sensors for semantic understanding around the ego-vehicle.

Original language	English
Title of host publication	2016 IEEE Computer Vision and Pattern Recognition Workshops : Automatic Traffic Surveillance
Publisher	IEEE
Publication date	19 Dec 2016
Pages	1584-1591
ISBN (Print)	978-1-5090-1438-5
ISBN (Electronic)	978-1-5090-1437-8
DOIs	https://doi.org/10.1109/CVPRW.2016.197
Publication status	Published - 19 Dec 2016
Event	2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops: Automated Traffic Surveillance - Las Vegas, United States Duration: 1 Jul 2016 → …

Workshop

Workshop	2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops: Automated Traffic Surveillance
Country/Territory	United States
City	Las Vegas
Period	01/07/2016 → …

Access to Document

10.1109/CVPRW.2016.197

Towards Semantic Understanding of Surrounding Vehicular Maneuvers: A Panoramic Vision-Based Framework for Real-World Highway StudiesAccepted author manuscript, 3.73 MB

AUB Link

Search for the material in Aalborg University Library's search engine

Master of Science in Vision, Graphics and Interactive Systems
Dueholm, J. V.
01/09/2014 → 30/06/2016
Project: Other

Cite this

Kristoffersen, M. S., Dueholm, J. V., Satzoda, R. K., Trivedi, M. M., Møgelmose, A., & Moeslund, T. B. (2016). Towards Semantic Understanding of Surrounding Vehicular Maneuvers: A Panoramic Vision-Based Framework for Real-World Highway Studies. In 2016 IEEE Computer Vision and Pattern Recognition Workshops: Automatic Traffic Surveillance (pp. 1584-1591). IEEE. https://doi.org/10.1109/CVPRW.2016.197

@inproceedings{4a8c0cca54d84dccb581f426a984c713,

title = "Towards Semantic Understanding of Surrounding Vehicular Maneuvers: A Panoramic Vision-Based Framework for Real-World Highway Studies",

abstract = "This paper proposes the use of multiple low-cost visual sensors to obtain a surround view of the ego-vehicle for semantic understanding. A multi-perspective view will assist the analysis of naturalistic driving studies (NDS), by automating the task of data reduction of the observed sequences into events. A user-centric vision-based framework is presented using a vehicle detector and tracker in each separate perspective. Multi-perspective trajectories are estimated and analyzed to extract 14 different events, including potential dangerous behaviors such as overtakes and cut-ins. The system is tested on ten sequences of real-world data collected on U. S. highways. The results show the potential use of multiple low-cost visual sensors for semantic understanding around the ego-vehicle.",

author = "Kristoffersen, {Miklas Str{\o}m} and Dueholm, {Jacob Velling} and Satzoda, {Ravi K.} and Trivedi, {Mohan M.} and Andreas M{\o}gelmose and Moeslund, {Thomas B.}",

year = "2016",

month = dec,

day = "19",

doi = "10.1109/CVPRW.2016.197",

language = "English",

isbn = "978-1-5090-1438-5",

pages = "1584--1591",

booktitle = "2016 IEEE Computer Vision and Pattern Recognition Workshops",

publisher = "IEEE",

address = "United States",

note = "2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops: Automated Traffic Surveillance ; Conference date: 01-07-2016",

}

Kristoffersen, MS, Dueholm, JV, Satzoda, RK, Trivedi, MM, Møgelmose, A & Moeslund, TB 2016, Towards Semantic Understanding of Surrounding Vehicular Maneuvers: A Panoramic Vision-Based Framework for Real-World Highway Studies. in 2016 IEEE Computer Vision and Pattern Recognition Workshops: Automatic Traffic Surveillance. IEEE, pp. 1584-1591, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops: Automated Traffic Surveillance, Las Vegas, United States, 01/07/2016. https://doi.org/10.1109/CVPRW.2016.197

Towards Semantic Understanding of Surrounding Vehicular Maneuvers: A Panoramic Vision-Based Framework for Real-World Highway Studies. / Kristoffersen, Miklas Strøm; Dueholm, Jacob Velling; Satzoda, Ravi K. et al.
2016 IEEE Computer Vision and Pattern Recognition Workshops: Automatic Traffic Surveillance. IEEE, 2016. p. 1584-1591.

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

TY - GEN

T1 - Towards Semantic Understanding of Surrounding Vehicular Maneuvers

T2 - 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops: Automated Traffic Surveillance

AU - Kristoffersen, Miklas Strøm

AU - Dueholm, Jacob Velling

AU - Satzoda, Ravi K.

AU - Trivedi, Mohan M.

AU - Møgelmose, Andreas

AU - Moeslund, Thomas B.

PY - 2016/12/19

Y1 - 2016/12/19

N2 - This paper proposes the use of multiple low-cost visual sensors to obtain a surround view of the ego-vehicle for semantic understanding. A multi-perspective view will assist the analysis of naturalistic driving studies (NDS), by automating the task of data reduction of the observed sequences into events. A user-centric vision-based framework is presented using a vehicle detector and tracker in each separate perspective. Multi-perspective trajectories are estimated and analyzed to extract 14 different events, including potential dangerous behaviors such as overtakes and cut-ins. The system is tested on ten sequences of real-world data collected on U. S. highways. The results show the potential use of multiple low-cost visual sensors for semantic understanding around the ego-vehicle.

AB - This paper proposes the use of multiple low-cost visual sensors to obtain a surround view of the ego-vehicle for semantic understanding. A multi-perspective view will assist the analysis of naturalistic driving studies (NDS), by automating the task of data reduction of the observed sequences into events. A user-centric vision-based framework is presented using a vehicle detector and tracker in each separate perspective. Multi-perspective trajectories are estimated and analyzed to extract 14 different events, including potential dangerous behaviors such as overtakes and cut-ins. The system is tested on ten sequences of real-world data collected on U. S. highways. The results show the potential use of multiple low-cost visual sensors for semantic understanding around the ego-vehicle.

U2 - 10.1109/CVPRW.2016.197

DO - 10.1109/CVPRW.2016.197

M3 - Article in proceeding

SN - 978-1-5090-1438-5

SP - 1584

EP - 1591

BT - 2016 IEEE Computer Vision and Pattern Recognition Workshops

PB - IEEE

Y2 - 1 July 2016

ER -

Towards Semantic Understanding of Surrounding Vehicular Maneuvers: A Panoramic Vision-Based Framework for Real-World Highway Studies

Abstract

Workshop

Access to Document

AUB Link

Fingerprint

Projects

Master of Science in Vision, Graphics and Interactive Systems

Cite this