Attention estimation by simultaneous analysis of viewer and view

Ashish Tawari, Andreas Møgelmose, Sujitha Martin, Thomas B. Moeslund, Mohan M. Trivedi

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

12 Citations (Scopus)
266 Downloads (Pure)

Abstract

This paper introduces a system for estimating the attention of a driver wearing a first person view camera using salient objects to improve gaze estimation. A challenging data set of pedestrians crossing intersections has been captured using Google Glass worn by a driver. A challenge unique to first person view from cars is that the interior of the car can take up a large part of the image. The proposed system automatically filters out the dashboard of the car, along with other parts of the instrumentation. The remaining area is used as a region of interest for a pedestrian detector. Two cameras looking at the driver are used to determine the direction of the driver’s gaze, by examining the eye corners and the center of the iris. This coarse gaze estimation is then linked to the detected pedestrians to determine which pedestrian the driver is focused on at any given time.
Original languageEnglish
Title of host publicationIEEE 17th International Conference on Intelligent Transportation Systems (ITSC), 2014
Number of pages7
PublisherIEEE Press
Publication date8 Oct 2014
Pages1381-1387
ISBN (Print)9781479960798
DOIs
Publication statusPublished - 8 Oct 2014
EventInternational Conference on Intelligent Transportation Systems, 2014 - Qingdao, China
Duration: 8 Oct 201411 Oct 2014
Conference number: 17

Conference

ConferenceInternational Conference on Intelligent Transportation Systems, 2014
Number17
CountryChina
CityQingdao
Period08/10/201411/10/2014

Fingerprint

Railroad cars
Cameras
Crosswalks
Detectors
Glass

Cite this

Tawari, A., Møgelmose, A., Martin, S., Moeslund, T. B., & Trivedi, M. M. (2014). Attention estimation by simultaneous analysis of viewer and view. In IEEE 17th International Conference on Intelligent Transportation Systems (ITSC), 2014 (pp. 1381-1387). IEEE Press. https://doi.org/10.1109/ITSC.2014.6957880
Tawari, Ashish ; Møgelmose, Andreas ; Martin, Sujitha ; Moeslund, Thomas B. ; Trivedi, Mohan M. / Attention estimation by simultaneous analysis of viewer and view. IEEE 17th International Conference on Intelligent Transportation Systems (ITSC), 2014. IEEE Press, 2014. pp. 1381-1387
@inproceedings{11645c9b257d465790a09c839f720462,
title = "Attention estimation by simultaneous analysis of viewer and view",
abstract = "This paper introduces a system for estimating the attention of a driver wearing a first person view camera using salient objects to improve gaze estimation. A challenging data set of pedestrians crossing intersections has been captured using Google Glass worn by a driver. A challenge unique to first person view from cars is that the interior of the car can take up a large part of the image. The proposed system automatically filters out the dashboard of the car, along with other parts of the instrumentation. The remaining area is used as a region of interest for a pedestrian detector. Two cameras looking at the driver are used to determine the direction of the driver’s gaze, by examining the eye corners and the center of the iris. This coarse gaze estimation is then linked to the detected pedestrians to determine which pedestrian the driver is focused on at any given time.",
author = "Ashish Tawari and Andreas M{\o}gelmose and Sujitha Martin and Moeslund, {Thomas B.} and Trivedi, {Mohan M.}",
year = "2014",
month = "10",
day = "8",
doi = "10.1109/ITSC.2014.6957880",
language = "English",
isbn = "9781479960798",
pages = "1381--1387",
booktitle = "IEEE 17th International Conference on Intelligent Transportation Systems (ITSC), 2014",
publisher = "IEEE Press",

}

Tawari, A, Møgelmose, A, Martin, S, Moeslund, TB & Trivedi, MM 2014, Attention estimation by simultaneous analysis of viewer and view. in IEEE 17th International Conference on Intelligent Transportation Systems (ITSC), 2014. IEEE Press, pp. 1381-1387, Qingdao, China, 08/10/2014. https://doi.org/10.1109/ITSC.2014.6957880

Attention estimation by simultaneous analysis of viewer and view. / Tawari, Ashish; Møgelmose, Andreas; Martin, Sujitha; Moeslund, Thomas B.; Trivedi, Mohan M.

IEEE 17th International Conference on Intelligent Transportation Systems (ITSC), 2014. IEEE Press, 2014. p. 1381-1387.

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

TY - GEN

T1 - Attention estimation by simultaneous analysis of viewer and view

AU - Tawari, Ashish

AU - Møgelmose, Andreas

AU - Martin, Sujitha

AU - Moeslund, Thomas B.

AU - Trivedi, Mohan M.

PY - 2014/10/8

Y1 - 2014/10/8

N2 - This paper introduces a system for estimating the attention of a driver wearing a first person view camera using salient objects to improve gaze estimation. A challenging data set of pedestrians crossing intersections has been captured using Google Glass worn by a driver. A challenge unique to first person view from cars is that the interior of the car can take up a large part of the image. The proposed system automatically filters out the dashboard of the car, along with other parts of the instrumentation. The remaining area is used as a region of interest for a pedestrian detector. Two cameras looking at the driver are used to determine the direction of the driver’s gaze, by examining the eye corners and the center of the iris. This coarse gaze estimation is then linked to the detected pedestrians to determine which pedestrian the driver is focused on at any given time.

AB - This paper introduces a system for estimating the attention of a driver wearing a first person view camera using salient objects to improve gaze estimation. A challenging data set of pedestrians crossing intersections has been captured using Google Glass worn by a driver. A challenge unique to first person view from cars is that the interior of the car can take up a large part of the image. The proposed system automatically filters out the dashboard of the car, along with other parts of the instrumentation. The remaining area is used as a region of interest for a pedestrian detector. Two cameras looking at the driver are used to determine the direction of the driver’s gaze, by examining the eye corners and the center of the iris. This coarse gaze estimation is then linked to the detected pedestrians to determine which pedestrian the driver is focused on at any given time.

U2 - 10.1109/ITSC.2014.6957880

DO - 10.1109/ITSC.2014.6957880

M3 - Article in proceeding

SN - 9781479960798

SP - 1381

EP - 1387

BT - IEEE 17th International Conference on Intelligent Transportation Systems (ITSC), 2014

PB - IEEE Press

ER -

Tawari A, Møgelmose A, Martin S, Moeslund TB, Trivedi MM. Attention estimation by simultaneous analysis of viewer and view. In IEEE 17th International Conference on Intelligent Transportation Systems (ITSC), 2014. IEEE Press. 2014. p. 1381-1387 https://doi.org/10.1109/ITSC.2014.6957880