An integrated neural network model for pupil detection and tracking

Authors: Shi, L., Wang, C.Y., Tian, F. and Jia, H.B.

Journal: Soft Computing

Volume: 25

Issue: 15

Pages: 10117-10127

eISSN: 1433-7479

ISSN: 1432-7643

DOI: 10.1007/s00500-021-05984-y

Abstract:

The accurate detection and tracking of pupil is important to many applications such as human–computer interaction, driver’s fatigue detection and diagnosis of brain diseases. Existing approaches however face challenges in handing low quality of pupil images. In this paper, we propose an integrated pupil tracking framework, namely LVCF, based on deep learning. LVCF consists of the pupil detection model VCF which is an end-to-end network, and the LSTM pupil motion prediction model which applies LSTM to track pupil’s position. The proposed network was trained and evaluated on 10600 images and 75 videos taken from 3 realistic datasets. Within an error threshold of 5 pixels, VCF achieves an accuracy of more than 81%, and LVCF outperforms the state of arts by 9% in terms of percentage of pupils tracked. The project of LCVF is available at https://github.com/UnderTheMangoTree/LVCF.

https://eprints.bournemouth.ac.uk/35772/

Source: Scopus

An integrated neural network model for pupil detection and tracking

Authors: Shi, L., Wang, C., Tian, F. and Jia, H.

Journal: SOFT COMPUTING

Volume: 25

Issue: 15

Pages: 10117-10127

eISSN: 1433-7479

ISSN: 1432-7643

DOI: 10.1007/s00500-021-05984-y

https://eprints.bournemouth.ac.uk/35772/

Source: Web of Science (Lite)

An integrated neural network model for pupil detection and tracking

Authors: Shi, L., Wang, C., Tian, F. and Jia, H.

Journal: Soft Computing

Volume: 25

Pages: 10117-10127

ISSN: 1432-7643

Abstract:

The accurate detection and tracking of pupil is important to many applications such as human computer interaction, driver’s fatigue detection and diagnosis of brain diseases. Existing approaches however face challenges in handing low quality of pupil images.

In this paper, we propose an integrated pupil tracking framework namely LVCF, based on deep learning.

LVCF consists of the pupil detection model VCF which is an end-to-end network, and the LSTM pupil motion prediction model which applies LSTM to track pupil’s position. The proposed network was trained and evaluated on 10600 images and 75 videos taken from 3 realistic datasets. Within an error threshold of 5 pixels, VCF achieves an accuracy of more than 81%, and LVCF outperforms the state of arts by 9% in terms of percentage of pupils tracked. The project of LCVF is available at https://github.com/UnderTheMangoTree/LVCF.

https://eprints.bournemouth.ac.uk/35772/

Source: BURO EPrints