CNN-Based Pupil Center Detection for Wearable Gaze Estimation System

This paper presents a convolutional neural network- (CNN-) based pupil center detection method for a wearable gaze estimation system using infrared eye images. Potentially, the pupil center position of a user’s eye can be used in various applications, such as human-computer interaction, medical diag...

Full description

Saved in:
Bibliographic Details
Main Authors: Warapon Chinsatit, Takeshi Saitoh
Format: Article
Language:English
Published: Wiley 2017-01-01
Series:Applied Computational Intelligence and Soft Computing
Online Access:http://dx.doi.org/10.1155/2017/8718956
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832545579238948864
author Warapon Chinsatit
Takeshi Saitoh
author_facet Warapon Chinsatit
Takeshi Saitoh
author_sort Warapon Chinsatit
collection DOAJ
description This paper presents a convolutional neural network- (CNN-) based pupil center detection method for a wearable gaze estimation system using infrared eye images. Potentially, the pupil center position of a user’s eye can be used in various applications, such as human-computer interaction, medical diagnosis, and psychological studies. However, users tend to blink frequently; thus, estimating gaze direction is difficult. The proposed method uses two CNN models. The first CNN model is used to classify the eye state and the second is used to estimate the pupil center position. The classification model filters images with closed eyes and terminates the gaze estimation process when the input image shows a closed eye. In addition, this paper presents a process to create an eye image dataset using a wearable camera. This dataset, which was used to evaluate the proposed method, has approximately 20,000 images and a wide variation of eye states. We evaluated the proposed method from various perspectives. The result shows that the proposed method obtained good accuracy and has the potential for application in wearable device-based gaze estimation.
format Article
id doaj-art-637643b957a64c658df3428bff6b6b1e
institution Kabale University
issn 1687-9724
1687-9732
language English
publishDate 2017-01-01
publisher Wiley
record_format Article
series Applied Computational Intelligence and Soft Computing
spelling doaj-art-637643b957a64c658df3428bff6b6b1e2025-02-03T07:25:28ZengWileyApplied Computational Intelligence and Soft Computing1687-97241687-97322017-01-01201710.1155/2017/87189568718956CNN-Based Pupil Center Detection for Wearable Gaze Estimation SystemWarapon Chinsatit0Takeshi Saitoh1Graduate School of Computer Science and Systems Engineering, Kyushu Institute of Technology, 680–4 Kawazu, Iizuka-shi, Fukuoka 820-8502, JapanGraduate School of Computer Science and Systems Engineering, Kyushu Institute of Technology, 680–4 Kawazu, Iizuka-shi, Fukuoka 820-8502, JapanThis paper presents a convolutional neural network- (CNN-) based pupil center detection method for a wearable gaze estimation system using infrared eye images. Potentially, the pupil center position of a user’s eye can be used in various applications, such as human-computer interaction, medical diagnosis, and psychological studies. However, users tend to blink frequently; thus, estimating gaze direction is difficult. The proposed method uses two CNN models. The first CNN model is used to classify the eye state and the second is used to estimate the pupil center position. The classification model filters images with closed eyes and terminates the gaze estimation process when the input image shows a closed eye. In addition, this paper presents a process to create an eye image dataset using a wearable camera. This dataset, which was used to evaluate the proposed method, has approximately 20,000 images and a wide variation of eye states. We evaluated the proposed method from various perspectives. The result shows that the proposed method obtained good accuracy and has the potential for application in wearable device-based gaze estimation.http://dx.doi.org/10.1155/2017/8718956
spellingShingle Warapon Chinsatit
Takeshi Saitoh
CNN-Based Pupil Center Detection for Wearable Gaze Estimation System
Applied Computational Intelligence and Soft Computing
title CNN-Based Pupil Center Detection for Wearable Gaze Estimation System
title_full CNN-Based Pupil Center Detection for Wearable Gaze Estimation System
title_fullStr CNN-Based Pupil Center Detection for Wearable Gaze Estimation System
title_full_unstemmed CNN-Based Pupil Center Detection for Wearable Gaze Estimation System
title_short CNN-Based Pupil Center Detection for Wearable Gaze Estimation System
title_sort cnn based pupil center detection for wearable gaze estimation system
url http://dx.doi.org/10.1155/2017/8718956
work_keys_str_mv AT waraponchinsatit cnnbasedpupilcenterdetectionforwearablegazeestimationsystem
AT takeshisaitoh cnnbasedpupilcenterdetectionforwearablegazeestimationsystem