Design and Implementation of an Eye-Tracking System with OpenCV and Synthetic Data

Authors

  • Weizhe Sun

DOI:

https://doi.org/10.54097/5j4z5e05

Keywords:

Eye-tracking, CNN, OpenCV.

Abstract

Eye-tracking technology is instrumental in assistive devices, especially for individuals with limited motor abilities. This paper presents an eye-tracking system developed using OpenCV, with a focus on pupil detection and gaze direction estimation. By leveraging synthetic data alongside appearance-based models, this system enhances accuracy and adaptability, addressing common challenges in dynamic environments. The approach seeks for improve robustness of eye-tracking systems in this world applications, particularly in assistive technologies. Eye-tracking technology is crucial to the in assistive devices, particularly for individuals with motor impairments. These systems facilitate user interaction through gaze control, greatly improving life quality. This paper presents an eye-tracking system developed using OpenCV, focusing on detecting pupil position and estimating gaze direction with image processing techniques.  The approach incorporates synthetic data and appearance-based models to enhance system adaptability and accuracy in real-world scenarios.  By addressing limitations in traditional systems, including environmental sensitivity, this method provides a robust solution for dynamic environments.  The study identifies potential applications in assistive technology, promoting more adaptable and accurate control systems.

Downloads

Download data is not yet available.

References

[1] Szeliski, R. 2010. Computer vision: algorithms and applications. Springer.

[2] Krizhevsky, A., Sutskever, I., & Hinton, G. E. 2012. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 1097-1105.

[3] Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. 2017. It’s written all over your face: Full-face appearance-based gaze estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2291-2300.

[4] Krafka, K., Khosla, A., Kellnhofer, P., Kannan, H., Bhandarkar, S., Matusik, W., & Torralba, A. 2016. Eye tracking for everyone. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2176-2184.

[5] Redmon, J., & Farhadi, A. 2018. YOLOv3: An incremental improvement. arXiv preprint arXiv:1804.02767.

[6] Kassner, M., Patera, W., & Bulling, A. 2014. Pupil: An open-source platform for pervasive eye tracking and mobile gaze-based interaction. Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication, 1151-1160.

[7] Wood, E., Baltrusaitis, T., Hewitt, C., Johnson, M., Shotton, J., & Valentine, S. 2016. Learning an appearance-based gaze estimator from one million synthesized images. Proceedings of the 9th ACM International Symposium on Eye Tracking Research & Applications (ETRA 2016).

[8] Park, K. W., & Lee, D. 2018. A review on computer vision techniques in medical image analysis. Journal of Digital Imaging, 31(3), 386-403.

[9] Santini, T., Fuhl, W., & Kasneci, E. 2017. PupilNet: Convolutional Neural Networks for Robust Pupil Detection. arXiv preprint arXiv:1705.08940.

[10] Kellnhofer, P., Recasens, A., Stent, S., Matusik, W., & Torralba, A. 2019. Gaze360: Physically unconstrained gaze estimation in the wild. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 6912-6921.

[11] Mora, K., & Odobez, J. M. 2018. Gaze estimation in the 3D space using RGB-D sensors. International Journal of Computer Vision, 126(9), 1080-1104.

Downloads

Published

29-01-2026

Issue

Section

Articles

How to Cite

Sun, W. (2026). Design and Implementation of an Eye-Tracking System with OpenCV and Synthetic Data. Academic Journal of Science and Technology, 19(2), 369-374. https://doi.org/10.54097/5j4z5e05