Research on fatigue driving detection technology based on Dlib and micro-expression


  • Xinru Fang
  • Xinyue Yan



Fatigue driving, Facial feature recognition, Micro-expressions, Multi-featured


Driver fatigue is the most important factor contributing to the annual increase in traffic accidents and fatalities. Fatigue can affect driving performance due to lack of concentration and slower reaction time. Therefore, fatigue detection systems are crucial for safe driving. This article proposes a fatigue driving detection scheme based on the dlib library. Build a facial key point detection system based on the Dlib library. Real time calculation of eye and mouth data and head Euler angles using HOG-SVM algorithm, PnP algorithm, and fixed threshold. When running the YOLOV5 model in a PyTorch environment to recognize distracting behaviors, training is conducted on the sample and test sets for recognition, and the accuracy of the model is verified using the validation set for accurate recognition. Train smoking, answering and making phone calls, and drinking water behaviors to achieve distraction detection. Using convolutional neural networks to detect driver status and perform micro expression analysis. Fatigue assessment in multi feature situations of eye, mouth, and head posture and micro expression attention discrimination.


Xinyun Hu, Gabriel Lodewijks. Detecting fatigue in car drivers and aircraft pilots by using non-invasive measures: The value of differentiation of sleepiness and mental fatigue[J]. Journal of Safety Research,2020,72173-187.

Albadawi Yaman, Takruri Maen, Awad Mohammed. A Review of Recent Developments in Driver Drowsiness Detection Systems[J]. Sensors,2022,22(5):2069-2069.

Abbas Qaisar, Alsheddy Abdullah. Driver Fatigue Detection Systems Using Multi-Sensors, Smartphone, and Cloud-Based Computing Platforms: A Comparative Analysis.[J].Sensors (Basel, Switzerland),2020,21(1):189-201.

Civik E, Yuzgec U. Real-time driver fatigue detection system with deep learning on a low-cost embedded system[J].Microprocessors and microsystems, 2023.

Lashkov I , Kashevnik A , Shilov N ,et al.Driver Dangerous State Detection Based on OpenCV & Dlib Libraries Using Mobile Video Processing[C]//2019 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).IEEE, 2019.

Rani P I , Muneeswaran K .Recognize the facial emotion in video sequences using eye and mouth temporal Gabor features[J].Multimedia Tools and Applications, 2016, 76(7):1-24.

Angeliki,Fydanaki,Zeno,et al. Evaluating OpenFace: an open-source automatic facial comparison algorithm for forensics.[J].Forensic Sciences Research, 2018.

Fran├žois Rocca, Mancas M , Gosselin B .Head Pose Estimation by Perspective-n-Point Solution Based on 2D Markerless Face Tracking[C]//International Conference on Intelligent Technologies for Interactive Entertainment. Springer, Cham, 2014.







How to Cite

Fang, X., & Yan, X. (2024). Research on fatigue driving detection technology based on Dlib and micro-expression. Journal of Computing and Electronic Information Management, 13(2), 52-56.

Similar Articles

1-10 of 42

You may also start an advanced similarity search for this article.