A High Performance and Robust FPGA Implementation of a Driver State Monitoring Application
Author:
Christakos P.1, Petrellis N.1ORCID, Mousouliotis P.2, Keramidas G.3, Antonopoulos C. P.1ORCID, Voros N.1
Affiliation:
1. Electrical and Computer Engineering, University of Peloponnese, 263 34 Patras, Greece 2. Electrical and Computer Engineering, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece 3. Computer Science, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece
Abstract
A high-performance Driver State Monitoring (DSM) application for the detection of driver drowsiness is presented in this paper. The popular Ensemble of Regression Trees (ERTs) machine learning method has been employed for the alignment of 68 facial landmarks. Open-source implementation of ERTs for facial shape alignment has been ported to different platforms and adapted for the acceleration of the frame processing speed using reconfigurable hardware. Reducing the frame processing latency saves time that can be used to apply frame-to-frame facial shape coherency rules. False face detection and false shape estimations can be ignored for higher robustness and accuracy in the operation of the DSM application without sacrificing the frame processing rate that can reach 65 frames per second. The sensitivity and precision in yawning recognition can reach 93% and 97%, respectively. The implementation of the employed DSM algorithm in reconfigurable hardware is challenging since the kernel arguments require large data transfers and the degree of data reuse in the computational kernel is low. Hence, unconventional hardware acceleration techniques have been employed that can also be useful for the acceleration of several other machine learning applications that require large data transfers to their kernels with low reusability.
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference37 articles.
1. Real-time face alignment: Evaluation methods, training strategies and implementation optimization;J. Real-Time Image Process.,2021 2. Chang, C.Y., Cheng, M.J., and Ma, M.M.H. (2018, January 18–19). Application of Machine Learning for Facial Stroke Detection. Proceedings of the IEEE 23rd International Conference on Digital Signal Processing (DSP), Shanghai, China. 3. Pascual, A.M., Valverde, E.C., Kim, J.-I., Jeong, J.-W., Jung, Y., Kim, S.-H., and Lim, W. (2022). Light-FER: A Lightweight Facial Emotion Recognition System on Edge Devices. Sensors, 22. 4. Kosuge, A., Yamamoto, K., Akamine, Y., Yamawaki, T., and Oshima, T. (May, January 28). A 4.8x Faster FPGA-Based Iterative Closest Point Accelerator for Object Pose Estimation of Picking Robot Applications. Proceedings of the IEEE 27th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), San Diego, CA, USA. 5. CNN-Grinder: From Algorithmic to High-Level Synthesis descriptions of CNNs for Low-end-low-cost FPGA SoCs;Mousouliotis;Microprocess. Microsyst.,2020
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献
1. A MEMS-based real-time structured light 3-D measuring architecture on FPGA;Journal of Real-Time Image Processing;2024-05-21 2. From Embedded to AI-powered Cyberphysical Systems and Beyond;2023 30th International Conference on Mixed Design of Integrated Circuits and System (MIXDES);2023-06-29
|
|