Development of Drowsiness Detection System for Drivers using Haar Cascade Classifier and Convolutional Neural Network

Syamsul Mujahidin, Achmad Ripaldi, Bowo Nugroho, Ramadhan Paninggalih

Abstract


The use of the Convolutional Neural Network (CNN) method to recognize an object in an image that is not too complex from the background and fore-ground shows very good results. However, in the case of images with various and very complex objects, the CNN method produces a large number of fea-ture maps, sometimes even unnecessary regions of interest (ROI) are includ-ed as material for model training which results in a lot of noise. This results in high computational costs and inconsistencies in the prediction results. Therefore, a pre-processing stage is needed, such as determining the area of interest (ROI) on the object of interest and the optimal architecture of CNN. This study applies the Haar Cascade Classifier method to determine the ROI of the object of interest in the image and CNN with the modified vgg-16 model architecture to detect drowsiness in drivers based on facial images. Test results based on the method used show optimal performance on exper-iments at various epochs with the highest accuracy was achieved 96.72%.

Full Text:

PDF

References


A. Amodio, M. Ermidoro, D. Maggi, S. Formentin, and S. M. Savaresi, “Automatic detection of driver impairment based on pupillary light reflex,” IEEE transactions on intelligent transportation systems, vol. 20, no. 8, pp. 3038–3048, 2018.

I. Imanuddin, F. Alhadi, R. Oktafian, and A. Ihsan, “Deteksi mata mengantuk pada pengemudi mobil menggunakan metode viola jones,” MATRIK: Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer,

vol. 18, no. 2, pp. 321–329, 2019.

R. Tamanani, R. Muresan, and A. Al-Dweik, “Estimation of driver vigilance status using real-time facial expression and deep learning,” IEEE Sensors Letters, vol. 5, no. 5, pp. 1–4, 2021.

S. Ansari, F. Naghdy, H. Du, and Y. N. Pahnwar, “Driver mental fatigue detection based on head posture using new modified relu-bilstm deep neural network,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 8, pp. 10 957–10 969, 2021.

V. P. Sharma, J. S. Yadav, and V. Sharma, “Deep convolutional network based real time fatigue detection and drowsiness alertness system,” Int. J. Electr. Comput. Eng, vol. 12, no. 5, pp. 5493–5500, 2022.

S. Bakheet and A. Al-Hamadi, “A framework for instantaneous driver drowsiness detection based on improved hog features and na¨ıve Bayesian classification,” Brain Sciences, vol. 11, no. 2, p. 240, 2021.

V. P. Sharma, J. S. Yadav, and V. Sharma, “Deep convolutional network based real time fatigue detection and drowsiness alertness system,” Int. J. Electr. Comput. Eng, vol. 12, no. 5, pp. 5493–5500, 2022.

F. Liu, D. Chen, J. Zhou, and F. Xu, “A review of driver fatigue detection and its advances on the use of rgb-d camera and deep learning,” Engineering Applications of Artificial Intelligence, vol. 116, p. 105399, 2022.

A.-C. Phan, T.-N. Trieu, and T.-C. Phan, “Driver drowsiness detection and smart alerting using deep learning and iot,” Internet of Things, vol. 22, p. 100705, 2023.




DOI: http://dx.doi.org/10.12962/j24775401.v10i2.21955

Refbacks

  • There are currently no refbacks.



View My Stats


Creative Commons License
International Journal of Computing Science and Applied Mathematics by Pusat Publikasi Ilmiah LPPM, Institut Teknologi Sepuluh Nopember is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Based on a work at https://iptek.its.ac.id/index.php/ijcsam.