HNSE-O1-2. How Facial Features and Head Gesture Convey Attention in Stationary Environments
Janelle Domantay1
Faculty Mentor: Brendan Morris, Ph.D.2
1Howard R. Hughes College of Engineering, Department of Computer Science
2Howard R. Hughes College of Engineering, Department of Electrical and Computer Engineering
ABSTRACT
Awareness detection technologies have been gaining traction in a variety of enterprises; Most often used for driver fatigue detection, recent research has shifted towards using computer vision technologies to analyze user attention in stationary environments such as online classrooms. This study aims to extend previous research on distraction detection by analyzing which visual features contribute most to predicting awareness and fatigue. We utilized the open source facial analysis toolkit OpenFace in order to analyze visual data of subjects at varying levels of attentiveness. Then, using a Support Vector Machine (SVM) we created several prediction models for user attention and identified Histogram of Oriented Gradients (HOGS) to be the greatest predictor of the features we tested. We also compared the performance of this SVM to deep learning approaches that utilize Convolutional and/or Recurrent neural networks (CNN’s and CRNN’s). Interestingly, CRNN’s did not appear to perform significantly better than their CNN counterparts. While deep learning methods definitively performed better, SVMs utilized less resources and, using certain parameters, were able to approach the performance of deep learning methods.
Date
- Nov 15 - 19 2021
- Expired!
Time
- All Day
Organizer
-
The Office of Undergraduate Research
-
Phone
702-895-4771 -
Email
our@unlv.edu -
Website
http://unlv.edu/our
Speakers
-
Dr. Brendan Morris | Howard R. Hughes College of Engineering
-
Janelle Domantay | Howard R. Hughes College of Engineering
You did a very good job of making this understandable for many different audiences. Thank you.
Hello Everyone!
Thank you for your attendance at the Fall 2021 Virtual Undergraduate Research Symposium! I invite you to view my uploaded presentation on facial analysis. If you have any questions or feedback you’d like to provide please feel free to do so by replying to this comment. I will address your response as soon as I can!