2. Home
  3. ARCHIVE
  4. 2023
  5. VOL 45, NO 5 (2023)
  6. pp. 89-102

RECOGNITION OF USER EMOTIONS USING ARTIFICIAL INTELLIGENCE

V.O. Bolilyi, L.P. Sukhovirska, Yu.M. Hordiienko

Èlektron. model. 2023, 45(5):89-102

https://doi.org/10.15407/emodel.45.05.089

ABSTRACT

The article explains the face recognition process. The stages of recognition of emotions on the face and groups according to the field of application of FER are described. The main types of emotional artificial intelligence are distinguished. Seven recognized universal emotions are considered. A custom facial recognition script has been developed. Realized the functions of reading and detecting emotions live through a webcam using DeepFace.The research examines the development of the program "Recognition of user emotions using artificial intelligence." The following tasks were implemented in the work: writing the function of detecting a person in a photo or video and teaching the program to distinguish different facial emotions: happiness, sadness, anger, etc., using the DeepFace and OpenCV face recognition package. The developed computer program can be used in various aspects of everyday life: provision of personalized services, health care, employment, education, public safety. The program was tested by students of higher education major 122 "Computer science" of the Central Ukrainian State University named after V. Vinnichenko.

KEYWORDS

artificial intelligence, programming, emotions, DeepFace, OpenCV.

REFERENCES

  1. Abdat F., et al. Human-Computer Interaction Using Emotion Recognition from Facial Expression. In: 2011 UKSim 5th European Symposium on Computer Modeling and Simulation. 2011. 
    https://doi.org/10.1109/EMS.2011.20
  2. Cowie, R. et al. Emotion recognition in humancomputer interaction. In: IEEE Signal Processing Magazine. 2021. https://ieeexplore.ieee.org/document/911197
  3. Konstantina Vemou, Anna Horvath. Facial Emotion Recognition. https://edps.europa.eu/system/files/2021-05/21-05-26_techdispatch-facial-emotion-recognition_ref_en.pdf
  4. Facial recognition: top 7 trends (tech, vendors, use cases). https://www.frontiersin.org/articles/ 10.3389/fpsyg.2021.759485/full
  5. Song Z. Facial Expression Emotion Recognition Model Integrating Philosophy and Machine Learning Theory. Front. Psychol. https://www.thalesgroup.com/en/markets/digital-identity-and-security/government/biometrics/facial-recognition
  6. Priya Dwivedi Face. Detection, Recognition and Emotion Detection in 8 lines of code! https://towardsdatascience.com/face-detection-recognition-and-emotion-detection-in-8-lines-of-code-b2ce32d4d5de
  7. Corinne Bernstein. Face Detection. https://www.techtarget.com/searchenterpriseai/definition/face-detection
  8. Face Detection vs. Facial Recognition — What’s the Difference? https://www.two-i.com/blog/face-detection-vs-facial-recognition-whats-the-difference
  9. Elhadi Shakshuki, Ansar Yasar, Haroon Malik. Facial emotion recognition using deep learning: review and insights. https://www.sciencedirect.com/science/article/pii/S1877050920318019
  10. Santosh Kumar Bharti, S. Varadhaganapathy, Rajeev Kumar Gupta, Prashant Kumar Shukla, Mohamed Bouye, Simon Karanja Hingaa, corresponding author and Amena Mahmoud. Text-Based Emotion Recognition Using Deep Learning Approach. https://www.ncbi.nlm.gov/pmc/articles/PMC9427219/
  11. Real Time Facial Expressions/Emotions Recognition on a Web Interface using Python. https://mayankbimbra.medium.com/real-time-facial-expressions-emotions-recognition-on-a-web-interface-using-python-b42f58a25780
  12. Rahulraj Singh. The Ultimate Guide to Emotion Recognition from Facial Expressions using Python. https://towardsdatascience.com/the-ultimate-guide-to-emotion-recognition-from-facial-expressions-using-python-64e58d4324ff
  13. Emotion Analysis Recognition Software. https://www.raydiant.com/blog/emotion-analysis-recognition
  14. Reconnaissance des émotions. https://meritis.fr/reconnaissance-des-emotions/
  15. Emotion Recognition: Introduction to Emotion Reading Technology. https://recfaces.com/articles/emotion-recognition
  16. Facial expression detection using Deepface module in Python. https://www.geeksforgeeks.org/facial-expression-detection-using-deepface-module-in-python/
  17. La Reconnaissance Faciale avec Python. https://webpick.info/la-reconnaissance-faciale-avec-python/
  18. Karan Sethi. Emotion Detection Using OpenCV and Keras. https://medium.com/swlh/emotion-detection-using-opencv-and-keras-771260bbd7f7
  19. Real-time Emotion Detection System with PyTorch and OpenCV. https://neuraspike.com/blog/realtime-emotion-detection-system-pytorch-opencv/
  20. Jonathan Hicks. Emotion Detection Using OpenCV for Automatic Facial Recognition. https://portfolios.cs.earlham.edu/wp-content/uploads/2017/01/Jonathan-Hicks_4166436_assignsubmission_file_emotion-detection-opencv-3.pdf
  21. OpenCV modules. Documentation. https://docs.opencv.org/4.x/
  22. Тensorflow. Documentation. https://www.tensorflow.org/api_docs
  23. Keras API reference. Documentation. https://keras.io/api/
  24. Pandas documentation. Documentation. https://pandas.pydata.org/docs/
  25. Selenium with Python. Documentation. https://selenium-python.readthedocs.io/
  26. Documentation. https://pypi.org/project/deepface/
  27. RetinaFace: Deep Face Detection Library for Python. Documentation. https://github.com/ serengil/retinaface/
  28. Visual Studio Code. Documentation. https://code.visualstudio.com/docs
  29.  NumPy. Documentation. https://numpy.org/doc/stable/

Full text: PDF