Sentiment Analysis from Face Expressions Based on Image Processing Using Deep Learning Methods
In this study, the classification study of human facial expressions in real-time images is discussed. Implementing this work in software have some benefits for us. For example, analysis of mood in group photos is an interesting instance in this regard. The perception of people’s facial expressions i...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Çanakkale Onsekiz Mart University
2022-12-01
|
| Series: | Journal of Advanced Research in Natural and Applied Sciences |
| Subjects: | |
| Online Access: | https://dergipark.org.tr/en/download/article-file/2187593 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832095499922964480 |
|---|---|
| author | Orhan Emre Aksoy Selda Güney |
| author_facet | Orhan Emre Aksoy Selda Güney |
| author_sort | Orhan Emre Aksoy |
| collection | DOAJ |
| description | In this study, the classification study of human facial expressions in real-time images is discussed. Implementing this work in software have some benefits for us. For example, analysis of mood in group photos is an interesting instance in this regard. The perception of people’s facial expressions in photographs taken during an event can provide quantitative data on how much fun these people have in general. Another example is context-aware image access, where only photos of people who are surprised can be accessed from a database. Seven different emotions related to facial expressions were classified in this context; these are listed as happiness, sadness, surprise, disgust, anger, fear and neutral. With the application written in Python programming language, classical machine learning methods such as k-Nearest Neighborhood and Support Vector Machines and deep learning methods such as AlexNet, ResNet, DenseNet, Inception architectures were applied to FER2013, JAFFE and CK+ datasets. In this study, while comparing classical machine learning methods and deep learning architectures, real-time and non-real-time applications were also compared with two different applications. This study conducted to demonstrate that real-time expression recognition systems based on deep learning techniques with the most appropriate architecture can be implemented with high accuracy via computer hardware with only one software. In addition, it is shown that high accuracy rate is achieved in real-time applications when Histograms of Oriented Gradients (HOG) is used as a feature extraction method and ResNet architecture is used for classification. |
| format | Article |
| id | doaj-art-abb95cfd7ebf4050a3aa2ca1a6864c19 |
| institution | Kabale University |
| issn | 2757-5195 |
| language | English |
| publishDate | 2022-12-01 |
| publisher | Çanakkale Onsekiz Mart University |
| record_format | Article |
| series | Journal of Advanced Research in Natural and Applied Sciences |
| spelling | doaj-art-abb95cfd7ebf4050a3aa2ca1a6864c192025-02-05T17:57:35ZengÇanakkale Onsekiz Mart UniversityJournal of Advanced Research in Natural and Applied Sciences2757-51952022-12-018473675210.28979/jarnas.1056664453Sentiment Analysis from Face Expressions Based on Image Processing Using Deep Learning MethodsOrhan Emre Aksoy0https://orcid.org/0000-0003-3603-8417Selda Güney1https://orcid.org/0000-0002-0573-1326BAŞKENT ÜNİVERSİTESİBAŞKENT ÜNİVERSİTESİIn this study, the classification study of human facial expressions in real-time images is discussed. Implementing this work in software have some benefits for us. For example, analysis of mood in group photos is an interesting instance in this regard. The perception of people’s facial expressions in photographs taken during an event can provide quantitative data on how much fun these people have in general. Another example is context-aware image access, where only photos of people who are surprised can be accessed from a database. Seven different emotions related to facial expressions were classified in this context; these are listed as happiness, sadness, surprise, disgust, anger, fear and neutral. With the application written in Python programming language, classical machine learning methods such as k-Nearest Neighborhood and Support Vector Machines and deep learning methods such as AlexNet, ResNet, DenseNet, Inception architectures were applied to FER2013, JAFFE and CK+ datasets. In this study, while comparing classical machine learning methods and deep learning architectures, real-time and non-real-time applications were also compared with two different applications. This study conducted to demonstrate that real-time expression recognition systems based on deep learning techniques with the most appropriate architecture can be implemented with high accuracy via computer hardware with only one software. In addition, it is shown that high accuracy rate is achieved in real-time applications when Histograms of Oriented Gradients (HOG) is used as a feature extraction method and ResNet architecture is used for classification.https://dergipark.org.tr/en/download/article-file/2187593image processingclassificationemotion analysisconvoultional neural networkdeep learning |
| spellingShingle | Orhan Emre Aksoy Selda Güney Sentiment Analysis from Face Expressions Based on Image Processing Using Deep Learning Methods Journal of Advanced Research in Natural and Applied Sciences image processing classification emotion analysis convoultional neural network deep learning |
| title | Sentiment Analysis from Face Expressions Based on Image Processing Using Deep Learning Methods |
| title_full | Sentiment Analysis from Face Expressions Based on Image Processing Using Deep Learning Methods |
| title_fullStr | Sentiment Analysis from Face Expressions Based on Image Processing Using Deep Learning Methods |
| title_full_unstemmed | Sentiment Analysis from Face Expressions Based on Image Processing Using Deep Learning Methods |
| title_short | Sentiment Analysis from Face Expressions Based on Image Processing Using Deep Learning Methods |
| title_sort | sentiment analysis from face expressions based on image processing using deep learning methods |
| topic | image processing classification emotion analysis convoultional neural network deep learning |
| url | https://dergipark.org.tr/en/download/article-file/2187593 |
| work_keys_str_mv | AT orhanemreaksoy sentimentanalysisfromfaceexpressionsbasedonimageprocessingusingdeeplearningmethods AT seldaguney sentimentanalysisfromfaceexpressionsbasedonimageprocessingusingdeeplearningmethods |