Discrimination between the facial gestures of vocalising and non-vocalising lemurs and small apes using deep learning
Facial expression studies in animal communication are essential. However, manual inspection methods are only practical for small datasets. Deep learning techniques can help discriminate facial configurations associated with vocalisations over large datasets. We extracted and labelled frames of diffe...
Saved in:
| Main Authors: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-03-01
|
| Series: | Ecological Informatics |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1574954124003893 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832595397534547968 |
|---|---|
| author | Filippo Carugati Olivier Friard Elisa Protopapa Camilla Mancassola Emanuela Rabajoli Chiara De Gregorio Daria Valente Valeria Ferrario Walter Cristiano Teresa Raimondi Valeria Torti Brice Lefaux Longondraza Miaretsoa Cristina Giacoma Marco Gamba |
| author_facet | Filippo Carugati Olivier Friard Elisa Protopapa Camilla Mancassola Emanuela Rabajoli Chiara De Gregorio Daria Valente Valeria Ferrario Walter Cristiano Teresa Raimondi Valeria Torti Brice Lefaux Longondraza Miaretsoa Cristina Giacoma Marco Gamba |
| author_sort | Filippo Carugati |
| collection | DOAJ |
| description | Facial expression studies in animal communication are essential. However, manual inspection methods are only practical for small datasets. Deep learning techniques can help discriminate facial configurations associated with vocalisations over large datasets. We extracted and labelled frames of different primate species, trained deep-learning models to identify key points on their faces, and computed distances between them to identify facial gestures. We used machine learning algorithms to classify vocalised and non-vocalised gestures across different species. The algorithms showed higher-than-chance correct classification rates, with some exceeding 90 %. Our work employs deep learning to map primate facial gestures and offers an innovative application of pose estimation systems. Our approach facilitates the investigation of facial repertoire across primate species and behavioural contexts, enabling comparative research in primate communication. |
| format | Article |
| id | doaj-art-5888fa20a37b493ab425ad7957935dd3 |
| institution | Kabale University |
| issn | 1574-9541 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Ecological Informatics |
| spelling | doaj-art-5888fa20a37b493ab425ad7957935dd32025-01-19T06:24:32ZengElsevierEcological Informatics1574-95412025-03-0185102847Discrimination between the facial gestures of vocalising and non-vocalising lemurs and small apes using deep learningFilippo Carugati0Olivier Friard1Elisa Protopapa2Camilla Mancassola3Emanuela Rabajoli4Chiara De Gregorio5Daria Valente6Valeria Ferrario7Walter Cristiano8Teresa Raimondi9Valeria Torti10Brice Lefaux11Longondraza Miaretsoa12Cristina Giacoma13Marco Gamba14Department of Life Sciences and Systems Biology, Università di Torino, Torino, Italy; Corresponding authors at: Department of Life Sciences and Systems Biology, Università di Torino, Torino, Italy.Department of Life Sciences and Systems Biology, Università di Torino, Torino, ItalyDepartment of Life Sciences and Systems Biology, Università di Torino, Torino, ItalyDepartment of Life Sciences and Systems Biology, Università di Torino, Torino, ItalyDepartment of Life Sciences and Systems Biology, Università di Torino, Torino, ItalyDepartment of Life Sciences and Systems Biology, Università di Torino, Torino, ItalyDepartment of Life Sciences and Systems Biology, Università di Torino, Torino, Italy; Parco Natura Viva, Garda Zoological Park, 37012 Bussolengo, ItalyDepartment of Life Sciences and Systems Biology, Università di Torino, Torino, Italy; Chester Zoo, Caughall Road, Chester, UKDepartment of Life Sciences and Systems Biology, Università di Torino, Torino, ItalyDepartment of Life Sciences and Systems Biology, Università di Torino, Torino, ItalyDepartment of Life Sciences and Systems Biology, Università di Torino, Torino, ItalyZoo de Mulhouse, Mulhouse, FranceGroupe d'Etude et de la Recherche sur les Primates de Madagascar (GERP), Madagascar; Institut Supérieur de Technologie Régionale (ISTR), Manakara, MadagascarDepartment of Life Sciences and Systems Biology, Università di Torino, Torino, ItalyDepartment of Life Sciences and Systems Biology, Università di Torino, Torino, Italy; Corresponding authors at: Department of Life Sciences and Systems Biology, Università di Torino, Torino, Italy.Facial expression studies in animal communication are essential. However, manual inspection methods are only practical for small datasets. Deep learning techniques can help discriminate facial configurations associated with vocalisations over large datasets. We extracted and labelled frames of different primate species, trained deep-learning models to identify key points on their faces, and computed distances between them to identify facial gestures. We used machine learning algorithms to classify vocalised and non-vocalised gestures across different species. The algorithms showed higher-than-chance correct classification rates, with some exceeding 90 %. Our work employs deep learning to map primate facial gestures and offers an innovative application of pose estimation systems. Our approach facilitates the investigation of facial repertoire across primate species and behavioural contexts, enabling comparative research in primate communication.http://www.sciencedirect.com/science/article/pii/S1574954124003893Primate faceIndri indriPropithecus diademaNomascus gabriellaeDeepLabCutAcoustic communication |
| spellingShingle | Filippo Carugati Olivier Friard Elisa Protopapa Camilla Mancassola Emanuela Rabajoli Chiara De Gregorio Daria Valente Valeria Ferrario Walter Cristiano Teresa Raimondi Valeria Torti Brice Lefaux Longondraza Miaretsoa Cristina Giacoma Marco Gamba Discrimination between the facial gestures of vocalising and non-vocalising lemurs and small apes using deep learning Ecological Informatics Primate face Indri indri Propithecus diadema Nomascus gabriellae DeepLabCut Acoustic communication |
| title | Discrimination between the facial gestures of vocalising and non-vocalising lemurs and small apes using deep learning |
| title_full | Discrimination between the facial gestures of vocalising and non-vocalising lemurs and small apes using deep learning |
| title_fullStr | Discrimination between the facial gestures of vocalising and non-vocalising lemurs and small apes using deep learning |
| title_full_unstemmed | Discrimination between the facial gestures of vocalising and non-vocalising lemurs and small apes using deep learning |
| title_short | Discrimination between the facial gestures of vocalising and non-vocalising lemurs and small apes using deep learning |
| title_sort | discrimination between the facial gestures of vocalising and non vocalising lemurs and small apes using deep learning |
| topic | Primate face Indri indri Propithecus diadema Nomascus gabriellae DeepLabCut Acoustic communication |
| url | http://www.sciencedirect.com/science/article/pii/S1574954124003893 |
| work_keys_str_mv | AT filippocarugati discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT olivierfriard discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT elisaprotopapa discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT camillamancassola discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT emanuelarabajoli discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT chiaradegregorio discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT dariavalente discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT valeriaferrario discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT waltercristiano discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT teresaraimondi discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT valeriatorti discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT bricelefaux discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT longondrazamiaretsoa discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT cristinagiacoma discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning AT marcogamba discriminationbetweenthefacialgesturesofvocalisingandnonvocalisinglemursandsmallapesusingdeeplearning |