Identification of Autism Disorder Spectrum Based on Facial Expressions

Mahsa Naeeni Davarani, Touraj Bnirostam, Hayedeh Saberi


The study of emotions has always been a matter for philosophers and psychologists. The purpose of this research is to identify and categorize children with autism disorder using diagnosis of the faces emotion in eight states (neutral, anger, ridicule, hate, fear, happiness, sadness and wonder). The method of this research is descriptive-analytic. To collect samples from 80 children with autism disorder, we take images in each of the 8 cases. MATLAB software has been used to analyse photos accurately. The results show that children who are in first group according to DSM-5, they have at least six mode of the listed eight modes. Children who are in the second category of DSM-5, they experience between three to five feelings. It is also observed that children who are in the third category according to DSM-5, can experience only one to two feelings.


Autism; Facial Expressions; Emotions; MATLAB.


Hashemi, Jordan, Mariano Tepper, Thiago Vallin Spina, Amy Esler, Vassilios Morellas, Nikolaos Papanikolopoulos, Helen Egger, Geraldine Dawson, and Guillermo Sapiro. "Computer vision tools for low-cost and noninvasive measurement of autism-related behaviors in infants." Autism research and treatment 2014 (2014).

Smitha, Kavallur Gopi, and A. Prasad Vinod. "Facial emotion recognition system for autistic children: a feasible study based on FPGA implementation." Medical & biological engineering & computing 53, no. 11 (2015): 1221-1229.

Garman, Heather D., Christine J. Spaulding, Sara Jane Webb, Amori Yee Mikami, James P. Morris, and Matthew D. Lerner. "Wanting it Too Much: An Inverse Relation Between Social Motivation and Facial Emotion Recognition in Autism Spectrum Disorder." Child Psychiatry & Human Development 47, no. 6 (2016): 890-902.

McPartland, James C., Sara Jane Webb, Brandon Keehn, and Geraldine Dawson. "Patterns of visual attention to faces and objects in autism spectrum disorder." Journal of autism and developmental disorders 41, no. 2 (2011): 148-157.

Harms, Madeline B., Alex Martin, and Gregory L. Wallace. "Facial emotion recognition in autism spectrum disorders: a review of behavioral and neuroimaging studies." Neuropsychology review 20, no. 3 (2010): 290-322.

Wong, Nina, Deborah C. Beidel, Dustin E. Sarver, and Valerie Sims. "Facial emotion recognition in children with high functioning autism and children with social phobia." Child Psychiatry & Human Development 43, no. 5 (2012): 775-794.

Macdonald, Hope, Michael Rutter, Patricia Howlin, Patricia Rios, Ann Le Conteur, Christopher Evered, and Susan Folstein. "Recognition and expression of emotional cues by autistic and normal adults." Journal of Child Psychology and Psychiatry 30, no. 6 (1989): 865-877.

Humphreys, Kate, Nancy Minshew, Grace Lee Leonard, and Marlene Behrmann. "A fine-grained analysis of facial expression processing in high-functioning adults with autism." Neuropsychologia 45, no. 4 (2007): 685-695.

Rump, Keiran M., Joyce L. Giovannelli, Nancy J. Minshew, and Mark S. Strauss. "The development of emotion recognition in individuals with autism." Child development 80, no. 5 (2009): 1434-1447.

Smith, Miriam J. Law, Barbara Montagne, David I. Perrett, Michael Gill, and Louise Gallagher. "Detecting subtle facial emotion recognition deficits in high-functioning autism using dynamic stimuli of varying intensities." Neuropsychologia 48, no. 9 (2010): 2777-2781.

Sucksmith, E., C. Allison, S. Baron-Cohen, B. Chakrabarti, and R. A. Hoekstra. "Empathy and emotion recognition in people with autism, first-degree relatives, and controls." Neuropsychologia 51, no. 1 (2013): 98-105.

Chandler, Susie, Patricia Howlin, Emily Simonoff, Tony O'sullivan, Evelin Tseng, Juliet Kennedy, Tony Charman, and Gillian Baird. "Emotional and behavioural problems in young children with autism spectrum disorder." Developmental Medicine & Child Neurology 58, no. 2 (2016): 202-208.

Chen, Chien-Hsu, I-Jui Lee, and Ling-Yi Lin. "Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions." Computers in Human Behavior 55 (2016): 477-485.

L. Berkovits, A. Eisenhower, J. Blacher, , "Emotion Regulation in Young Children with Autism Spectrum Disorder,"Journal of Autism and Developmental Disorders, Volume 47, Issue 1, (2017): 68–79.

Deodhare, Dipti. "Facial Expressions to Emotions: A Study of Computational Paradigms for Facial Emotion Recognition." In Understanding Facial Expressions in Communication, pp. 173-198. Springer India, 2015.

Palestra, Giuseppe, Adriana Pettinicchio, Marco Del Coco, Pierluigi Carcagnì, Marco Leo, and Cosimo Distante. "Improved performance in facial expression recognition using 32 geometric features." In International Conference on Image Analysis and Processing, pp. 518-528. Springer, Cham, 2015.

Ayesh, Aladdin, and William Blewitt. "Models for computational emotions from psychological theories using type I fuzzy logic." Cognitive Computation 7, no. 3 (2015): 285-308.

Ngo, Thi Duyen, Thi Hong Nhan Vu, and Viet Ha Nguyen. "Improving simulation of continuous emotional facial expressions by analyzing videos of human facial activities." In International Conference on Principles and Practice of Multi-Agent Systems, pp. 222-237. Springer, Cham, 2014.

Bakshi, Urvashi, and Rohit Singhal. "A survey on face detection methods and feature extraction techniques of face recognition." International Journal of Emerging Trends & Technology in Computer Science (IJETTCS) 3, no. 3 (2014): 233-237.

Full Text: PDF

DOI: 10.28991/esj-2017-01121


  • There are currently no refbacks.

Copyright (c) 2017 Mahsa Naeeni Davarani, Touraj Bnirostam, Hayedeh Saberi