Bimodal Feature Analysis with Deep Learning for Autism Spectrum Disorder Detection

Abstract

Autism Spectrum Disorder (ASD) is a complex and heterogeneous neurodevelopmental disorder which affects a significant proportion of the population, with estimates suggesting that about 1 in 100 children worldwide are affected by ASD. This study introduces a new Deep Neural Network for identifying ASD in children through gait analysis, using features extracted from frames composing video recordings of their walking patterns. The innovative method presented herein is based on imagery and combines gait analysis and deep learning, offering a noninvasive and objective assessment of neurodevelopmental disorders while delivering high accuracy in ASD detection. Our model proposes a bimodal approach based on the concatenation of two distinct Convolutional Neural Networks processing two feature sets extracted from the same videos. The features obtained from the convolutions of both networks are subsequently flattened and merged into a single vector, serving as input for the fully connected layers in the binary classification process. This approach demonstrates the potential for effective ASD detection in children through the combination of gait analysis and deep learning techniques.