Emotion recognition software for Google Glass to help autistic adolescents

10 November 2015

In a joint experiment, the University of Amsterdam and Leiden University built a Google Glass app to assist adolescents with an Autistic Spectrum Disorder in the processing of social information. Professor Theo Gevers from the Informatics Institute developed the emotion recognition software for the project, in cooperation with UvA spin-off Sightcorp.

The idea behind the project ‘Google Glass for Gemma’ was that someone with autism (‘Gemma’), can use Google Glass to practice appropriate emotional expressions in response to others. During the three-month experiment, several parties from both universities were brought together to develop the application.

Appropriate emotions

Gevers and Sightcorp developed emotion recognition software for the project. The software can read someone’s expression from multiple facial markers, analyse the data en give feedback to the user about whether the emotion is appropriate for the given situation. Aim of this part of the project was to show proof of concept, in which they succeeded. In a next phase, the application will be tested with autistic adolescents who might benefit from this technology. 

Published by  Faculty of Science