Optimizing machine learning capabilities to support young adults with intellectual and developmental disabilities’ (IDD) engagement in health-related behaviors

Spring 2018 RESEARCH INCUBATION AWARDEE

PI: Jessica Kramer, Adjunct Associate Professor, Dept of Occupational Therapy

Co-PI: Dora Erdos, Lecturer & Undergraduate Program Director, Computer Science, CAS

The challenge

The major challenge is witnessed in the provision of support to young people with IDD in order to increase their capacities in the performance of various tasks related to professionalism and vocational through digitalized resources. User disability to contextualize digital material is inherent, however matching support requires outside assistance.

Solution

The solution will be tailored in the integration of augmented reality in teaching young adults with IDD vocational skills and professionalism. AR is an interface significant in synchronization of perception and reality to the user. Therefore in such a case basic operational skills are simplified and navigational skills made independent.

The Process

AR devices are mounted on the user which will aid them to perform tasks. Users ask for the next step and the image of the user interpreted on the server and feedback is sent back with the required response. This creates a mode of interaction in audio and perception of the images sent by the AR interface.