An eye-wearable device that made headlines in 2015 but failed in the consumer technology space has now rekindled the hopes of millions of people with autism spectrum disorder globally, including in India. Although no official numbers are available, at least 70 million people have autism worldwide, including over 10 million in India.
According to Dr Ned Sahin, Founder and CEO of Brain Power, a US-based science-driven company, Augmented Reality (AR)-powered wearable computers can help those with ASD gain confidence, clarity, understanding, social integration and self-sufficiency.There is no cure for autism but early diagnosis and intervention with therapies does improve the long-term outcome.
“We need help. We need families and schools to support the first wave of technology for autism and special school communities.I am open to collaboration if there is an interest from schools, organisations and families from India. We can customize our Google Glass-based applications for autistic people in India,”.Brain Power is currently working with several schools in the US. The “Empower Me” wearable system has been used by hundreds of children and adults on the autism spectrum.
In this technology, the child or adult wears light, computerized Glasses and sees and hears special feedback geared to the situation like digital coaching on facial expressions of emotions, when to look at people, feedback on the user’s own state of stress or anxiety.”The apps also encourage them to make eye contact and control repetitive behaviors — both of which are big challenges related to autism,” said Dr Sahin, a famed neuroscientist who studied at Harvard and MIT.
According to Dr Sahin, contrary to what most of the people think, kids actually treat wearable devices as fun and are facing no problem using them.”We have discovered scientifically that people with autism enjoy using wearable devices and embedded software for socio-emotional learning,”.Each software module connects to Brain Power’s Cloud-hosted portal where Artificial Intelligence (AI) algorithms produce insights and predictions in real time.
The game-like apps collect numerical behavioral data — scientifically and rigorously — and present the child, family, school or clinic with insights and answers they can readily understand.
“We now have a package for schools consisting multiple AR devices. The devices and the software add more functionalities than we had before. It generates very good data about how kids are learning, their progress and whether young adults have the right skill-sets to get a job,” Dr Sahin explained.
Another new product is called “Learning Eye”.In this technology, a camera is placed in the classroom which is connected to a computer that runs Machine Learning (ML) algorithms.
“AWS gave us access to its new product called Deeplens months before releasing it to the public. ‘Learning Eye’ uses Deeplens’ capabilities to run ML in the classroom in order to assist teachers as well as kids,” noted Dr Sahin.
The technology can detect if a student is paying attention or not. It can also detect if a student is writing a message on his smartphone in the classroom, giving a warning to the student while alerting the teacher.
“The teacher can also assess when the student is bored and initiate an immediate feedback to improve the student’s mood. She can get entire data about what is happening in the classroom,” Dr Sahin informed.
AWS Deeplens helps the Brain Power team run deep learning models locally on the camera to analyse and takes action on what it sees.Deep Lens is easy to customize and is programmable using AWS Lambda — a server less compute service that makes it easy to build applications that respond quickly to new information.”We are very serious about maintaining privacy. Video footage stays in the classroom and is never sent to Cloud. Video processing is done at the edge of the Cloud to maintain complete privacy,”.The company has also developed a method known as “Fidgetology” which rapidly quantifies body language to assess mental health or to estimate enjoyment.”Fidgetology” was developed in collaboration with AWS, using the company’s Cloud-based AI, ML and computer visions tools.