IRIS - Microcontroller & Backend Development

Description

Microcontroller team project developed within the Sony Spresense Hackathon. Our project, IRIS, won for Best Technical Implementation and Best Overall Project.

IRIS is an assistance device designed for individuals with visual impairments. We integrated a camera module and microphones into the Sony Spresense board and used a combination of on-device and cloud-based machine learning models to enable iris to receive and understand visual and auditory inputs.

After being woken with the phrase "ok, iris," iris can describe the user's surroundings and answer questions within the context of their environment, assisting them in understanding and engaging with the world around them.

Technology