{{sect1}}
My hackathon team and I prototyped an AR glasses-based public speaking anxiety intervention that could be accessed and applied in the moments of greatest need.
{{sect2}}
Traditional therapy treats patients during appointments and may have homework or exercises for patients to try in their daily lives, yet there still remains a significant gap of transferring new skills or perspectives learned through therapy to real-world situations that trigger symptoms.
Potential Audience: Young adults starting first job in their professional career want to feel confident to speak up and share their ideas to engage better with teammates and in a workplace.
{{sect3}}
Inspired by the framework of Just In Time Adaptive Interventions (JITAI), we wanted to explore how perception-first digital mediatory tools such as mixed reality can offer new ways to seamlessly access powerful tools and techniques on the fly.
We built our experience in Unity with the help of Magic Leap's documentation and their Unity SDKs and plugins. Some of us focused more on the storyboarding and UI/UX sketches, and others focused on Unity implementation, including setting up Magic Leap hand-tracking, hand pose gestures, eye-tracking, world reconstruction, fluid UI menus, spatial audio, and mixed reality anxiety-reducing experiences.
{{sect4}}
We prototyped a proof of concept of the menu system (featuring hand-tracking and speech-to-text inputs) and one of the interventions (the 4, 7, 8 breathing technique, which consists of a guided breathing meditation synced with expanding and contracting particle system visuals).
We started prototyping the other two interventions:
The solution will also be integrated with the EDA sensor device called Bitalino, that measures your stress level through sweat detection. If your stress threshold is reached, the application will start by itself. If the stress threshold decreases, the application will shut down automatically.
{{sect5}}
Prototype Demo:
Recorded presentation:
{{sect6}}
UI Storyboards:
{{sect7}}
{{sect8}}
{{sect1}}
My hackathon team and I prototyped an AR glasses-based public speaking anxiety intervention that could be accessed and applied in the moments of greatest need.
{{sect2}}
Traditional therapy treats patients during appointments and may have homework or exercises for patients to try in their daily lives, yet there still remains a significant gap of transferring new skills or perspectives learned through therapy to real-world situations that trigger symptoms.
Potential Audience: Young adults starting first job in their professional career want to feel confident to speak up and share their ideas to engage better with teammates and in a workplace.
{{sect3}}
Inspired by the framework of Just In Time Adaptive Interventions (JITAI), we wanted to explore how perception-first digital mediatory tools such as mixed reality can offer new ways to seamlessly access powerful tools and techniques on the fly.
We built our experience in Unity with the help of Magic Leap's documentation and their Unity SDKs and plugins. Some of us focused more on the storyboarding and UI/UX sketches, and others focused on Unity implementation, including setting up Magic Leap hand-tracking, hand pose gestures, eye-tracking, world reconstruction, fluid UI menus, spatial audio, and mixed reality anxiety-reducing experiences.
{{sect4}}
We prototyped a proof of concept of the menu system (featuring hand-tracking and speech-to-text inputs) and one of the interventions (the 4, 7, 8 breathing technique, which consists of a guided breathing meditation synced with expanding and contracting particle system visuals).
We started prototyping the other two interventions:
The solution will also be integrated with the EDA sensor device called Bitalino, that measures your stress level through sweat detection. If your stress threshold is reached, the application will start by itself. If the stress threshold decreases, the application will shut down automatically.
{{sect5}}
Prototype Demo:
Recorded presentation:
{{sect6}}
UI Storyboards:
{{sect7}}
{{sect8}}