Wellness & Health

Design process for Zen Eye Pro, VR Stress Check - PIco 4 Enterprise

Project main image
Project Background

Japan is said to be living head of it's time and are known for it's technology and deep tech application , I’m grateful to have had the opportunity to work on one such forward-thinking project, designing alongside a brilliant team of developers, researchers, and engineers.

From November 5-6, I assisted the CEO, Anna Shimafuji of representing NeuralPort Inc. who are currently in the middle of another fund raising round at the Smart City Expo, alongside my collegue in marketing to showcase the products under Japan pavilion as well as one of the portfolio from JETRO.

While Neuralport works on many other products such as Zone Z and Zen Eye Glass , today i'm sharing the design process and approach from one of their product that i have worked with, Zen Eye Pro.

Zen Eye Pro presentation in Smart City Expo 2024 , with JETRO and Japan Pavilions

Designing Zen Eye Pro: Visualizing Mental States with Eye Tracking

Zen Eye Pro is a tool that lets you see your mental state by tracking stress through eye movements. Developed with an algorithm based on research into how eye movements can reveal stress levels. As an XR Designer, my role is to focus on creating an intuitive interface based on the research to that guides users their experience and understanding insights from the data .

Why understanding stress / tension some people call it  matter ? Stress is a natural reaction of the body, resulting from demanding circumstances where the brain activates the “fight or flight” mode. In sports, one application of NeuralPort is to find the optimal level of stress that triggers the brain to increase the level of fight to be able to compete effectively. By identifying this level and correlating it with actual on-field performance, athletes can have personalized training that ensures they maintain that optimal stress level for peak performance before entering the field.

At the moment, we’re using the Pico 4 Enterprise headset for Zen Eye Pro, but we’re also planning to integrate the experience into the Apple Vision Pro in the future (timeline TBA)

So, How might we provide user with good viewing of the Stress Check Application ?

Design Thinking

A while ago in XRExpo , Stuttgart i presented design framework on how to design mixed reality experience . In designing this application i used the same approach , but with a little tweak of VR Experience instead of mixed reality experience to put together initially what we will be needing within the scenes to reach the user goal.

Scene 1 : Lobby Table Element Experience


Low Fidelity Wireframes

UI Approach : Gaze Interaction for User Comfort and Precision

To ensure comfortable gaze interactions, we keep them within a ±60-degree angle, allowing users to engage with the virtual environment without strain, even during extended use. In this case, I’m using gaze for interaction, not navigation. However, if gaze were used for navigation, I would set the gaze angle at 10° - 20° below the horizon for natural movement. For precise selections, I add a Gaze-Based Selection Precision layer, setting a 10-degree activation angle to ensure accurate, responsive feedback.

Key Findings from Testing:To maintain comfort and prevent strain, the following should be avoided:

  • Gaze angle greater than 10° above the horizon
  • Gaze angle greater than 60° below the horizon
  • Neck rotation exceeding 45° above the horizon

Approaches in UI Placements in Gaze

Object placed within 0-60 degree to -0 to -60 degree( horizontally and vertically ) for gaze interaction within 90 degree POV

Spatial UI Layout : In this case, i place the interactive elements within a 1.5-meter radius ensures comfortable interaction , while we make the content changes automatically as needed without requiring users to stretch left and right too much.

Interactive elements within a 1.5-meter


Low Fidelity Prototype in ShapesXR

Made in ShapesXR

Project small image
Project small image

High Fidelity Prototype


-------------



Current WIP

NeuralPort’s application is currently trying to healthcare. I'm currently designing an upcoming Proof of Concept (POC) at Kyushu Hospital in Fukuoka City, Japan, for pediatric patients, to use the application quantitively for the correct content to decrease "flight" level during operation.

CEO, Neuralport.Inc | Forbes JAPAN Women In Tech TOP30
I work with Sonya at my startup, where her XR design expertise and broad skill set—including pitch creation, networking, diplomacy, and data analysis—are invaluable. She’s a hardworking, talented, and highly motivated person. I'm very happy to work with her.
Sr. Engineer XR at Qualcomm
I worked with Sonya on a VR app project, where her punctuality, creativity, and attention to detail kept us on track. Her stunning, user-friendly UI designs made a huge impact, and collaborating with her was a smooth, enjoyable experience. I'd gladly work with her again.
Technical Engineer Researcher, Osaka University
I've worked with Sonya over the past years, and she's proven to be an exceptional designer with strong communication skills. Sonya played a vital role in designing the audiovisual interface for our XR application, quickly aligning with the product concept and delivering impactful results. I give my best recommendation.
CEO at XR Wellness | XR for hospital patients
I had the pleasure of working with Sonya on two VR projects. She is highly creative and brings a lot to a project, she works efficiently and is dedicated to what she does, testing the final versions until she's sure their perfect. She has a lot of creative ideas - a grand professional! Thanks Sonya I hope to work with you again in future projects.
CEO, Exuberante Caos Associação | Immersive Mural
We had the pleasure of working with Sonya on our AR Scavenger Hunt project, we couldn’t be happier with the results. She is a talented XR Designer with expertise in UI/UX Design and Web AR Onirix to implement gamification & geolocation, with clear communication. We highly recommend Sonya for any AR/VR project!
Welcome
New Ideas
Welcome
New Ideas
Welcome
New Ideas
Welcome
New Ideas
Welcome
New Ideas
Welcome
New Ideas
Welcome
New Ideas
Welcome
New Ideas