Designing AR Experience for educative exhibitions experience with a particular focus on using SLAM (Simultaneous Localization and Mapping) for UX
Open air Museum, is one of the project of PlaygroundXR , that focuses on bringing the door of museum towards the users through the usage of AR technology.
To commemorate 50Y of Cubism movement, they decided to create an experience that brings the educative side of cubism history using augmented reality experience to inspire people about the movements and how it has an effect on our daily life.
In collaboration with Bridge 48 2.0 Festival and Synthetica, the experience will be run in Estrella Damm on 14th October 2023 for the visitors of the event in their section of immersive experience exhibitions
The primary goals of this experience were to :
SLAM is a technique that allows digital devices to map an environment while simultaneously tracking their own movement within it. This technology was crucial for our project for several reasons:
The SLAM understanding took sometime , i had to visit many different places to have idea, brainstorm and also tested different technique to manipulate the environment into something workable.
Once i managed to figured it, thanks to many hours of testing and help from different people advicing me, I started with building and collecting all the 3D objects that is needed, a
We wanted the design to be accesible for everyone who visited the festival, which is why WebAR is the best option for it , and i decided to use Onirix to build this experience.
The data collection are in collaboration with ArtSpace Tour Barcelona about the movement of Cubism and how we translate the idea into Open Air Museum , bringing different stories , technique, history in timeline and inspiration for people who experience it.
Once the application is launched, users we put will be presented with 2 experience , AR Portal Experience and Gen AI Mask Experience
Users can select the AR Portal Experience as the first experience, and the application will open.
User will stand in the mark they have seen on the floor and place the surface tracking on the mark they will see on the carpet.
Once the experience load, user will see hear a music and a giant lift that opens slowly to the open air portal experience.
Once the door open, user will see a navigation on the floor that says “ Left Photos and Right videos “
User will start their experience on the left, where the hanging painting dated from people who inspired cubism , each of tha painting is interactable with stories and painting details.
User can roam around through their left and right side, to see the experience and watch some videos as well that was hanging on the frames within the experience, once they are done with this . They will see a giant collage cubism wall with an instruction to tap to get back into the real world for the next experience.
Once user is done with the Portal Experience, they now can start with second experience, Gen AI Mask
User will load the experience from a QR Code , the application will ask for some consent of video and motion from device
Once the application load, user will see an interface of a chatbox ( like Chatgpt ) and a textureless mask .
User will be prompt to add their own creativity based on the experience in the portal to generate the texture for the mask.
Once they are generating it, they can take a photo with them and share it in the social media.