Mirada x MR

Company
Mirada
Role
UX Researcher + Designer
Year
2016
Time to read
7 mins

I worked in a team to create a prototype model to demonstrate best usability practices for Microsoft Hololens for Research and Development at Mirada Studios. The prototype focused on fantasy YA author Cornelia Funke.

Mirada’s logo with the writing overlaid on it: “Mirada x Funke MR: A Case Study for Best Practices in Mixed Reality for the Hololens"

Overview

Problem to Solve What are the best usability practices of navigating content for the Microsoft Hololens?

Solution Deliver a List of Research findings validated through User Testing + Digital Prototype. Model this practice through the lens of a Mirada franchise, YA Fantasy author Cornelia Funke.

My Role UX + AR/MR Researcher and Designer

Teammates Adrian Inchauste (Client Relations, Research, Audio Prototype and Testing), David Kim (User Research, User Testing), and Stephanie Morales (Project Manager, Research, User Testing).

Mirada’s illustration of an owl.

The Client's Needs

Mirada Studios is a new-media, multi-platform production house founded by Guillermo del Toro that seeks to pioneer new storytelling experiences through the innovation of technology. I felt that the quote below reflected user experience in the brand:

“Sometimes the experience illuminates the inherent story values of a brand.

Sometimes it leads audiences to uncharted places.

Sometimes it’s just an incredible idea that needs to be realized, because it just does.”

Business Opportunity

With the rise of Virtual Reality and Augmented Reality, Mirada’s Research and Development department was keen to take a look into harnessing the power of these platforms for their storytelling purposes.

Creating a new model would be a powerful opportunity to develop the innovation of storytelling.

The AR/VR market is currently estimated by Goldman Sachs to be $3.5 billion based on investor funding. With a plethora of usages being ideated by companies, one matter needs to be fore-mostly investigated — how will people adopt it?

The answer to that lies in the process — test the user’s engagement through content. In content, creators can gauge emotional, visceral, physical and mental reactions to it.

Franchise Opportunity

Cornelia Funke is a critically acclaimed international bestselling author of fantasy books for children. Her books, Inkheart and The Thief Lord, have been adapted into films.

A library with Cornelia Funke’s body of work on top.
Funke’s body of work

Why Hololens?

The Microsoft Hololens is a computer headset that projects digital holograms for the User to see, hear, and interact within their actual environment. This blend of reality and digital environment is known as Mixed Reality (MR), although is commonly mistaken for Augmented Reality (AR). Currently priced at $3,000, the Hololens is the purveyor of MR headsets in the field.

A man wearing the Hololens, and the different UI displayed.
A visualization of what the Hololens interface could look like.

Terminology 101

You may have noticed that I have talked about the Hololens being an “MR” technology. What is MR? From Wired, here are some definitions broken down:

Virtual Reality, or VR: VR places the user in another location entirely. Whether that location is ­computer-generated or captured by video, it entirely occludes the user’s natural surroundings.

Augmented Reality, or AR: In augmented reality — like Google Glass or the Yelp app’s Monocle feature on mobile devices — the visible natural world is overlaid with a layer of digital content.

Mixed Reality, or MR: In technologies like Magic Leap’s, virtual objects are integrated into — and responsive to — the natural world. A virtual ball under your desk, for example, would be blocked from view unless you bent down to look at it. In theory, MR could become VR in a dark room.

A graphic that says, "What's the difference between MR/AR/VAR?"Source: Wired

How the Hololens Measures Up

At the time in 2016, virtual reality and related technologies were a booming market. Amidst the competitive landscape, I conducted a competitive and comparative analysis of the different hardwares. The Hololens was the most expensive model, due to it being in beta.

A chart that compares different VR/AR/MR hardwares.
2016 landscape of virtual reality and related technologies

Existing Competitive Franchises

Media franchises have expanded and deepened their audience reach through exploring books, movies, theme parks, toys, and video games — some even starting to explore the VR/AR space.

A chart that shows different franchises and their networth, all in billions.
While these franchises offer a percentage of the total AR/VR market, their preliminary insights into users reactions and testing are simultaneously invaluable and profitable — a unique advantage for Mirada.
A snapshot of Fantastic Beasts VR experience.
An example here featuring the Harry Potter spinoff, Fantastic Beasts, created into a VR experience. This experience was released shortly around the time of this project’s timeframe.

A Case Study for Mirada

I referred to Mirada’s own case-study of Cornelia Funke Fearless franchise, iPad app Mirrorworld. The importance of the success in this app demonstrated interest and a market for Cornelia Funke and for new media.

Mirrorworld app, in addition to garnering lauded press, won Silver in the Mobile Lions category for Best Visual Design/Aesthetic and shortlisted in the Mobile category for Best Content created for Mobile.

Mirrorworld app advertisement.

Research

Target Areas of Research Focus

1. Current UX practices in AR/VR

2. Interviews with Subject Matter Experts and identified key users

3. Contextual Inquiries in the Hololens

A thought cloud stemming from the word “AR” on a large whiteboard. Two designers are looking at it and thinking.
One of many brainstorm sessions

I helped research various existing methods of navigating content. Many of them relied on mimicking 2d screens as a way to transfer over similar users. However, a question arose if the User in the Hololens would still follow this pattern?

Google Daydream menu showing different streaming apps.
Example of media browsing in Google Daydream VR
A man demoing Oculus Rift menu.
Example of browsing content in the Oculus Rift

I evaluated the existing Hololens Interactions that define the restrictions of R&D:

Restrictions of the Hololens.

Product/Market Fit

A person's finger interacts with mixed reality UI.

Who uses this?

In the first attempt to perform a survey, we found that not many had used the Hololens. We had to go to the experts, the Subject Matter Experts such as developers and tech-enthusiasts. From there, I found that these users overall had enjoyed the experience, but found the interaction with the technology to still be rudimentary.

But the main question we concerned ourselves with was, Who would use the Microsoft Hololens?

I knew that there was a unique insight to a fan-base, the Mirada audience. Mirada Studios prides itself on innovating technology for storytelling purposes. Through its existing franchise of YA Fantasy author Cornelia Funke, they have tested the waters by creating an iPad app for the Mirror World series.

A venn diagram of early adopter and fantasy lover, who would be our users.

Two user types identified:

1. Early Adopter — Excited by technology, one of the first to have had access to and tried out the Microsoft Hololens and other AR/MR/VR devices.

2. Fantasy Lover — Engages with YA Fantasy content such as Harry Potter, Hunger Games, and Twilight in the form of books, movies, TV shows as well as theme parks and merchandise.

By comparing these two user types, I found that there existed a User that straddled both worlds and would be on board as a consumer to MR content that would come out.

The persona, Kelsey Funkadelic.

What does the persona mean for Mirada’s business?

I reviewed Goldman Sach’s Business Report, along with other financial research. These findings indicated that AR would soon eclipse VR, and move past entertainment sectors.

AR/VR revenue forecast.

User Interviews

In my research, we interviewed Subject Matter Experts as well as Hololens Users to identify overlapping and contrasting experiences.

Key Insights from Subject Matter Experts

• “It is missing feedback from virtual objects (easy to not understand what is going on).”
• “Gesture control is the hardest to get right so instruction is key.”
• “Gestures don’t always make sense when navigating menus or opening apps so microphones on the headset will capture voice commands.”
• “I would like to see more 3D UI and go away from the 2D UI.”

Key Insights from Hololens Users

•”It is so new so I’m not sure what to do first without instruction.”
•”View-point is small and can be hard to make sense of.”
•”It would be helpful to have boxes that outline the selection.”
• "I’m impressed but there’s not enough for me to want to come back to.”

Contextual Inquiries

After gathering these insights, it was necessary to validate these common pain-points by conducting contextual inquiries. I helped conduct 3 Hololens User Tests, and 3 Task Scenarios, in 15 minute sessions.

Photos of different actual users using the Hololens.

Key Take-Aways

When people encounter an experience for the first time, they are also learning how to use it for the first time. 83% of human learning is visual, so having clear affordances that helps guide users through an experience is key for learnability.

The simple differential factor relies on one primary element: a User-Centered Design. By placing the user at the center of the experience and reducing complexity, you improve overall usability and ultimately provide them with real engagement.

Reduced Complexity = Optimal User Experience = Engagement

Prototype

Prototype’s Objectives

1. Browse content (Funke’s work)

2. Navigation (through fantasy worlds)

3. Informational learning (about characters)

Check out the video prototype!

Connect with me

Email me: courttan@gmail.com

All rights reserved Courtney Taniguchi 2021