UX Design

UX Research

Mixed Reality(MR)

Accessibility

Reducing cognitive overload in libraries for users
with focus and memory challenges using mixed reality

PROJECT OVERVIEW

Public libraries can be overwhelming for users with memory, focus, or decision-making challenges. This mixed reality concept designed for Apple Vision Pro helps users navigate and explore books more confidently and independently. By offering personalized, non-intrusive guidance, the system reduces cognitive load and transforms traditional library spaces into supportive, user-centered environments.

Conceptual experience designed for Apple Vision Pro, created independently as part of an advanced HCI course.

My Role

UX Designer

Duration

2 months (2025)

Tools

After Effects

Figma

Skills

Inclusive Design

User Interviews

(Guerrilla Interviews)

Journey Mapping

Concept Ideation

Affinity Mapping

Team

collaborative research & ideation

1 UX Designer

1 UI Designer

The Problem

Library systems prioritize search over exploration leaving users with cognitive impairments struggling to navigate or engage confidently

🙂 Without Cognitive Impairment

Can easily navigate signage, shelves, and catalog systems

Comfortable asking staff for help when needed

Able to focus and remember where books are located

😔 With Cognitive Impairment

Disoriented by complex layouts and dense shelf arrangements

Struggle with memory, decision-making, and visual overload

Hesitate to ask for help due to confusion or social discomfort

Framing the Challenge

How might we support people with cognitive impairment in discovering new books without overwhelming their memory or attention?

Our research aimed to uncover inclusive design strategies that enable these users

to independently explore and find books of interest.

Research

Library systems create hidden barriers by relying on layouts, tools, and signage that fail users with cognitive strain

(01)

Secondary Research

(02)

Field Research at Carnegie Library

(03)

Synthesized Insights

(04)

Why This Research Matters

✨ These research insights directly shaped our solution. Every feature was designed to reduce the cognitive cost of being curious.

Library browsing is more cognitively demanding than it appears. Our research showed that users must:

-> Compare unfamiliar books quickly

-> Hold preferences and options in working memory

-> Navigate abstract signage and dense visual environments

-> Make decisions without support or feedback

This invisible strain helped us define our goal. We weren’t just building an easier search tool. We were designing a system that reduces friction, supports independent decision-making, and preserves the joy of wandering.

Design Execution

Flow Designed Around Mental Load:
From Entry to Bookshelf with Fewer Decisions

Design Execution: Wireframe

Interfaces That Think for You: Visual Cues, Simple Actions, No Overload

Final solution

Reducing Friction with Clean, Low-Effort Interfaces

Feature 01

One-at-a-Time Recommendations to Ease Decision Fatigue

Design rationale

One Book at a Time

Prevents overwhelm and supports easier decision-making.

Real-Time Behavior

Uses pick-up/put-down actions to tailor recommendations.

Feature 02

Fast, Tag-Based Context
& Social Proof for Quicker Decisions

Design rationale

Tags offer quick content preview

Helps users quickly understand book themes without needing extra search.

Ratings reduce guesswork

Goodreads scores offer a fast signal for interest and quality.

Feature 03

Personalized AI Summaries for Efficient Content Scanning

Design rationale

Smart Summary

AI delivers a bite-sized overview tailored to the user’s history—no external search needed.

Cognitive Ease

Short, scannable content supports quicker and more confident decisions.

Feature 04

Visual Browsing History to Support Recall Without Repetition

Design rationale

Memory Support

Helps users recall which books they explored during the session.

Book Trail

Automatically logs picked-up books to reduce mental load.

Beyond Features

Designing for Future Use

Edge Cases and Adaptability

Staff Integration

Beyond the Library

Ethical Considerations

Real-Time Sharing

Users may not always engage with the first recommendation they see.


That’s intentional.


With a simple swipe, they can dismiss a book and receive another suggestion based on updated preferences. Disinterest becomes valuable input.


The system learns passively through interaction, without interrupting the browsing experience.

Technology Decision

Leveraging Vision Pro to Simplify Interaction Through Real-World Anchors

We selected Vision Pro for its:

No Context Switching

Keeps all relevant information in one view, helping users stay focused and avoid cognitive overload.

Real-World Integration

Overlays digital content onto physical space, reducing the mental strain of abstract mapping.

Simple, Natural Gestures

Users interact using familiar motions like tapping and swiping—no controllers or complex training needed.

Spatial Awareness

Displays are anchored in space, letting users maintain orientation and navigate the library naturally.

Users only wear the headset briefly—when actively exploring books.

Project Reflection

How We Supported Independent Exploration Without Disruption

This approach helped us design a system that quietly supported decision-making while preserving the joy of discovery.

Working closely with librarians and accessibility specialists, I stripped the experience to its essentials. We learned that discovery, unlike search, is emotional and non-linear. Designing for it means reducing cognitive friction while still leaving room for curiosity and exploration.

Empowering self-directed discovery

Rather than steering users toward a “right” book, subtle visual cues encourage wandering, comparison, and personal choice—supporting independence, not dependence.

“Less-but-better” as an accessibility rule, not a style

Showing only one highlighted book, three genre chips, and a concise AI summary minimized decision fatigue without oversimplifying content.

Tiny gestures, huge impact

Restricting the interaction set to a single pinch → select and swipe → dismiss kept the learning curve low while preserving the “wow” of spatial computing.

My amazing team, brought together by creativity and collaboration.