Lumero

Luminate experiences in the memory with mixed senses.

OVERVIEW

Memory links people to the past, proves the existence of life and makes people who they are. Then what makes the memory? How memories are created from experiences? And what makes our memory fresh and vivid? This project explores the relationship between senses and memory, and tries to create a more controllable and immersive way of memorizing the past with mixed senses.

MY ROLE

TYPE

TOOL

DURATION

User Research
Usability Testing
UX/UI Design
Product Design
3D Modeling​/Animation
(Individual work, all work shown below)

IOT
Artificial Intelligence

Figma
Photoshop
Illustrator
Rhino
Keyshot

Nov. 2021 - Dec. 2021

EXPERIENCE OVERVIEW

Mixed-Sense Experience with

+ VISUAL + AUDIO +

By controlling the shell transparency, LUMERO luminates experiences between two different states.

EFFECT TESTING

EFFECT 01

The first effect idea came with my experience in Tokyo. I tried to recreate the busy street night scene in Tokyo, with the mix of street video, Japanese music and crowd noise.
+
Japanese Music
+
Crowd Noise
=

EFFECT 02

In this effect testing, I tried to create a seaside wandering experience which may reminds people of relaxing seaside holidays. I mixed audio and video materials selected on that base, and did the testing with motion detection added.
+
Seaside Music
+
Relaxing Vocal
=

HOW I GOT THERE?

RESEARCH

Purpose of Research

I was initially interested in the role of senses in memory forming and keeping. Thus I did some online research and found there’s proof of evidence of link between senses and memories. Then I began to be curious about how such link was reflected in people’s real life. So further research was done to explore this question.

HOW PEOPLE KEEP THEIR MEMORIES?

People use all sorts of methods to memorize their important moments in life. What are those methods? I collected and organized the most popular ways people like in keeping their memories:

HOW THESE METHODS ARE INFLUENCED BY SENSES?

To know the role of senses in those memory keeping methods, I did some interview to people in different age and identity. Here’s the highlighted answers:
Arisa | 23, Student
Shot in July 2019
Hao | 44, Architect
Shot in Jan 1982
Zhengmin | 57, Teacher
Shot in Jun 2009
Q | Have you ever record your memories and how?
A | I like taking photos. I usually bring my camera with me when I go to places with nice sceneries. And I also like to post them on social media or share them with my family.
Q | How do you feel when you recall your memories by your way of remembering?
A | Sometimes specific feeling during a certain time, such as the image, atmosphere or scent could be amplified by recalling memories.
Q | Which way of memorizing the past do you like most and why?
A | Talking about funny stories happened in the past with my family. We have such tradition in our family which has bond us tighter together.
Q | How do you feel when you recall your memories by your way of remembering?
A | I remember the images and emotion of both me and other people in that memory. I feel enjoyable thinking about those experiences.
Q | What are the most impressive feelings for you in a certain memory?
A | I remember the touch of the cold creek water when I played there in my young age. And also the sounds and images of people around me.
Q | Have you found any deficiency in current way of recording and retrieving memories?
A | If only I could “enter” the scene of my memory to interact with people and surroundings there, and have senses of interactions.
Sense memory gives people chance of re-experiencing the past, and also enables experience-sharing among different people.

ROLE OF DIFFERENT SENSES IN CREATING EXPERIENCE

To gain first-hand knowlege of how different senses function in triggering experience, I designed and conducted an Experience Experiment.
MATERIALS
Materials were selected on the purpose of creating different types of senses:
EXPERIMENT
BEST EFFECT - SOUND + IMAGE
The result of the experiment shows that: if at most two senses were selected to provid mix-senses experience, Sound + Image would work the best.

SYNTHESIS

With the research results on hand, defination process for understanding needs and pain points of target group was then conducted.

EMPATHY MAP

PERSONA & JOURNEY MAP

Then I futher explored the pain points for different type of target people and through the reminiscence process.

PROBLEM STATEMENT

How to create controllable memory experience with mixed senses?

IDEATION & DESIGN

HOW TO FUNCTION?

To find the best design idea, I firstly combed target users’ story thoroughly to define the scope of possible solution. And by making the storyline, I also developed the MVP user flow that serves the key functions needed.
One day Jack viewed something and heared a sound that trigger one of his deep-buried memory about the past.
He couldn’t wait to share this experience to one of his friends, but found that his friend couldn't fully understand his feeling from the oral description.
Jack felt disappointed. He wondered whether there’s more direct way to recall and share his memories and experiences.
Jack went sight-seeing another day. He recorded the beautiful scene with his phone.
After going back home, Jack selected his favorite episodes of the sight-seeing experience, sent them to the device, and created a mixed-sensed effects.
The effects directly triggered the viewers sense of presence in the scene. Jack was happy that his friends finally could share his feelings in a past experience.
DEVICE DESIGN PRINCIPLE
From Jack’s storyline, I figured that there’s some principle in designing the device in order to achieve the needed function.
01 MULTI-MEDIA
In order to trigger mixed-sense effects, the device should make use of multiple displaying medium.
02 MULTI-USER
For the sharing pupose, the device should be able to provide effects that could be experienced by multiple people at the same time.
03 STAND-ALONE
The device should not be fixed or attached, but be a flexible stand-alone product.
04 ADJUSTABLE
The effects should be able to be controlled and adjusted by users instantaneously while displayed.

USER FLOW

DEVICE FORM & APPEARANCE

FORM EXPLORATION

I brainstormed several possible form of the device. And by comparing them to the design principle, it was found that the “lamp” is the best form.

LAMP APPEARANCE

FUNCTIONING SYSTEM

AI algorithm plays a vital role in extracting data from source images or videos that the user uploaded, then it combines the preset effect data from machine learning and does image calculation, and finally it outputs the mixed-sense effects on devices.

APP DESIGN

KEY FLOWS

TEST & ITERATION

MOCKUP

Lumero
With controlling of lightness and transparency, Lumero creates experiences in different states.
More Projects