Motion Lab: Learning Experience Design

Motion Lab: Learning Experience Design

Motion Lab: Learning Experience Design

01
RESPONSIBILITIES
UX RESEARCH
UX RESEARCH
UX DESIGN
UX DESIGN
UI DESIGN
UX DESIGN
UX DESIGN
DELIVERABLES

Unity Application

{ SCROLL }
OVERVIEW

Making hands-on, biology lab experiment more affordable and accessible

Hands-on, lab-based science experiments are critical in STEM education but are often expensive and inaccessible, particularly for students with learning disabilities (LDs).

Motion Lab aims to create an interactive virtual simulation of a biology lab experiment that is relatively cheaper, with a focus on an accessible experience for students with LDs.

Our final product is a Unity application that users can interact with through the Leap Motion sensor, covering the main concepts of the micropipette experiment.

Hands-on, lab-based science experiments are critical in STEM education but are often expensive and inaccessible, particularly for students with learning disabilities (LDs).

Motion Lab aims to create an interactive virtual simulation of a biology lab experiment that is relatively cheaper, with a focus on an accessible experience for students with LDs.

Our final product is a Unity application that users can interact with through the Leap Motion sensor, covering the main concepts of the micropipette experiment.

Hands-on, lab-based science experiments are critical in STEM education but are often expensive and inaccessible, particularly for students with learning disabilities (LDs).

Motion Lab aims to create an interactive virtual simulation of a biology lab experiment that is relatively cheaper, with a focus on an accessible experience for students with LDs.

Our final product is a Unity application that users can interact with through the Leap Motion sensor, covering the main concepts of the micropipette experiment.

Trailer Video

BACKGROUND

In need of a virtual solution to reach more students

In need of a virtual solution to reach more students

In need of a virtual solution to reach more students

Our client, PittBio Outreach, has developed Pitt-Kits, which include essential equipment and video instructions to help K-12 students perform lab experiments. However, due to the limited availability of these kits and safety concerns associated with certain experiments, PittBio is seeking to expand their reach by offering virtual learning solutions.


Our client, PittBio Outreach, has developed Pitt-Kits, which include essential equipment and video instructions to help K-12 students perform lab experiments. However, due to the limited availability of these kits and safety concerns associated with certain experiments, PittBio is seeking to expand their reach by offering virtual learning solutions.


Our client, PittBio Outreach, has developed Pitt-Kits, which include essential equipment and video instructions to help K-12 students perform lab experiments. However, due to the limited availability of these kits and safety concerns associated with certain experiments, PittBio is seeking to expand their reach by offering virtual learning solutions.


This is what longboard dancing looks like. Dancers usually post-edit music or listen to music while they dance.

Here’s what Jambo sounds like. The rider’s dancing style is captured by the board and transformed into sound.

THE GOAL

Simultaneously, the Learning Disabilities Association of Pennsylvania (LDA of PA) recognizes the unique challenges students with LDs face in traditional laboratory settings. They see this initiative as an opportunity to enhance educational access for these students through highlighting the accessibility of the new virtual learning solution.

Simultaneously, the Learning Disabilities Association of Pennsylvania (LDA of PA) recognizes the unique challenges students with LDs face in traditional laboratory settings. They see this initiative as an opportunity to enhance educational access for these students through highlighting the accessibility of the new virtual learning solution.

Simultaneously, the Learning Disabilities Association of Pennsylvania (LDA of PA) recognizes the unique challenges students with LDs face in traditional laboratory settings. They see this initiative as an opportunity to enhance educational access for these students through highlighting the accessibility of the new virtual learning solution.

Sample sound

Pitch bend

tempo

Sample sound

Pitch bend

tempo

Force-sensitive resistor: sandwich the Velostat between two squares of copper tape.

Drum Pad: based on which part of the board is pressed, different samples will play.

Sample sound

Velostat

copper tape

copper tape

Force-sensitive resistor: sandwich the Velostat between two squares of copper tape.

Drum Pad: based on which part of the board is pressed, different samples will play.

Sample sound

Velostat

copper tape

copper tape

Force-sensitive resistor: sandwich the Velostat between two squares of copper tape.

Drum Pad: based on which part of the board is pressed, different samples will play.

Sample sound

Velostat

copper tape

copper tape

SUCCESS METRIC

Building a proof of concept for scalable system

Starting with micropipette: Essential, expensive, and challenging to teach digitally.

Measuring success through:

  • Accessibility

  • Affordability

  • Gesture transferability.

Measuring success through:

  • Accessibility

  • Affordability

  • Gesture transferability.

Measuring success through:

  • Accessibility

  • Affordability

  • Gesture transferability.

User Background

User Background

Medium (Jambo)

Medium (Jambo)

Experience

Experience

Music Driven By

Emphasis on Dancing

Music Driven By

Emphasis on Dancing

Brings new perspective to

Music Production

Brings new perspective to

Music Production

Music Driven By

Emphasis on Musicianship

Music Driven By

Emphasis on Musicianship

Brings new perspective to

Longboard Dancing

Brings new perspective to

Longboard Dancing

From Overwhelming to Accessible

Better understand what students need through research

Building a prove of concept for scalable system

Starting with Micropipette: essential, expensive, and challenging to learn digitally.

From expensive to affordable

Choosing the appropriate medium and technology

Choosing the appropriate medium and technology

Choosing the appropriate medium and technology

After an exploration of different technologies that enable replicating the pipetting motion interaction, we chose Leap Motion for its flexibility to capture a wide range of lab experiment gestures.

After an exploration of different technologies that enable replicating the pipetting motion interaction, we chose Leap Motion for its flexibility to capture a wide range of lab experiment gestures.

After an exploration of different technologies that enable replicating the pipetting motion interaction, we chose Leap Motion for its flexibility to capture a wide range of lab experiment gestures.

Additional micro adjustments & customization within Max/msp

potential for generative sound synthesis & effect

Gather data of dancer’s movements using Arduino

feet position, wheel speed, and board tilt

Map value to MIDI Control in Ableton Live

to sample sound, tempo, and pitch

Result

“This is exactly what we’re looking for!"

“This is exactly what we’re looking for!"

“This is exactly what we’re looking for!"

layout

Jambo 1.0

Jambo 2.0

triggering multiple sensors all the time

clearance at the center avoids accidentally triggering sounds.

shape & size


the shape and size of the new sensor pad resemble a foot, which is more ergonomic for dancers.

Jambo 1.0

Jambo 2.0

when the dancer is simply pushing forward, the front foot stays near the center. This new layout makes music interaction more intentional.

fabrication

old sensors are unpredictable and too sensitive. we added more elastic material as a cushion in-between. New sensors are more reliable, stable, and durable.

Adhesive Foam Tape

FSR-touch sensor

silicone grid sheet

acrylic sheet

Our client validated the educational aspects of the prototype and gave us positive feedback.

Our client validated the educational aspects of the prototype and gave us positive feedback.

Our client validated the educational aspects of the prototype and gave us positive feedback.

Simulated physical feedback with exaggerated audio/visual feedback:

To replicate the tactile experience of a physical micropipette, we integrated a physics-based UI that simulates the behavior of a spring-loaded plunger. Just as in the real tool, the initial press is smooth and requires less effort, while pressing further increases resistance, mimicking the harder-to-press sensation of the second stop.

Simulated physical feedback with exaggerated audio/visual feedback:

To replicate the tactile experience of a physical micropipette, we integrated a physics-based UI that simulates the behavior of a spring-loaded plunger. Just as in the real tool, the initial press is smooth and requires less effort, while pressing further increases resistance, mimicking the harder-to-press sensation of the second stop.

Simulated physical feedback with exaggerated audio/visual feedback:

To replicate the tactile experience of a physical micropipette, we integrated a physics-based UI that simulates the behavior of a spring-loaded plunger. Just as in the real tool, the initial press is smooth and requires less effort, while pressing further increases resistance, mimicking the harder-to-press sensation of the second stop.

background beats


setting a rhythmic background

switch between multiple sets of samples

one-step

mix & switch

For hi-fi user testing, we wanted to make an effort to recruit students who had LDs in order to assess the target audiences' needs. To do this, we created a functional needs survey that asked users whether they identified with common needs that are present in students with LDs, such as ADHD and dyslexia.

We were able to test 5 college students, 2 of which self-reported as having light ADHD/executive dysfunction, and 3 students who scored above average on the survey. None of our users had previous experience with micropipetting.

For hi-fi user testing, we wanted to make an effort to recruit students who had LDs in order to assess the target audiences' needs. To do this, we created a functional needs survey that asked users whether they identified with common needs that are present in students with LDs, such as ADHD and dyslexia.

We were able to test 5 college students, 2 of which self-reported as having light ADHD/executive dysfunction, and 3 students who scored above average on the survey. None of our users had previous experience with micropipetting.

For hi-fi user testing, we wanted to make an effort to recruit students who had LDs in order to assess the target audiences' needs. To do this, we created a functional needs survey that asked users whether they identified with common needs that are present in students with LDs, such as ADHD and dyslexia.

We were able to test 5 college students, 2 of which self-reported as having light ADHD/executive dysfunction, and 3 students who scored above average on the survey. None of our users had previous experience with micropipetting.

54 mm

32 mm

Result

Evaluation Highlights:

Evaluation Highlights:

Evaluation Highlights: