top of page

Sept. 2018 - Aug. 2020

Master's Thesis

“It felt like I was part of the data”: Comparing Mouse, Touch, and Physical Interaction with Visualizations

 

Download my thesis here

 

Abstract

 

With my two exploratory studies I contribute a deeper understanding of the different experiences people have when manipulating data representations using mouse, touch, and physical interaction. To uncover experiences rather than performance measures I employed two different methodologies in the context of “data connectedness.” My first study used Likert-based questionnaires to determine differences in how connected participants felt to the data they were interacting with. To gain a deeper understanding, my second study employed a word selection activity (using the Desirability Toolkit), which led to much richer data. I found that people associated words like “engaged,” “direct,” and “satisfying” with touch and physical interaction, but often used words like “awkward,” “dull,” and “distant” with the mouse.

For my Master’s thesis, I collaborated with researchers from Microsoft Research and Inria France. I conducted a user study comparing different interaction techniques (mouse, touchscreen, and physical tangibles) that explored people’s experiences with data visualizations, rather than the typical performance measures such as speed and accuracy.

Process: Designing the Application

For my study, I needed an interface that was usable both in digital and physical formats. I first considered the potential types of visualization (bar chart vs. scatterplot) and the different interaction techniques associated with them. I visualized these as storyboards seen below.

Bar chart storyboard

Bar chart storyboard

Scatterplot storyboards

storyboard 2.png
storyboard 3.png

We wanted the digital and physical visualizations to be as similar as possible. Here are some potential candidates we considered but ended up passing on.

Pilot testing

For our pilot tests, we decided to test tangibles that were flat but grip-able (see below).

What we found:

  • creating bar charts were tedious, took too long

  • trends perceived from bar chart data was too simple

  • more freedom in terms of what data could be used in scatterplots

  • scatterplot points were fairly easy to grasp and pick up

  • data points become overcrowded at times

  • gridlines are too harsh

  • working with a flat view not ideal or comfortable

20190726_193709.jpeg
20190726_190323.jpeg

Final Product

For the purpose of our study, given participants' time constraints, we decided to study only scatterplots.

Other changes:

  • used a larger whiteboard

  • used a generic dataset most participants would understand

  • created custom grey gridlines

  • exchanged handwritten erasable marker axes for printed axes

  • included adjustable stand to angle the board

See the final physical and digital application below.

physical_vis.jpg
digital_vis.PNG

Please check out my thesis for details on methodology and results!

bottom of page