Sept. 2018 - Aug. 2020
Master's Thesis
“It felt like I was part of the data”: Comparing Mouse, Touch, and Physical Interaction with Visualizations
Download my thesis here
Abstract
With my two exploratory studies I contribute a deeper understanding of the different experiences people have when manipulating data representations using mouse, touch, and physical interaction. To uncover experiences rather than performance measures I employed two different methodologies in the context of “data connectedness.” My first study used Likert-based questionnaires to determine differences in how connected participants felt to the data they were interacting with. To gain a deeper understanding, my second study employed a word selection activity (using the Desirability Toolkit), which led to much richer data. I found that people associated words like “engaged,” “direct,” and “satisfying” with touch and physical interaction, but often used words like “awkward,” “dull,” and “distant” with the mouse.
For my Master’s thesis, I collaborated with researchers from Microsoft Research and Inria France. I conducted a user study comparing different interaction techniques (mouse, touchscreen, and physical tangibles) that explored people’s experiences with data visualizations, rather than the typical performance measures such as speed and accuracy.
Process: Designing the Application
For my study, I needed an interface that was usable both in digital and physical formats. I first considered the potential types of visualization (bar chart vs. scatterplot) and the different interaction techniques associated with them. I visualized these as storyboards seen below.
Bar chart storyboard
Scatterplot storyboards
We wanted the digital and physical visualizations to be as similar as possible. Here are some potential candidates we considered but ended up passing on.
Pilot testing
For our pilot tests, we decided to test tangibles that were flat but grip-able (see below).
What we found:
-
creating bar charts were tedious, took too long
-
trends perceived from bar chart data was too simple
-
more freedom in terms of what data could be used in scatterplots
-
scatterplot points were fairly easy to grasp and pick up
-
data points become overcrowded at times
-
gridlines are too harsh
-
working with a flat view not ideal or comfortable
Final Product
For the purpose of our study, given participants' time constraints, we decided to study only scatterplots.
Other changes:
-
used a larger whiteboard
-
used a generic dataset most participants would understand
-
created custom grey gridlines
-
exchanged handwritten erasable marker axes for printed axes
-
included adjustable stand to angle the board
See the final physical and digital application below.
Please check out my thesis for details on methodology and results!