Attention-Aware Visualization: Tracking and Responding to User Perception Over Time

Research output: Contribution to journalArticlepeer-review

Standard Standard

Attention-Aware Visualization: Tracking and Responding to User Perception Over Time. / Srinivasan, Arvind; Ellemose, Johannes ; Butcher, Peter et al.
In: IEEE Transactions on visualization and computer graphics, 09.09.2024, p. 1-11.

Research output: Contribution to journalArticlepeer-review

HarvardHarvard

Srinivasan, A, Ellemose, J, Butcher, P, Ritsos, PD & Elmqvist, N 2024, 'Attention-Aware Visualization: Tracking and Responding to User Perception Over Time', IEEE Transactions on visualization and computer graphics, pp. 1-11. https://doi.org/10.1109/TVCG.2024.3456300

APA

Srinivasan, A., Ellemose, J., Butcher, P., Ritsos, P. D., & Elmqvist, N. (2024). Attention-Aware Visualization: Tracking and Responding to User Perception Over Time. IEEE Transactions on visualization and computer graphics, 1-11. Advance online publication. https://doi.org/10.1109/TVCG.2024.3456300

CBE

Srinivasan A, Ellemose J, Butcher P, Ritsos PD, Elmqvist N. 2024. Attention-Aware Visualization: Tracking and Responding to User Perception Over Time. IEEE Transactions on visualization and computer graphics. 1-11. https://doi.org/10.1109/TVCG.2024.3456300

MLA

Srinivasan, Arvind et al. "Attention-Aware Visualization: Tracking and Responding to User Perception Over Time". IEEE Transactions on visualization and computer graphics. 2024, 1-11. https://doi.org/10.1109/TVCG.2024.3456300

VancouverVancouver

Srinivasan A, Ellemose J, Butcher P, Ritsos PD, Elmqvist N. Attention-Aware Visualization: Tracking and Responding to User Perception Over Time. IEEE Transactions on visualization and computer graphics. 2024 Sept 9;1-11. Epub 2024 Sept 9. doi: 10.1109/TVCG.2024.3456300

Author

Srinivasan, Arvind ; Ellemose, Johannes ; Butcher, Peter et al. / Attention-Aware Visualization: Tracking and Responding to User Perception Over Time. In: IEEE Transactions on visualization and computer graphics. 2024 ; pp. 1-11.

RIS

TY - JOUR

T1 - Attention-Aware Visualization: Tracking and Responding to User Perception Over Time

AU - Srinivasan, Arvind

AU - Ellemose, Johannes

AU - Butcher, Peter

AU - Ritsos, Panagiotis D.

AU - Elmqvist, Niklas

PY - 2024/9/9

Y1 - 2024/9/9

N2 - We propose the notion of attention-aware visualizations (AAVs) that track the user's perception of a visual representation over time and feed this information back to the visualization. Such context awareness is particularly useful for ubiquitous and immersive analytics where knowing which embedded visualizations the user is looking at can be used to make visualizations react appropriately to the user's attention: for example, by highlighting data the user has not yet seen. We can separate the approach into three components: (1) measuring the user's gaze on a visualization and its parts; (2) tracking the user's attention over time; and (3) reactively modifying the visual representation based on the current attention metric. In this paper, we present two separate implementations of AAV: a 2D data-agnostic method for web-based visualizations that can use an embodied eye tracker to capture the user's gaze, and a 3D data-aware one that uses the stencil buffer to track the visibility of each individual mark in a visualization. Both methods provide similar mechanisms for accumulating attention over time and changing the appearance of marks in response. We also present results from a qualitative evaluation studying visual feedback and triggering mechanisms for capturing and revisualizing attention.

AB - We propose the notion of attention-aware visualizations (AAVs) that track the user's perception of a visual representation over time and feed this information back to the visualization. Such context awareness is particularly useful for ubiquitous and immersive analytics where knowing which embedded visualizations the user is looking at can be used to make visualizations react appropriately to the user's attention: for example, by highlighting data the user has not yet seen. We can separate the approach into three components: (1) measuring the user's gaze on a visualization and its parts; (2) tracking the user's attention over time; and (3) reactively modifying the visual representation based on the current attention metric. In this paper, we present two separate implementations of AAV: a 2D data-agnostic method for web-based visualizations that can use an embodied eye tracker to capture the user's gaze, and a 3D data-aware one that uses the stencil buffer to track the visibility of each individual mark in a visualization. Both methods provide similar mechanisms for accumulating attention over time and changing the appearance of marks in response. We also present results from a qualitative evaluation studying visual feedback and triggering mechanisms for capturing and revisualizing attention.

U2 - 10.1109/TVCG.2024.3456300

DO - 10.1109/TVCG.2024.3456300

M3 - Article

SP - 1

EP - 11

JO - IEEE Transactions on visualization and computer graphics

JF - IEEE Transactions on visualization and computer graphics

SN - 1077-2626

ER -