Filtered by themeEye tracking4 papersclear ✕

Effect of Adaptive Guidance and Visualization Literacy on Gaze Attentive Behaviors and Sequential Patterns on Magazine-Style Narrative VisualizationsOSWALD BARRAL, SÉBASTIEN LALLÉ et al. · 2021We study the effectiveness of adaptive interventions at helping users process textual documents with embedded visualizations, a form of multimodal documents known as Magazine-Style Narrative Visualizations (MSNVs). The interventions are meant to dynamically highlight in the visualization the datapoints that are described in the textual sentence currently being read by the user, as captured by eye-tracking. These interventions were previously evaluated in two user studies that involved 98 participants reading excerpts of real-world MSNVs during a 1-hour session. Participants' outcomes included their subjective feedback about the guidance, and well as their reading time and score on a set of comprehension questions. Results showed that the interventions can increase comprehension of the MSNV excerpts for users with lower levels of a cognitive skill known as visualization literacy. In this article, we aim to further investigate this result by leveraging eye-tracking to analyze in depth how the participants processed the interventions depending on their levels of visualization literacy. We first analyzed summative gaze metrics that capture how users process and integrate the key components of the narrative visualizations. Second, we mined the salient patterns in the users' scanpaths to contextualize how users sequentially process these components. Results indicate that the interventions succeed in guiding attention to salient components of the narrative visualizations, especially by generating more transitions between key components of the visualization (i.e., datapoints, labels, and legend), as well as between the two modalities (text and visualization). We also show that the interventions help users with lower levels of visualization literacy to better map datapoints to the legend, which likely contributed to their improved comprehension of the documents. These findings shed light on how adaptive interventions help users with different levels of visualization literacy, informing the design of personalized narrative visualizations.

UX of AI & PersonalizationResearch Papers

I see, you design: user interface intelligent design system with eye tracking and interactive genetic algorithmCheng · 2019User interfaces are important for streamlining the interactions between humans and computers. However, there are few effective approaches for collecting users’ preferences implicitly and objectively for the purpose of user interface (UI) design optimization. This paper presents an effective approach to interactive genetic algorithm (IGA) optimization-based UI design via eye tracking, including eye-movement data based users’ preference inferring, gene coding for real UI components and design features, and the visualization and interaction mechanisms. Then we design and build a prototype system that applies IGA to generate and optimize music player UI solutions automatically. An evaluation of our prototype system suggests that it can generate and identify personalized UI designs reliably with minimal user intervention and high efficiency and user satisfaction.

UX of AI & PersonalizationResearch Papers

Review of eye tracking metrics involved in emotional and cognitive processesVasileios Skaramagkas, Giorgos Giannakakis et al.Eye behaviour provides valuable information reveal- ing one’s higher cognitive functions and state of affect. Although eye tracking is gaining ground in the research community, it is not yet a popular approach for the detection of emotional and cognitive states. In this paper, we present a review of eye and pupil tracking related metrics (such as gaze, fixations, saccades, blinks, pupil size variation, etc.) utilized towards the detection of emotional and cognitive processes, focusing on visual attention, emotional arousal and cognitive workload. Besides, we investigate their involvement as well as the computational recognition meth- ods employed for the reliable emotional and cognitive assessment. The eye-tracking publicly available datasets employed in relevant research efforts were concentrated and described their specifi- cations and details. The multimodal approaches which combine eye-tracking features with other modalities (e.g. biosignals), along with artificial intelligence and machine learning techniques were also surveyed in terms of their recognition/classification accuracy. The limitations, current open research problems and prospective future research directions were discussed for the usage of eye- tracking as the primary sensor modality. This study aims to comprehensively present the most robust and significant eye/pupil metrics based on available literature towards the development of a robust emotional or cognitive computational model. Index Terms—eye tracking, gaze, pupil, fixations, saccades, smooth pursuit, blinks, stress, visual attention, emotional arousal, cognitive workload, emotional arousal datasets, cognitive work- load datasets Vasileios Skaramagkas, Giorgos Giannakakis, Emmanouil Ktistakis, Dim- itris Manousos, Ioannis Karatzanis are with the Institute of Computer Science, Foundation for Research and Technology Hellas (FORTH), GR-700 13 Heraklion, Crete, Greece (Email: vskaramag@ics.forth.gr, ggian@ics.forth.gr, mandim@ics.forth.gr, karatzan@ics.forth.gr) Giorgos Giannakakis is with the Institute of AgriFood and Life Sciences, University Research Centre, Hellenic Mediterranean University, Heraklion, Greece. Emmanouil Ktistakis is with the Institute of Computer Science, Foundation for Research and Technology Hellas (FORTH) and the Laboratory of Optics and Vision, School of Medicine, University of Crete, Heraklion, Greece (Email: mankti@ics.forth.gr) Nikolaos S. Tachos and Evanthia E. Tripoliti, are with the Department of Biomedical Rese

Emotional DesignResearch Papers

Library and Information Science ResearchMaja Kuhar, Tanja Merˇcun · 2022In the field of digital libraries, research on user experience is sparse, especially in terms of emotions, impressions, and stimulation evoked by interaction with the digital library. Given the many different methods and tools available for assessing user experience, two questionnaires and eye-tracking were explored to see how each can contribute to understanding user experience in digital libraries. An eye-tracking study with 30 participants was carried out using two digital libraries. Analysis of the questionnaires revealed that overall, one digital library was experienced more positively, with the difference most evident in the hedonic quality. The eye-tracking data revealed different gaze patterns in the two digital libraries, with significant difference in measure values particularly on the search boxes. When eye-tracking was combined with the questionnaire data, several corre­ lations were found, indicating that the search box position and the intuitiveness of the homepage had an impact on the user experience.

Emotional DesignResearch Papers