Filtered by themeMeasuring user experience23 papersclear ✕

Assessing Human-AI Interaction Early through FactorialMIHAELA VORVOREANU, DEREK DEBELLIS et al. · 2023This work contributes a research protocol for evaluating human-AI interaction in the context of specific AI products. The research protocol enables UX and HCI researchers to assess different human-AI interaction solutions and validate design decisions before investing in engineering. We present a detailed account of the research protocol and demonstrate its use by employing it to study an existing set of human-AI interaction guidelines. We used factorial surveys with a 2 × 2 mixed design to compare user perceptions when a guideline is applied versus violated, under conditions of optimal versus sub-optimal AI performance. The results provided both qualitative and quantitative insights into the UX impact of each guideline. These insights can support creators of user-facing AI systems in their nuanced prioritization and application of the guidelines.

UX of AI & PersonalizationResearch Papers

Article UX Framework Including Imbalanced UX Dataset Reduction Method for Analyzing Interaction Trends of Agent SystemsAgent Systems. Sensors · 2023The performance of game AI can significantly impact the purchase decisions of users. User experience (UX) technology can evaluate user satisfaction with game AI by analyzing user interaction input through a user interface (UI). Although traditional UX-based game agent systems use a UX evaluation to identify the common interaction trends of multiple users, there is a limit to evaluating UX data, i.e., creating a UX evaluation and identifying the interaction trend for each individual user. The loss of UX data features for each user should be minimized and reflected to provide a personalized game agent system for each user. This paper proposes a UX framework for game agent systems in which a UX data reduction method is applied to improve the interaction for each user. The proposed UX framework maintains non-trend data features in the UX dataset where overfitting occurs to provide a personalized game agent system for each user, achieved by minimizing the loss of UX data features for each user. The proposed UX framework is applied to a game called “Freestyle” to verify its performance. By using the proposed UX framework, the imbalanced UX dataset of the Freestyle game minimizes overfitting and becomes a UX dataset that reflects the interaction trend of each user. The UX dataset generated from the proposed UX framework is used to provide customized game agents of each user to enhanced interaction. Furthermore, the proposed UX framework is expected to contribute to the research on UX-based personalized services.

UX of AI & PersonalizationResearch Papers

Collaboration with Conversational AI Assistants for UX EvaluationEmily Kuang · 2023EMILY KUANG, Golisano College of Computing and Information Sciences Rochester Institute of Technology, USA EHSAN JAHANGIRZADEH SOURE, School of Computer Science University of Waterloo, Canada MINGMING FAN∗ , Computational Media and Arts Thrust The Hong Kong University of Science and Technology (Guangzhou), China and Division of Integrative Systems and Design & Department of Computer Science and Engineering The Hong Kong University of Science and Technology, China

UX of AI & PersonalizationResearch Papers

Bibliometric and Visualized Analysis of User Experience Design Research: From 1999 to 2019Rui Li · 2022With increasing research attention to user experience (UX), UX design (UXD) has gained concomitant interest. This study systematically reviews UXD research using a bibliometrical knowledge map. We collected and reviewed 14,825 documents to analyze UXD research from five perspectives: keyword trends, reference co-citation, author co-citation, categories, and author institutes. (a) UXD, as a research term, broadens the boundaries of experience and design and brings them together. (b) Publications in UXD focus on user, business, and technology orientation. (c) Author co-citation analysis reveals “invisible college networks” among UXD scholars. (d) Computer Science and Engineering are the most significant majors in UXD, although interdisciplinary research is common. (e) Research from the United States dominates. This review recognizes research gaps and future trends for conceptualizing and assessing UXD skills. The findings can benefit researchers, curriculum designers, and instructors.

UX of AI & PersonalizationResearch Papers

Measuring and Improving User Experience Through Artificial Intelligence-Aided Design[Unknown · 2020This paper aims to propose a methodology for measuring user experience (UX) by using artificial intelligence-aided design (AIAD) technology in mobile application design. Unlike the traditional assistance design tools, AIAD focuses on the rational use of artificial intelligence (AI) technology to measure and improve UX since conventional data collection methods (such as user interview and user observation) for user behavior data are inefficient and time-consuming. We propose to obtain user behavior data from logs of mobile application. In order to protect the privacy of users, only a few dimensions of information is used in the process of browsing and operating mobile application. The goal of the proposed methodology is to make the deep neural network model simulate the user's experience in the process of operating a mobile application as much as possible. We design and use projected pages of application to train neural networks for specific tasks. These projected pages consist of the click information of all users in the process of completing a certain task. Thus, features of user behavior can be aggregated and mapped in the connection layers and the hidden layers. Finally, the optimized design is executed on the social communication application to verify the efficiency of the proposed methodology.

UX of AI & PersonalizationResearch Papers

The Trend of Published Literature on User Experience (UX) Evaluation: A Bibliometric Analysis2020The term user experience (UX) emerged in the early 1990’s. Thenceforth, UX has become a key term for researchers to focus on aspects that go beyond usability and particularly in the field of Human Computer Interaction (HCI). The aim of this study is to analyse the bibliometric aspect of UX evaluation literature from Scopus database whereby 644 papers were extracted. The study utilised publishing or perishing software to collect the data, while VOSviewer was used to visualise the data. Data analysis was also carried out using SPSS and Microsoft Excel. The publication of articles between 2018 and 2019 increased to 117 articles in 2019 and this is the highest publication to date. Most of the publications are from journals and conferences, mainly in English. Based on the analysis of the co-occurrence map of all keywords in the articles published, the keywords frequently used by the authors are user experience (416) and user experience evaluation (155). Most of the research related to UX evaluation was conducted in United States; and the researchers prefer multi-authored publications. The co-authorship map of the journal’s authors showed that V. Roto is one of the dominant co-authorships. Other than that, Arnold P. O. S. Vermeeren is also the most cited author of UX evaluation in Scopus database. This study presents the history of scientific literature in user experience evaluation and will provide guidance for future research.

UX of AI & PersonalizationResearch Papers

Measuring the impact of online personalization - Past, present and futureMarkus Zanker⁎, Laurens Rookb et al. · 2019Research on understanding, developing and assessing personalisation systems is spread over multiple disciplines and builds on methodologies and findings from several different research fields and traditions, such as Artificial Intelligence (AI), Machine Learning (ML), Human–Computer Interaction (HCI), and User Modelling based on (applied) social and cognitive psychology. The fields of AI and ML primarily focus on the optimisation of per- sonalisation applications, and concentrate on creating ever more accurate algorithmic decision makers and prediction models. In the fields of HCI and Information Systems, scholars are primarily interested in the phe- nomena around the use and interaction with personalisation systems, while Cognitive Science (partly) delivers the theoretical underpinnings for the observed effects. The aim and contribution of this work is to put together the pieces about the impact of personalisation and recommendation systems from these different backgrounds in order to formulate a research agenda and provide a perspective on future developments.

UX of AI & PersonalizationResearch Papers

User Experience for Model-Driven Engineering:Future Directions · 2017Since its infancy, Model Driven Engineering (MDE) research has primarily focused on technical issues. Although it is becoming increasingly common for MDE research papers to evaluate their theoretical and practical solutions, extensive usability studies are still uncommon. We observe a scarcity of User eXperience (UX)-related research in the MDE community, and posit that many existing tools and languages have room for improvement with respect to UX [26], [44], [37], where UX is a key focus area in the software development industry. We consider this gap a fundamental problem that needs to be addressed by the community if MDE is to gain widespread use. In this vision paper, we explore how and where UX fits into MDE by considering motivating use cases that revolve around different dimensions of integration: model integration, tool integration, and integration between process and tool support. Based on the literature and our collective experience in research and industrial collaborations, we propose future directions for addressing these challenges.

UX of AI & PersonalizationResearch Papers

Model-based adaptive user interface based on context and user experience evaluationJamil Hussain, Anees Ul Hassan, Hafiz Syed Muhammad Bilal, Rahman Ali, Muhammad Afzal, Shujaat Hussain, Jaehun Bang,Oresti Banos, Sungyoung Lee · 2016Personalized services have greater impact on user experience to effect the level of user satisfaction. Many approaches provide personalized services in the form of an adaptive user interface. The focus of these approaches is lim- ited to specific domains rather than a generalized approach applicable to every domain. In this paper, we proposed a domain and device-independent model-based adaptive user interfacing methodology. Unlike state-of-the-art approaches, the proposed methodology is dependent on the evaluation of user context and user experience (UX). The proposed methodologyisimplementedasanadaptiveUI/UXauthoring (A-UI/UX-A) tool; a system capable of adapting user inter- face based on the utilization of contextual factors, such as user disabilities, environmental factors (e.g. light level, noise level, and location) and device use, at runtime using the adap- tation rules devised for rendering the adapted interface. To validate effectiveness of the proposed A-UI/UX-A tool and methodology, user-centric and statistical evaluation methods are used. The results show that the proposed methodology B Sungyoung Lee [sylee@oslab.khu.ac.kr](mailto:sylee@oslab.khu.ac.kr) Jamil Hussain [jamil@oslab.khu.ac.kr](mailto:jamil@oslab.khu.ac.kr) 1 Department of Computer Science & Engineering, Kyung Hee University (Global Campus), 1732 Deokyoungdae-ro, Giheung-gu, Yongin-si, Gyeonggi-do 446-701, Republic of Korea 2 Quaid-e-Azam College of Commerce, University of Peshawar, Peshawar, Pakistan 3 College of Electronics and Information Engineering, Sejong University, Seoul, South Korea 4 Telemedicine Group, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Postbox 217, 7500 AE Enschede, The Netherlands outperforms the existing approaches in adapting user inter- faces by utilizing the users context and experience.

UX of AI & PersonalizationResearch Papers

User experience evaluation methods: Current state and development needsArnold P.O.S. Vermeeren, Effie Lai-Chong Law, Virpi Roto, Marianna Obrist, Jettie Hoonhout, Kaisa Väänänen-Vainio-Mattila · 2010The recent shift of emphasis to user experience (UX) has rendered it a central focus of product design and evaluation. A multitude of methods for UX design and evaluation exist, but a clear overview of the current state of the available UX evaluation methods is missing. This is partly due to a lack of agreement on the essential characteristics of UX. In this paper, we present the results of our multi-year effort of collecting UX evaluation methods from academia and industry with different approaches such as literature review, workshops, Special Interest Groups sessions and an online survey. We have collected 96 methods and analyzed them, among other criteria, based on the product development phase and the studied period of experience. Our analysis reveals development needs for UX evaluation methods, such as early-stage methods, methods for social and collaborative UX evaluation, establishing practicability and scientific quality, and a deeper understanding of UX. Author Keywords User Experience, Evaluation method, Methodological development needs ACM Classification Keywords H5.2. User Interfaces (D.2.2, H.1.2, I.3.6): Evaluation/methodology

UX of AI & PersonalizationResearch Papers

Research Through Design as a Method for InteractionJohn Zimmerman, Jodi Forlizzi et al. · 2007For years the HCI community has struggled to integrate design in research and practice. While design has gained a strong foothold in practice, it has had much less impact on the HCI research community. In this paper we propose a new model for interaction design research within HCI. Following a research through design approach, designers produce novel integrations of HCI research in an attempt to make the right thing: a product that transforms the world from its current state to a preferred state. This model allows interaction designers to make research contributions based on their strength in addressing under-constrained problems. To formalize this model, we provide a set of four lenses for evaluating the research contribution and a set of three examples to illustrate the benefits of this type of research. Author Keywords design, interaction design, interaction design research, HCI research, research through design, wicked problems, design theory, design method ACM Classification Keywords H5.2. User Interfaces: Theory and methods.

UX of AI & PersonalizationResearch Papers

User experience - A research agendaMarc Hassenzahl, Noam Tractinsky · 2006Over the last decade, ‘user experience’ (UX) became a buzzword in the field of human–computer interaction (HCI) and interaction design. As technology matured, interactive products became not only more useful and usable, but also fashionable, fascinating things to desire. Driven by the impression that a narrow focus on interactive products as tools does not capture the variety and emerging aspects of technology use, practitioners and researchers alike, seem to readily embrace the notion of UX as a viable alternative to traditional HCI. And, indeed, the term promises change and a fresh look, without being too specific about itsdefinite meaning. The present introduction to the special issue on ‘Empirical studies of the user experience’ attempts to give a provisional answer to the question of what is meant by ‘the user experience’. It provides a cursory sketch of UX and how we think UX research will look like in the future. It is not so much meant as a forecast of the future, but as a proposal – a stimulus for further UX research.

UX of AI & PersonalizationResearch Papers

Library and Information Science ResearchMaja Kuhar, Tanja Merˇcun · 2022In the field of digital libraries, research on user experience is sparse, especially in terms of emotions, impressions, and stimulation evoked by interaction with the digital library. Given the many different methods and tools available for assessing user experience, two questionnaires and eye-tracking were explored to see how each can contribute to understanding user experience in digital libraries. An eye-tracking study with 30 participants was carried out using two digital libraries. Analysis of the questionnaires revealed that overall, one digital library was experienced more positively, with the difference most evident in the hedonic quality. The eye-tracking data revealed different gaze patterns in the two digital libraries, with significant difference in measure values particularly on the search boxes. When eye-tracking was combined with the questionnaire data, several corre­ lations were found, indicating that the search box position and the intuitiveness of the homepage had an impact on the user experience.

Emotional DesignResearch Papers

Article Do Products Respond to User Desires? A Case Study. Errors and Successes in the Design Process, under the Umbrella of Emotional Design2020This article introduces a methodological approach to the evaluation of different industrial products according to Norman’s approach and dimensions, focusing on a specific case study. The study also shows different possibilities to guide industrial designers during the design process in order to create products with high emotional value. For those, the case study was done with 330 target specific users, submitting nine prototypes (designed for different targets) to the user experience evaluation and product perception analysis. The evaluated proposals were selected from a total of 45. The results show the visceral, behavioural and reflective levels perceived by those users to whom each product is intended, as well as the target deviation within the design process. In this sense, the emotional response reveals the asymmetric character of perception according to Norman’s dimensions.

Emotional DesignResearch Papers

Emotional Design on User Experience-based Development System2018In UX, user as a center of the process has crucial role in determining the quality of a system. System has broad definition. In this study, system definition restricted to the outcome of information technology (IT) product. So far, there are so many approaches which are involving user as a center of process. Involving user in the UX process is not limited as evaluator in the measurement. Moreover, user research should be conducted deeply aims to excavate all about user deeper. Functionality and usability are two measurements methods which ensure user can experience using system intuitively. In order to excavate intuitive experience, it is required to figure out user deeper. Furthermore, physiological and psychological aspects are mandatory to be discussed. Psychology and physiology theories are related to the processes of designing system. This study aims to conduct argumentative literature review about the emotional design on the user experience (UX). Papers reviewed had been selected and limited related to the problems. Result of this study is proposed methodology. This methodology is proposed aims to gain deeper perspective on user research. Hopefully, this methodology can be considered to strengthen ideas about user mental model theories into system development.

Emotional DesignResearch Papers

The focus of UX research is to design and develop systems that must support usability and user’s affective needs and goals[10-11]. UX research has gained more interest due to limitations of the conventional usability models [4]. UX studies do not only focus on task related aspects but also on affective qualities, sensation, meaning and value of interactive systems, products and services [12-14]. In order to better understand the concept of UX, many frameworks and models are proposed e.g. [11, 14, 15] that include various integrated UX constructs and measures. These frameworks are presented from different perspectives that include interaction-centered, user-centered and system-centered [16, 17]. It is also focused to understand and document different types of experience created while interacting with systems. Experience is described as a constant stream of “self-talk” that occurs while interaction is carried out with products e.g. using instant messaging systems. An experience is described as something that can be articulated e.g. watching a movie and sitting on free fall ride. Co-experience is described as the motions and meanings created together while interacting with products e.g. playing mobile messaging games with friends. UX can be created either positive or negative depending on systems qualities perceived by users [18-20]. It introduces a valid point of interest to research that how positive UX of interactive systems can be created, measured and modeled [19]. Thus, UX is being studied extensively in HCI field to design systems to be more useful, pleasant and attractive [14, 18]. Despite the availability of different frameworks and models, there is still no consensus on the definition of UX [3, 10, 21]. It is argued that UX encompasses various integrated aspects and shares diverse views. The wider scope and incoherent views on UX make it more complex [4, 10]. It presents many challenges such as selecting and validating the core constructs, factors and relevant2006In recent years, the notion of User Experience (UX) has gained a greater attention among HCI researchers in academia and industry. Due to its importance, several frameworks and models have been proposed to design and assess UX of interactive systems. These models guide to improve the design and help to determine the quality of interactive systems, products and services. UX is highly subjective, dynamic, and context dependent; it evolves during the interaction with the system. Different factors collectively influence UX and present a challenging task to define, model, measure and validate it. The less attention is paid to understand and underline these factors; this paper is an attempt to understand and underline the core UX factors based on literature review. These factors make UX more complex, diverse and vague in nature. It is recommended to incorporate the management aspect in UX process that may help to overwhelming the issues of complexity, diversity and vagueness.

Emotional DesignResearch Papers

Design Research on Maker Office Space Based on User ExperienceJiaqi Chi, Jinqi Xu · 2022The maker office space is a new type of office space that has gradually come into everyone’s view since 2014 when the country put forward the concept of “Mass Entrepreneurship and Innovation”. With the continuous development of the country, the era of experience economy comes, people no longer simply need the basic functions of space, but pay more attention to the experience. Therefore, this paper integrates user experience into the design of maker office space to find the demand of users. We analyze the design points of user experience in office space from various aspects, propose the design strategy of user experience in maker office space, and propose innovative thinking and inspiration for the design of maker office space in the future.

HCI & Adaptive InterfacesResearch Papers

Evaluating Grasping Visualizations and Control Modes in a VR GameYuting Ye · 2021A primary goal of the Virtual Reality (VR) community is to build fully immersive and presence-inducing environments with seamless and natural interactions. To reach this goal, researchers are investigating how to best directly use our hands to interact with a virtual environment using hand-tracking. Most studies in this field require participants to perform repetitive tasks. In this paper, we investigate if results of such studies translate into a real application and game-like experience. We designed a virtual escape room in which participants interact with various objects to gather clues and complete puzzles. In a between-subjects study, we examine the effects of two input modalities (controllers vs. hand tracking) and two grasping visualizations (continuously tracked hands vs. virtual hands that disappear when grasping) on ownership, realism, efficiency, enjoyment, and presence.

HCI & Adaptive InterfacesResearch Papers

Measurement of Trust in Automation: A Narrative Review and Reference Guide2021With the rise of automated and autonomous agents, research examining Trust in Automation (TiA) has attracted considerable attention over the last few decades. Trust is a rich and complex construct which has sparked a multitude of measures and approaches to study and understand it. This comprehensive narrative review addresses known methods that have been used to capture TiA. We examined measurements deployed in existing empirical works, categorized those measures into self-report, behavioral, and physiological indices, and examined them within the context of an existing model of trust. The resulting work provides a reference guide for researchers, providing a list of available TiA measurement methods along with the model-derived constructs that they capture including judgments of trustworthiness, trust attitudes, and trusting behaviors. The article concludes with recommendations on how to improve the current state of TiA measurement.

HCI & Adaptive InterfacesResearch Papers

Full-immersion virtual reality for experiential education: An exploratory user experience analysisChristian Schott, Stephen Marshall · 2021Experiential education is widely considered an effective pedagogy to foster learning for our rapidly changing world. Despite this, residential fieldtrips are on the decline. Recent advances in full-immersion virtual reality (VR) technology offer great potential to make situated experiential education, such as fieldtrips, more accessible to educational institutions, however, research on VR technology's effectiveness in this context is lacking. This article documents exploratory action research which examines the effectiveness of full-immersion VR technology for experiential education by adopting a user experience (UX) analytical frame. Six university staff and five students who participated in a trial of a virtual environment developed for sustainable tourism education, discussed their user experience through semi-structured interviews. The UX lens which distinguished between three UX facets during the analysis, *beyond the instrumental, emotion and affect*, *experiential*, serves to identify research areas requiring attention and assists in the technology's improvement prioritisation. Interviews revealed many positive perspectives thus lending support to VR technology's suitability to foster experiential education, however, several negative experiences were also identified; principally motion sickness. The exploratory findings suggest that more research is warranted to more comprehensively examine VR technology's capacity to foster experiential education and locate VR's place in the education landscape.

HCI & Adaptive InterfacesResearch Papers

SENSORY URBANISM AND PLACEMAKING2019Sensory Urbanism is an experimental prototyping project exploring the potential of immersive Virtual Reality (VR) environments to support the incorporation of sensory and intangible aspects of place. The study investigates how sensory exploration of urban places can be integrated into decision making regarding the future of cities. In the past, numerous studies reported various sophisticated ‘livability’ measures, deeming to determine what makes a city a great place to live in. While a part of these measures can be quantified and be represented as text, graphs or images, most of the qualitative aspects of place are inherently abstract and sensory. These aspects have to be experienced to be understood and therefore they are extremely difficult to communicate using conventional representation means. The proposition explored in this study is that the increasing ubiquity of VR and Augmented Reality (AR) technologies can provide new opportunities to engage with the multi-sensory and temporal aspects of urban place. A mixed media approach was adopted, tapping into a temporal dimension as well as visual, aural and kinesthetic range of human senses. The paper reports on the development of the VR sensory urbanism prototype and the initial pilot study that demonstrated the proof-of-concept.

HCI & Adaptive InterfacesResearch Papers

Evaluating user experience and wayfinding behaviour in complex, architectural environments – towards a user-centred approach of building usabilitySaskia Kulig · 2016"Where am I? And how can I get to my destination?" This question can have both a metaphorical sense ("How do I find my way in life?!"), as well as a practical purpose ("How do I find my way around in an unknown building?"). If we are unable to identify our own position in space, and cannot formulate strategies for how we get from where we are to a desired destination, we feel disoriented; perhaps even 'lost'. This is frequently frustrating, especially when we find ourselves travelling longer distances, or when finding one's way takes longer than expected.

HCI & Adaptive InterfacesResearch Papers

INSPIRING ENGAGEMENT THROUGH THE USER EXPERIENCE:Lisa Joy Gumerman · 2014INSPIRING ENGAGEMENT THROUGH THE USER EXPERIENCE: A PROJECT WITH THE FORT COLLINS MUSEUM OF DISCOVERY This project focused on user experience to create a plan for a web application that would increase engagement with the audience of a local museum. With the support of the Fort Collins Museum of Discovery, the researcher performed user experience research to create an interactive feature on the museum's website that can showcase the experiences and history and science content the museum has to offer. The project was conducted using a human-centered design framework and focused on engagement and user experience. Activity theory and the user experience framework drove the method. The process started with five stakeholder interviews, then proceeded to four observation sessions, five personas, and rounds of prototyping and testing. The final deliverable to the Fort Collins Museum of Discovery was a project plan – including specific design, content and technology recommendations resulting from research and development – they can use to implement the web application on their currently existing site to increase engagement and their audience size. ii

HCI & Adaptive InterfacesResearch Papers