Blocks

Blocks are the smallest pieces of svemir: links, images, notes and papers I’ve collected.

642 blocks · 61 channels · 642 nodes

Filtered by themePersonalization & adaptation107 papersclear ✕
Advancements in Context Recognition for Edge Devices and Smart Eyewear: Sensors and ApplicationsFrancesca Palermo, Luca Casciano · 2025Edge devices have garnered significant attention for their ability to process data locally, providing low-latency, context-aware services without the need for extensive reliance on cloud computing. This capability is particularly crucial in context recognition, which enables dynamic adaptation to a user’s real-time environment. Applications range from health monitoring and augmented reality to smart assistance and social interaction analysis. Among edge devices, smart eyewear has emerged as a promising platform for context recognition due to its ability to unobtrusively capture rich, multi-modal sensor data. However, the deployment of context-aware systems on such devices presents unique challenges, including real- time processing, energy efficiency, sensor fusion, and noise management. This manuscript provides a comprehensive survey of context recognition in edge devices, with a specific emphasis on smart eyewear. It reviews the state-of-the-art sensors and applications for context inference. Furthermore, the paper discusses key challenges in achieving reliable, low-latency context recognition while addressing energy and computational constraints. By synthesizing advancements and identifying gaps, this work aims to guide the development of more robust and efficient solutions for context recognition in edge computing. INDEX TERMS Context recognition, edge computing, smarteyewear, wearable technology.
Identifying Hand-based Input Preference Based on Wearable EEGKaining Zhang∗ · 2024Understanding user input preference can improve the user experi- ence, however automatically determining preference can be diffi- cult. In this paper, we designed an EEG-based method for directly evaluating hand-based input preference for touch and mid-air ges- tures on a smartwatch. We conducted a two-phase experiment, recording EEG data from 18 participants as they performed ges- tures and captured their ratings (Phase 1) and preference choices (Phase 2) for each gesture. Our analysis uncovered distinct EEG patterns between preferred and non-preferred gestures, including significant differences in Power Spectral Density (PSD), Coherence (Coh), and Sample Entropy (SE) features. When participants en- gaged with their preferred input gestures, we identified decreased brain activity (PSD) in the central and occipital regions, reduced brain connectivity (Coh) in the delta and alpha bands, and increased brain complexity (SE) in multiple sizes. These insights offer the potential to develop rapid detection of user intent for interactive computing devices by analysing brain signals. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. AHs 2024, April 04–06, 2024, Melbourne, VIC, Australia © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM. ACM ISBN 979-8-4007-0980-7/24/04 https://doi.org/10.1145/3652920.3653028 CCS CONCEPTS • Human-centered computing →User studies; Gestural input; Laboratory experiments.
Recommendations user interface in web-based e-commerce systemsOleksandr Yeroshkin, Janusz Sobecki · 2024In the world of dynamic e-commerce, competition is fierce, and the ability to attract and retain customers is becoming crucial. In this reality, adaptive user interfaces (UI) play an important role, allowing e-commerce platforms to personalize the shopping experience to better understand and meet customer needs. When combined with advanced artificial intelligence (AI) technologies, adaptive UI can bring revolutionary changes to the way customers interact with e-commerce platforms. In this article, we will discuss how AI can be used to design and improve adaptive user interfaces in e-commerce systems, and what benefits can result from this combination. © 2024 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license ([https://creativecommons.org/licenses/by-nc-nd/4.0](https://creativecommons.org/licenses/by-nc-nd/4.0)) Peer-review under responsibility of the scientific committee of the 28th International Conference on Knowledge Based and Intelligent information and Engineering Systems Oleksandr Yeroshkin et al. / Procedia Computer Science 246 (2024) 2874–2881 2875 tion of an experimental approach in a controlled environment. During the implementation and verification phases, we will be able to generate alternative solutions and evaluate them according to the UX and/or conversion requirements. The paper is structured as follows. In the second section, the state of the art is presented. Then, in the following section, an example of a commercial system whose user interface will be adapted is given. In the fourth section, the proposed solution of adapted UI based on AI is described. In the final section, we summarize the paper and give some information on the proposed future work. 2. State of the art In the beginning, UI recommendation services did not use artificial intelligence methods [12]. According to Baraglia [4] and Kopel [10], mainly traditional approaches were used at that time. However, currently we are dealing with solutions that intensively use various AI algorithms. Automating user interface optimization can be achieved using a variety of techniques based on both traditional ap- proaches and AI and machine learning (ML) algorithms. When it comes to optimizing user experience in e-commerce, there are three approaches: adaptable, semi-adaptive, and fully adaptive [1]. The first involves manual adjustment by a user or expert according to their usage criteria [18]. The second involves manual adjustment supported by system recommendations which is a kind of evol
Predictive Analytics for Website User BehaviorPawan Vankhede · 2024This study examines the application of predictive analytics to user behavior analysis on websites, with a particular emphasis on a dataset of customer behavior from e-commerce. To forecast behavioral patterns, the study will apply the random forest method. Additionally, exploratory data analysis (EDA) will be carried out to extract insights from the dataset. The dataset employed in this study includes a variety of factors, such as purchase history, browsing habits, and consumer demographics, among other pertinent data. The research attempts to derive useful insights that can improve the comprehension and prediction of user behavior on the website by utilizing predictive analytics approaches. In this study, the random forest algorithm which is well-known for its capacity to manage intricate datasets and generate precise predictions is employed. The method builds several decision trees and combines their predictions to produce more reliable and accurate outcomes by utilizing ensemble learning. Predicting different aspects of user behavior, including browsing patterns, chance of making a purchase, and customer segmentation, is the aim. When paired with the insights from EDA, the outcomes of the behavioral analysis prediction made with the random forest algorithm can provide e-commerce companies with useful data. Gaining insight into user behavior can help with customer engagement, website design optimization, personalization, and overall user experience enhancement.
Harnessing AI potential in E-Commerce: improving user engagement and sales through deep learning-based product recommendationsZhang · 2024Artificial intelligence (AI) has become a game-changing influence in e-commerce, reshaping the way businesses inter­ act with customers and increasing operational efficiency. In today’s digital era, AI technologies are being progressively embedded into e-commerce platforms to enhance the user experience, improve processes, and drive business growth. One of the primary areas where AI demonstrates its potential is in personalized product recommendations. This study explores the development of AI-driven recommendations regarding product design, sales, and customer experience in e-commerce environments. The research employs a quantitative approach to explore how AI technologies can enhance various facets of online retail. Using purposive sampling, 439 consumers and 356 sellers from diverse regions of China participated in an online survey designed to gather insights into their interactions with AI-driven recommendations. Data analysis was rigorously conducted using Lisrel 10.20 and Smart PLS 3 software, focusing on validating hypotheses related to AI’s influence on consumer behavior and business outcomes. Key findings include AI’s significant role in boosting productiv­ ity, enhancing sales figures, and enriching consumer experiences through personalized recommendations. This research provides a deeper insight into AI’s potential in e-commerce and provides recommendations for businesses focused on using AI technology to increase user engagement and increase sales in digital marketing.
Collaborative Filtering and Recommendation Algorithm for Artificial Intelligence Live Streaming E-Commerce Platforms Based on Big DataChen · 2024With the development of the Internet and mobile Internet, live streaming e-commerce has become an emerging e-commerce force. However, traditional recommendation algorithms have shortcomings in terms of accuracy and personalization of recommendation results, and more intelligent and personalized recommendation algorithms need to be applied. This article aimed to achieve personalized product recommendations and enhance the shopping experience of users by analyzing their historical behavioral data, real-time interests and needs, combined with big data and artificial intelligence technology. The collaborative filtering recommendation algorithm based on live streaming had an average recommendation accuracy of over 80% for user groups 1, 2, and 3. The research results of this article had important practical significance for promoting the healthy development of live streaming e-commerce platforms, improving user experience, and enhancing platform competitiveness. © 2024 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license ([https://creativecommons.org/licenses/by-nc-nd/4.0](https://creativecommons.org/licenses/by-nc-nd/4.0)) Peer-review under responsibility of the scientific committee of the 11th International Conference on Applications and Techniques in Cyber Intelligence Yu’e Chen et al. / Procedia Computer Science 247 (2024) 826–833 827 and loyalty to the platform, but also promotes user purchasing behavior, increases purchase conversion rates, and enhances order value. This article analyzes the current application status of traditional recommendation algorithms and big data artificial intelligence in the e-commerce field, points out the shortcomings and areas for improvement of existing methods, and proposes methods such as user collaborative filtering and live streaming collaborative filtering to improve recommendation accuracy. On this basis, an in-depth analysis and exploration of collaborative filtering and recommendation algorithms for intelligent live streaming e-commerce platforms based on big data is conducted. 2. Related Works A large number of customers use traditional e-commerce portal websites, which lack product quality assurance. Rashidin Md Salamun used the status quo bias theory to study customer retention behavior on e-commerce platforms. The research findings can help managers and policy makers develop new policies to better serve customers [1]. Nichifor Eliza aimed to study the impact of using artificial intelligence through chatbots on the con
Human-Centered AI: Enhancing User Interaction with Intelligent SystemsGalhenage Gayan Sudesh Suranga Perer · 2024This research examines Human- Centered AI (HCAI) and its contribution to user involvement and user experience with intelligent systems in the healthcare, finance, and education industries. HCAI focuses on deploying AI in a fashion that considers human abilities, values, and emotions in a way that enhances convenience, adaptability, and reliability. The study adopts a qualitative and quantitative mixed methodology in conducting surveys and interviews with users and AI developers examining the effects of human- centered design attributes explanation and user control on user satisfaction. The results imply that such systems of AI which follow the principles of human-centered design have more acceptance and endorsement among users. In particular, participants stressed the need for effective articulation of decision-making processes by AI tools and provision for some degree of manual control over the tools. At the same time, the analysis has uncovered the existence of persistent ethical problems, such as bias, privacy, reliability of AI systems, which need to be addressed further. According to the findings, the application of the HCAI approach can greatly boost the experience and confidence of users in using AI devices. Practical implications are related to the go and bias justice, implementing and enhancing information on explainability, feedback, privacy and integrated ethics into the systems. In this paper, we present additional development for the application of ethical artificial intelligence. Inde Term — Adaptability, Explainability, Human-Centered AI, Interaction Design, Personalization, Transparency, Trust, User Experience, Usability
Article Functional Framework for Multivariant E-Commerce User InterfacesAdam Wasilewski · 2024Modern e-businesses heavily rely on advanced data analytics for product recommendations. However, there are still untapped opportunities to enhance user interfaces. Currently, online stores offer a single-page version to all customers, overlooking individual characteristics. This paper aims to identify the essential components and present a framework for enabling multiple e-commerce user interfaces. It also seeks to address challenges associated with personalized e-commerce user interfaces. The methodology includes detailing the framework for serving diverse e-commerce user interfaces and presenting pilot implementation results. Key components, particularly the role of algorithms in personalizing the user experience, are outlined. The results demonstrate promising outcomes for the implementation of the pilot solution, which caters to various e-commerce user interfaces. User characteristics support multivariant websites, with algorithms facilitating continuous learning. Newly proposed metrics effectively measure changes in user behavior resulting from different interface deployments. This paper underscores the central role of personalized e-commerce user interfaces in optimizing online store efficiency. The framework, supported by machine learning algorithms, showcases the feasibility and benefits of different page versions. The identified components, challenges, and proposed metrics contribute to a comprehensive solution and set the stage for further development of personalized e-commerce interfaces.
A personalized product recommendation model in e-commerce based on retrieval strategyNguyen · 2024In recent years, online shopping is one of the routine parts in people’s life. It is convenient and takes less effort to purchase it. Regarding the increasing revolution of e-commerce businesses, recommendation engine plays a crucial role in them. Recommendation engines are very popular and easy to implement to their platform nowadays. Due to the extremely high competition of e-commerce businesses, the operation needs to integrate the recommender wisely. This study presents a comprehensive approach to improving user experience and engagement on e-commerce platforms through the implementation of an implicit personalized product recom­ mendation engine. Collaborating with the H&M Group, the research combines the strength of each recom­ mending algorithms which are collaborative filtering, popularity, and Bayesian personalized ranking to develop a robust recommendation system. By leveraging a retrieval strategy that combines multiple algorithmic tech­ niques and evaluating candidates using machine learning models which comprise LightGBM and Deep Neural Network, the study achieves promising results. The authors utilize two popular technical metrics to evaluate their models which are mean average precision at K candidates (MAP@K) and mean average recall at K candidates (MAR@K). The empirical result indicates that the LightGBM model has remarkable performance than Deep Neural Network model, which are 0.06 versus 0.02 respectively in MAP@K and 0.03 versus 0.01 respectively in MAR@K when both recommending ways is at 50 items. Overall, this research contributes a novel framework that addresses the challenges of analyzing large-scale data, cold-start problems, and personalization, thereby enhancing the user experience, and driving sales on e-commerce platforms.
SituationAdapt: Contextual UI Optimization in Mixed Reality with Situation Awareness via LLM ReasoningZhipeng Li, Christoph Gebhardt et al. · 2024Mixed Reality is increasingly used in mobile settings beyond con­ trolled home and ofce spaces. This mobility introduces the need for user interface layouts that adapt to varying contexts. However, existing adaptive systems are designed only for static environments. In this paper, we introduce SituationAdapt, a system that adjusts Mixed Reality UIs to real-world surroundings by considering envi­ ronmental and social cues in shared settings. Our system consists of perception, reasoning, and optimization modules for UI adaptation. Our perception module identifes objects and individuals around the user, while our reasoning module leverages a Vision-and-Language Model to assess the placement of interactive UI elements. This en­ sures that adapted layouts do not obstruct relevant environmental cues or interfere with social norms. Our optimization module then generates Mixed Reality interfaces that account for these consid­ erations as well as temporal constraints. For evaluation, we frst validate our reasoning module’s capability of assessing UI contexts in comparison to human expert users. In an online user study, we then establish SituationAdapt’s capability of producing context- aware layouts for Mixed Reality, where it outperformed previous adaptive layout methods. We conclude with a series of applications and scenarios to demonstrate SituationAdapt’s versatility. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for proft or commercial advantage and that copies bear this notice and the full citation on the frst page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specifc permission and/or a fee. Request permissions from permissions@acm.org. UIST ’24, October 13–16, 2024, Pittsburgh, PA, USA © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM. ACM ISBN 979-8-4007-0628-8/24/10 https://doi.org/10.1145/3654777.3676470 CCS CONCEPTS • Human-centered computing → Mixed / augmented reality; Virtual reality; Interactive systems and tools.
Real-Time Personalized User Interface Adaptation Using Reinforcement LearningAbdulrahman Khamaj, Abdulelah M. Ali · 2024Developing a dynamic, personalized user interface that changes in real-time in response to user behavior is the goal. This paper supplies a modern method to beautify consumers enjoy using Reinforcement Learning (RL) and a Deep Q Network (DQN). Through support examination, the task objectives are to upgrade buyer connections and increment commitment, delight, and undertaking of consummation rates. Users who utilize traditional user interfaces get a common experience because they’re impersonal and unflexible. The potential for higher engagement and happiness levels is limited in the absence of real-time changes based on individual preferences and behaviors. To overcome this problem, the study suggests a cunning technique for a getting-to-comprehend layout that may constantly analyze and modify patron communications. This evaluation is new as it provides a blended RL and DQN framework that modifies person interfaces grade by grade. Dissimilar to conventional methodologies, the proposed form adjusts the utilization of well-known, over-the-top prize moves with the development of the most recent ones through an investigation double-dealing system. EventType, contentId, personId, sensorId, and timestamp are instances of timestamped insights handles that give a thorough skill of client conduct and license planned and nuanced changes.
CulturAI: Exploring Mixed Reality Art Exhibitions with Large Language Models for Personalized Immersive ExperiencesNicolas Constantinides · 2024Mixed Reality (MR) technologies have transformed the way in which we interact and engage with digital content, offering immer- sive experiences that blend the physical and virtual worlds. Over the past years, there has been increasing interest in employing Artificial Intelligence (AI) technologies to improve user experience and trustworthiness in cultural contexts. However, the integration of Large Language Models (LLMs) into MR applications within the Cultural Heritage (CH) domain is relatively underexplored. In this work, we present an investigation into the integration of LLMs within MR environments, focusing on the context of virtual art exhi- bitions. We implemented a HoloLens MR application, which enables users to explore artworks while interacting with an LLM through voice. To evaluate the user experience and perceived trustworthi- ness of individuals engaging with an LLM-based virtual art guide, we adopted a between-subject study design, in which participants were randomly assigned to either the LLM-based version or a con- trol group using conventional interaction methods. The LLM-based version allows users to pose inquiries about the artwork displayed, ranging from details about the creator to information about the artwork’s origin and historical significance. This paper presents the technical aspects of integrating LLMs within MR applications and evaluates the user experience and perceived trustworthiness of this approach in enhancing the exploration of virtual art exhibitions. Results of an initial evaluation provide evidence about the positive aspect of integrating LLMs in MR applications. Findings of this work contribute to the advancement of MR technologies for the development of future interactive personalized art experiences. CCS CONCEPTS • Human-centered computing →Mixed / augmented reality; User studies; • Computing methodologies →Artificial intelligence. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s). UMAP Adjunct ’24, July 01–04, 2024, Cagliari, Italy © 2024 Copyright held by the owner/author(s). ACM ISBN 979-8-4007-0466-6/24/07 https://doi.org/10.1145/3631700.3664874
MineXR: Mining Personalized Extended Reality InterfacesHyunsung Cho · 2024Extended Reality (XR) interfaces offer engaging user experiences, but their effective design requires a nuanced understanding of user behavior and preferences. This knowledge is challenging to obtain without the widespread adoption of XR devices. We intro­ duce MineXR, a design mining workflow and data analysis platform for collecting and analyzing personalized XR user interaction and This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License. CHI ’24, May 11–16, 2024, Honolulu, HI, USA © 2024 Copyright held by the owner/author(s). ACM ISBN 979-8-4007-0330-0/24/05 https://doi.org/10.1145/3613904.3642394 experience data. MineXR enables elicitation of personalized in­ terfaces from participants of a data collection: for any particular context, participants create interface elements using application screenshots from their own smartphone, place them in the envi­ ronment, and simultaneously preview the resulting XR layout on a headset. Using MineXR, we contribute a dataset of personalized XR interfaces collected from 31 participants, consisting of 695 XR widgets created from 178 unique applications. We provide insights for XR widget functionalities, categories, clusters, UI element types, and placement. Our open-source tools and data support researchers and designers in developing future XR interfaces. CCS CONCEPTS • Human-centered computing → Mixed / augmented reality; Systems and tools for interaction design. CHI ’24, May 11–16, 2024, Honolulu, HI, USA Cho et al.
Next-Gen Human-Computer Interaction: A HybridRavindra Changal · 2024In the rapidly evolving landscape of human- computer interaction (HCI), the demand for personalized and adaptive user experiences has grown exponentially. To meet this demand, Research propose a groundbreaking approach leveraging the fusion of Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN) architectures. This hybrid LSTM-CNN model is designed to enhance adaptability, responsiveness, and user engagement across various interactive platforms.Traditional HCI models often struggle to effectively capture the dynamic nature of user behavior and preferences. By integrating LSTM and CNN, This model achieves a synergistic blend of temporal and spatial feature extraction capabilities. The LSTM component excels in capturing sequential dependencies and long-term patterns, enabling the system to learn from past interactions and anticipate future user actions. Meanwhile, the CNN component efficiently processes spatial information, extracting meaningful features from multimedia inputs such as images, videos, and text.One of the key strengths of proposed model is its adaptability to diverse user contexts and preferences. Through continuous learning and adaptation, it dynamically adjusts its interface, content, and interaction patterns to match the evolving needs and preferences of individual users. Moreover, the hybrid architecture enables real-time processing of multimodal inputs, facilitating seamless interaction across a wide range of devices and platforms.In experimental evaluations, Hybrid LSTM-CNN model demonstrated superior performance compared to baseline methods in terms of user satisfaction, engagement, and task completion rates. Furthermore, it exhibited robustness and scalability, making it suitable for deployment in real-world applications across domains such as e-commerce, entertainment, education, and healthcare.In summary, The proposed approach represents a significant advancement in HCI research, paving the way for next-generation interactive systems that deliver highly adaptive and personalized user experiences.
An empirical study of AI techniques in mobile applications ✩Haoye Tian b, Zhijie Wang c et al. · 2024The integration of artificial intelligence (AI) into mobile applications has significantly transformed various domains, enhancing user experiences and providing personalized services through advanced machine learning (ML) and deep learning (DL) technologies. AI-driven mobile apps typically refer to applications that leverage ML/DL technologies to perform key tasks such as image recognition and natural language processing. Despite existing research exploring how mobile apps exploit AI techniques, they have the following main limitations: (1) Most existing studies focus on DL-based apps, with limited research on ML-based apps. (2) Existing research typically focuses on investigating the apps and the technologies utilized in the apps, lacking user-level analysis. (3) The number of apps studied is limited, with only 1,000 to 2,000 ML/DL apps identified after filtering. To fill the gap, in this paper, we conducted the most extensive empirical study on AI applications, exploring on-device ML apps, on-device DL apps, and AI service-supported (cloud-based) apps. Our study encompasses 56,682 real- world AI applications, focusing on three crucial perspectives: (1) Application analysis, where we analyze the popularity of AI apps and investigate the update states of AI apps; (2) Framework and model analysis, where we analyze AI framework usage and AI model protection; (3) User analysis, where we examine user privacy protection and user review attitudes. Our study has strong implications for AI app developers, users, and AI R&D. On one hand, our findings highlight the growing trend of AI integration in mobile applications, demonstrating the widespread adoption of various AI frameworks and models. On the other hand, our findings emphasize the need for robust model protection to enhance app security. Additionally, our study highlights the importance of user privacy and presents user attitudes towards the AI technologies utilized in current AI apps. We provide our AI app dataset (currently the most extensive AI app dataset) as an open-source resource for future research on AI technologies utilized in mobile applications.
One Size Does Not Fit All: Multivariant User Interface Personalization in E-CommerceAdam Wasilewski · 2024One of the most visible manifestations of the changes brought about by the digitization of everyday life is undoubtedly the spread of electronic commerce. It is difficult to think of the digital economy without considering transactions through electronic channels. In turn, the user interface (UI) is the key to e- commerce, as it is usually the first and primary point of contact between business and consumer. A key trend in e-commerce is the personalization of communications, which can improve the user experience, increase customer satisfaction and deliver tangible business benefits. Today, it is technically possible to base this personalization on an analysis of user behavior using artificial intelligence and machine learning techniques. A common form of personalization in e-commerce is the use of product recommendation systems, but the user interface can be tailored much more extensively. The approach described and discussed in this paper is a multivariant user interface that allows the layout to be tailored to the characteristics, attributes, and behaviors of customer groups generated using machine learning techniques. The results of the research carried out make it possible to verify the practicality of the proposed solution and provide an opportunity to identify development directions that take into account the potential of artificial intelligence. The application of the concept described in the paper is broad, covering all aspects of e-commerce design that require compromises when serving a single UI variant, but allow flexibility and customization for different users when serving a multivariant UI. INDEX TERMS Artificial intelligence, e-commerce, machine learning, personalization, user interface.
A Systematic Review of the Impact of Auxiliary Information on Recommender SystemsMatthew Ayemowa · 2024Recommender systems are essential tools that provide personalized user experiences across various domains such as e-commerce, entertainment, social media, education and content streaming. The integration of auxiliary information, including user demographics, item attributes, and contextual data has shown significant promise in enhancing the performance of recommender systems. This systematic review investigates the impact of incorporating auxiliary information into various types of recommender systems, examining recent advancements, methodologies, datasets, evaluation metrics, and to equally examine its significance on generative artificial intelligence. Similarly, five (5) reputable online databases were used to identify the relevant studies for answering our research questions. To obtain effective results of our findings, we focus more on the recent studies published between (2019 - June 2024) to ensure that of our findings up-to-date. After filtering the selected primary papers that solely focused on auxiliary information recommender systems a total of 37 papers were identified and analyzed. Our analysis shows the most utilized datasets, metrics, models, addressed issues and future works. Research limitations and future scope are also highlighted to assist researchers and practitioners for their future studies. INDEX TERMS Recommender systems, auxiliary information, data sparsity, cold start problem.
Emoticontrol : Emotions-based Control of User-Interfaces AdaptationsKARTHIK VAIDHYANATHAN, IIIT Hyderaba · 2023Emotions are integral to human nature, and their existence, duration, and evolution could lead to specific behaviors. If emotions and behaviors are ignored in the design of socio-technical systems, they will fail or cause discomfort. User interfaces (UIs) are elements of interactive systems able to trigger or moderate emotions. UIs are increasingly designed adaptive to users' various characteristics, intending to improve their satisfaction, performance, and decisions. However, previous adaptation supervising approaches are not effectively adopted in real life since they neglect the dynamic behaviors of humans or systems. This paper proposes Emoticontrol, a quality-driven approach to adapting UIs to users' emotions using Model-Free Reinforcement Learning (MFRL). The approach aims to maximize applying the essential adaptations and minimize the unnecessary ones towards users' enhanced quality of experience (QoE). The approach also considers improving the software quality of service (QoS) by designing software architecture alternatives. We chose emergency evacuation training as a suitable evaluation domain since people experience intense emotions in potential danger. We performed experiments with a mobile application we developed that acts as a recommender system in evacuation training. By taking contextual input of the users' basic emotions from face recognition, the application intelligently adapts its UI to quickly lead people to safe areas while keeping them emotionally controlled. We consider software performance a crucial QoS; thus, we adopt and test architectures that facilitate an acceptable level of performance. The evaluation process confirms the efficiency and effectiveness of the MFRL in iterations, as well as compared to other UI adaptation techniques.
Human-Centered Artificial Intelligence: Designing for User Empowerment and Ethical ConsiderationsUsman Ahmad Usmani · 2023Human-Centered Artificial Intelligence (AI) focuses on AI systems prioritizing user empowerment and ethical considerations. We explore the importance of user- centric design principles and ethical guidelines in creating AI technologies that enhance user experiences and align with human values. It emphasizes user empowerment through personalized experiences and explainable AI, fostering trust and user agency. Ethical considerations, including fairness, transparency, accountability, and privacy protection, are addressed to ensure AI systems respect human rights and avoid biases. Effective human AI collaboration is emphasized, promoting shared decision-making and user control. By involving interdisciplinary collaboration, this research contributes to advancing human-centered AI, providing practical recommendations for designing AI systems that enhance user experiences, promote user empowerment, and adhere to ethical standards. It emphasizes the harmonious coexistence between humans and AI, enhancing well-being and autonomy and creating a future where AI technologies benefit humanity. Overall, this research highlights the significance of human-centered AI in creating a positive impact. By centering on users' needs and values, AI systems can be designed to empower individuals and enhance their experiences. Ethical considerations are crucial to ensure fairness and transparency. With effective collaboration between humans and AI, we can harness the potential of AI to create a future that aligns with human aspirations and promotes societal well-being.
Adaptive user interface for workflow-ERP systemMarcin Smereka, Grzegorz Kołaczek et al. · 2023In this paper, the problem of user interface recommendations for workflow management systems is investigated. The user interface is automatically adapted using a software tool based on content-based filtering. This tool collects information about the way processes are carried out in an organization, analyzes and processes the data, and recommends the next action to the user in order to increase efficiency, facilitate training, and improve decision-making. The proposed tool was verified in the real environment within three organizations. For each organization, after at least several weeks of learning, the tool was able to offer suggestions that were selected by real users. 2382 Marcin Smereka et al. / Procedia Computer Science 225 (2023) 2381–2391 The aim of the project carried out by Sente was to investigate the possibility of automatically analyzing user behavior in business software (especially ERP class) in order to automatically adapt the way processes are carried out to these behaviors using content-based filtering algorithms. A tool that would be able to collect information about the way processes are carried out in an organization, analyze and process the collected data and recommend the next action to the user could increase the efficiency of using the ERP system, and facilitate training and decision-making processes. 2. State of the art According to Kobsa [7], proper user model selection should be the starting point when designing the user inter- face. However, with the growing number of potential users, particularly in web-based systems, the differences among them are also increasing. Consequently, the user model is becoming more complex, resulting in a highly differentiated proposed user interface, such as in interaction styles. [14]. The user differences may reflex their demographical, psy- chological, sociological, and anthropological user characteristics, which have an influence on the users’ information needs, interaction habits, and potential limitations of the interaction systems usage. The consequence of these differ- ences is causing difficulties in modeling these users in the standard way [7], in a result more sophisticated solutions have been proposed, for example, one enhanced with the application of ontologies [12]. The ontologies may be used to enhance information systems design and development on at least several different levels, such as database integration, business logic, or Graphical User Interfaces (GUI) [8]. User interfaces have been also ado
User-Driven Constraints for Layout Optimisation in Augmented RealityAziz Niyazov · 2023Automatic layout optimisation allows users to arrange augmented reality content in the real-world environment without the need for tedious manual interactions. This optimisation is often based on modelling the intended content placement as constraints, defined as cost functions. Then, applying a cost minimization algorithm leads to a desirable placement. However, such an approach is lim- ited by the lack of user control over the optimisation results. In this paper we explore the concept of user-driven constraints for augmented reality layout optimisation. With our approach users can define and set up their own constraints directly within the real-world environment. We first present a design space composed of three dimensions: the constraints, the regions of interest and the constraint parameters. Then we explore which input gestures can be employed to define the user-driven constraints of our design space through a user elicitation study. Using the results of the study, we propose a holistic system design and implementation demon- strating our user-driven constraints, which we evaluate in a final user study where participants had to create several constraints at the same time to arrange a set of virtual contents. CCS CONCEPTS • Human-centered computing →Interactive systems and tools. ACM Reference Format: Aziz Niyazov, Barrett Ens, Kadek Ananta Satriadi, Nicolas Mellado, Loïc Barthe, Tim Dwyer, and Marcos Serrano. 2023. User-Driven Constraints Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. CHI ’23, April 23–28, 2023, Hamburg, Germany © 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM. ACM ISBN 978-1-4503-9421-5/23/04...$15.00 https://doi.org/10.1145/3544548.3580873 for Layout Optimisation in Augmented Reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 23–28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 16 pages. https: //doi.org/10.1145/3544
User Interface and Architecture Adaption Based onMahyar T. Moghaddam∗, Mina Alipour et al. · 2023This paper shows how emotions and behavior considerations in socio-technical systems lead to high-quality self-adaptations, both at application and architecture levels. In our approach, an interactive control system assesses the reconfigurations that enhance the quality of service (QoS) while considering humans’ quality of experience (QoE). We use a Model-Free Reinforcement Learning (MFRL) approach to self- adapt user interfaces (UIs) to users’ emotions. The approach aims to maximize applying the essential adaptations and minimize the unnecessary ones towards users’ QoE, i.e., task comple- tion and satisfaction. If the control system detects a drop in QoS in emotion-based adaptations or other functions, another level of adaptation reconfigures the architecture towards better quality. We chose emergency evacuation training as a suitable evaluation domain since people experience intense emotions in such potential danger. We performed experiments with a mobile application we developed that acts as a recommender system in emergency training. By taking contextual input of the users’ basic emotions from face recognition and their mobility behavior, the application intelligently adapts its UI to quickly lead people to safe areas while keeping them emotionally stable. In addition to UI adaptation, the system is capable of architecture-level adaptations to decrease response time if required. The evaluation process confirms the efficiency of the MFRL in iterations, as well as compared to other possible UI adaptation techniques. The emerging results also show that architecture-level adaptations positively impact the system performance and users’ emotions and performance. Index Terms—Software Architecture, Emotions, Behaviors, Reinforcement Learning, User Interface, Emergency.
InteractionAdapt: Interaction-driven Workspace Adaptation for Situated Virtual Reality EnvironmentsYi Fei Cheng · 2023Virtual Reality (VR) has the potential to transform how we work: it enables fexible and personalized workspaces beyond what is possi­ ble in the physical world. However, while most VR applications are designed to operate in a single empty physical space, work environ­ ments are often populated with real-world objects and increasingly diverse due to the growing amount of work in mobile scenarios. In this paper, we present InteractionAdapt, an optimization-based method for adapting VR workspaces for situated use in varying everyday physical environments, allowing VR users to transition between real-world settings while retaining most of their personal­ ized VR environment for efcient interaction to ensure temporal consistency and visibility. InteractionAdapt leverages physical afor­ dances in the real world to optimize UI elements for the respectively most suitable input technique, including on-surface touch, mid-air touch and pinch, and cursor control. Our optimization term thereby models the trade-of across these interaction techniques based on Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for proft or commercial advantage and that copies bear this notice and the full citation on the frst page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specifc permission and/or a fee. Request permissions from permissions@acm.org. UIST ’23, October 29–November 01, 2023, San Francisco, CA, USA © 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM. ACM ISBN 979-8-4007-0132-0/23/10...$15.00 https://doi.org/10.1145/3586183.3606717 experimental fndings of 3D interaction in situated physical envi­ ronments. Our two evaluations of InteractionAdapt in a selection task and a travel planning task established its capability of support­ ing efcient interaction, during which it produced adapted layouts that participants preferred to several baselines. We further show­ case the versatility of our approach through applications that cover a wide range of use cases. CCS CONCEPTS • Human-centered computing → Mixed / augmented reality; Virtual reality; User interface management systems.
ScalAR: Authoring Semantically Adaptive Augmented Reality Experiences in Virtual RealityXun Qian · 2022Augmented Reality (AR) experiences tightly associate virtual con- tents with environmental entities. However, the dissimilarity of different environments limits the adaptive AR content behaviors under large-scale deployment. We propose ScalAR, an integrated workflow enabling designers to author semantically adaptive AR ex- periences in Virtual Reality (VR). First, potential AR consumers col- lect local scenes with a semantic understanding technique. ScalAR then synthesizes numerous similar scenes. In VR, a designer au- thors the AR contents’ semantic associations and validates the design while being immersed in the provided scenes. We adopt a decision-tree-based algorithm to fit the designer’s demonstrations as a semantic adaptation model to deploy the authored AR expe- rience in a physical scene. We further showcase two application scenarios authored by ScalAR and conduct a two-session user study where the quantitative results prove the accuracy of the AR content rendering and the qualitative results show the usability of ScalAR. This work is licensed under a Creative Commons Attribution International 4.0 License. CHI ’22, April 29-May 5, 2022, New Orleans, LA, USA © 2022 Copyright held by the owner/author(s). ACM ISBN 978-1-4503-9157-3/22/04. https://doi.org/10.1145/3491102.3517665 CCS CONCEPTS • Human-centered computing →Mixed / augmented reality; Virtual reality; Interactive systems and tools.
Real-Time Adaptation of Context-Aware Intelligent User Interfaces, for Enhanced Situational AwarenessZinova Stefanidi, George Margetis · 2022In this work, a novel computational approach for the dynamic adaptation of User Inter- faces (UIs) is proposed, which aims at enhancing the Situational Awareness (SA) of users by leveraging the current context and providing the most useful information, in an optimal and efficient manner. By combining Ontology modeling and reasoning with Combinatorial Optimization, the system decides what information to present, when to present it, where to visualize it in the display - and how, taking into consideration contextual factors as well as placement constraints. The main objective of the proposed approach is to optimize the SA associated with the displayed UI at run-time, while avoiding information overload and induced stress. In the context of this work, we have deployed our computational approach to the use case of an Augmented Reality (AR) system for Law Enforcement Agents (LEAs). To explore the benefits and limitations of the developed system, two evaluations have been conducted. The first one was an expert-based evaluation with LEAs and User Experience (UX) experts, assessing the appropriateness of the system’s decisions. The second one was a user-based evaluation involving LEAs from different agencies, estimating the SA, the mental workload and the overall UX associated with the system, through an AR simulation. The results indicate that the system enhances SA, and while not imposing workload, it provides an overall positive UX. INDEX TERMS Adaptive user interfaces, augmented reality, context-awareness, intelligent user interfaces, ontology modeling, ontology reasoning, situational awareness, user interface optimization.
AUIT – the Adaptive User Interfaces Toolkit for Designing XR ApplicationsAnna Maria Feit · 2022Adaptive user interfaces can improve experiences in Extended Re­ ality (XR) applications by adapting interface elements according to the user’s context. Although extensive work explores diferent adaptation policies, XR creators often struggle with their imple­ mentation, which involves laborious manual scripting. The few available tools are underdeveloped for realistic XR settings where it is often necessary to consider conficting aspects that afect an adap­ tation. We fll this gap by presenting AUIT, a toolkit that facilitates the design of optimization-based adaptation policies. AUIT allows creators to fexibly combine policies that address common objec­ tives in XR applications, such as element reachability, visibility, and consistency. Instead of using rules or scripts, specifying adaptation policies via adaptation objectives simplifes the design process and This work is licensed under a Creative Commons Attribution International 4.0 License. UIST ’22, October 29-November 2, 2022, Bend, OR, USA © 2022 Copyright held by the owner/author(s). ACM ISBN 978-1-4503-9320-1/22/10. https://doi.org/10.1145/3526113.3545651 enables creative exploration of adaptations. After creators decide which adaptation objectives to use, a multi-objective solver fnds appropriate adaptations in real-time. A study showed that AUIT allowed creators of XR applications to quickly and easily create high-quality adaptations. CCS CONCEPTS • Human-centered computing → Systems and tools for in­ teraction design; Gestural input; Mixed / augmented reality; Virtual reality; User interface toolkits.
Service-Aware Personalized Item RecommendationReceived February · 2022Current recommender systems employ item-centric properties to estimate ratings and present the results to the user. However, recent studies highlight the fact that the stages of item fruition also involve extrinsic factors, such as the interaction with the service provider before, during and after item selection. In other words, a holistic view of consumer experience, including local properties of items, as well as consumers’ perceptions of item fruition, should be adopted to enhance user awareness and decision-making. In this work, we integrate recommender systems with service models to reason about the different stages of item fruition. By exploiting the Service Journey Maps to define service-based item and user profiles, we develop a novel family of recommender systems that evaluate items by taking preference management and overall consumer experience into account. Moreover, we introduce a two-level visual model to provide users with different information about recommendation results: (i) the higher level summarizes consumer experience about items and supports the identification of promising suggestions within a possibly long list of results; (ii) the lower level enables the exploration of detailed data about the local properties of items. In a user test instantiated in the home-booking domain, we compared our models to standard recommender systems. We found that the service-based algorithms that only use item fruition experience excel in ranking and minimize the error in rating estimation. Moreover, the combination of data about item fruition experience and item properties achieves slightly lower recommendation performance; however, it enhances users’ perceptions of the awareness and the decision-making support provided by the system. These results encourage the adoption of service-based models to summarize user preferences and experience in recommender systems. INDEX TERMS Information filtering, recommender systems, data visualization, service modeling.
Model-based intelligent user interface adaptation: challenges and future directionsSilvia Abrahao · 2021Adapting the user interface of a software system to the requirements of the context of use continues to be a major challenge, particularly when users become more demanding in terms of adaptation quality. A considerable number of methods have, over the past three decades, provided some form of modelling with which to support user interface adaptation. There is, however, a crucial issue as regards in analysing the concepts, the underlying knowledge, and the user experience afforded by these methods as regards comparing their benefits and shortcomings. These methods are so numerous that positioning a new method in the state of the art is challenging. This paper, therefore, defines a conceptual reference framework for intelligent user interface adaptation containing a set of conceptual adaptation properties that are useful for model-based user interface adaptation. The objective of this set of properties is to understand any method, to compare various methods and to generate new ideas for adaptation. We also analyse the opportunities that machine learning techniques could provide for data processing and analysis in this context, and identify some open challenges in order to guarantee an appropriate user experience for end-users. The relevant literature and our experience in research and industrial collaboration have been used as the basis on which to propose future directions in which these challenges can be addressed.
Adapting User Interfaces with Model-based Reinforcement LearningKashyap Todi · 2021Adapting an interface requires taking into account both the positive and negative efects that changes may have on the user. A carelessly picked adaptation may impose high costs to the user – for example, due to surprise or relearning efort – or “trap” the process to a suboptimal design immaturely. However, efects on users are hard to predict as they depend on factors that are latent and evolve over the course of interaction. We propose a novel approach for adaptive user interfaces that yields a conservative adaptation policy: It fnds benefcial changes when there are such and avoids changes when there are none. Our model-based reinforcement learning Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for proft or commercial advantage and that copies bear this notice and the full citation on the frst page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specifc permission and/or a fee. Request permissions from permissions@acm.org. CHI ’21, May 8–13, 2021, Yokohama, Japan © 2021 Association for Computing Machinery. ACM ISBN 978-1-4503-8096-6/21/05...$15.00 https://doi.org/10.1145/3411764.3445497 method plans sequences of adaptations and consults predictive HCI models to estimate their efects. We present empirical and simulation results from the case of adaptive menus, showing that the method outperforms both a non-adaptive and a frequency-based policy. CCS CONCEPTS • Human-centered computing → Interactive systems and tools.
X5Learn: A Personalised Learning Companion at the Intersection of AI and HCIMaría Pérez-Ortiz, Claire Dormann et al. · 2021X5Learn (available at https://x5learn.org) is a human-centered AI- powered platform for supporting access to free online educational resources. X5Learn provides users with a number of educational tools for interacting with open educational videos, and a set of tools adapted to suit the pedagogical preferences of users. It is intended to support both teachers and students, alike. For teachers, it provides a powerful platform to reuse, revise, remix, and redistribute open courseware produced by others. These can be videos, pdfs, exercises and other online material. For students, it provides a scaffolded and informative interface to select content to watch, read, make notes and write reviews, as well as a powerful personalised recommenda- tion system that can optimise learning paths and adjust to the user’s learning preferences. What makes X5Learn stand out from other educational platforms, is how it combines human-centered design with AI algorithms and software tools with the goal of making it intuitive and easy to use, as well as making the AI transparent to the user. We present the core search tool of X5Learn, intended to support exploring open educational materials. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s). IUI ’21 Companion, April 14–17, 2021, College Station, TX, USA © 2021 Copyright held by the owner/author(s). ACM ISBN 978-1-4503-8018-8/21/04. https://doi.org/10.1145/3397482.3450721 CCS CONCEPTS • Information systems →Users and interactive retrieval; Per- sonalization; Recommender systems; Search interfaces; • Ap- plied computing →Interactive learning environments.
User Context Ontology for Adaptive Mobile-Phone InterfacesReceived June · 2021The Adaptive User Interface (AUI) adapts to the changes in the context of use and provides improved interaction abilities for different users. The adaptivity in the user interfaces requires in depth knowledge of context. There is a need to enrich user profiles to achieve the personalized services with the ability to adapt the user’s context. The context can be reflected in a particular kind of knowledge and hence modeled as ontology. Ontology based context models are effective means to handle complex situations that support the sharing or integration of context information. This paper presents ontology based context model using OWL for adaptive mobile devices. It models the context over its four major elements including device, user, environment (location and time) and activity. The proposed ontology was derived in different classes, relationships, associations, dependencies and constraints to model dynamic context. Ontologies present a standardized, consistent and shareable context model. The context model and consequent context snapshots can be acknowledged by AUI to present a suitable user interface. The ontology was developed using Protégé on the basis of each context type having different values. Semantic querying (SPARQL) was used for knowledge acquisition. Moreover, the Pellet and HermiT Reasoner were used to verify the rules, relations and constraints to avoid the inconsistency between classes. Comparative to other context models for adaptive interfaces, ontological model provides more of scalability and growth with learning new context in to the shared context knowledge. INDEX TERMS Adaptive user interface, context aware interface, ontology driven interfaces, knowledge representation, knowledge engineering.
PRIME: A Personalized Recommender System for Information Visualization Methods via Extended Matrix CompletionChen, Lau · 2021Adapting user interface designs for specific tasks performed by different users is a challenging yet important problem. Automatically adapting visualization designs to users and contexts (e.g., tasks, display devices, environments, etc.) can theoretically improve human–computer interaction to acquire insights from complex datasets. However, effectiveness of any specific visualization is moderated by individual differences in knowledge, skills, and abilities for different contexts. A modeling framework called Personalized Recommender System for Information visualization Methods via Extended matrix completion (PRIME) is proposed for recommending the optimal visualization designs for individual users in different contexts. PRIME quantitatively models covariates (e.g., psychological and behavioral measurements) to predict recommendation scores (e.g., perceived complexity, mental workload, etc.) for users to adapt the visualization specific to the context. An evaluation study was conducted and showed that PRIME can achieve satisfactory recommendation accuracy for adapting visualization, even when there are limited historical data. PRIME can make accurate recommendations even for new users or new tasks based on historical wearable sensor signals and recommendation scores. This capability contributes to designing a new generation of visualization systems that will adapt to users' states. PRIME can support researchers in reducing the sample size requirements to quantify individual differences, and practitioners in adapting visualizations according to user states and contexts.
SemanticAdapt: Optimization-based Adaptation of Mixed Reality Layouts Leveraging Virtual-Physical Semantic ConnectionsYifei Cheng∗ · 2021We present an optimization-based approach that automatically adapts Mixed Reality (MR) interfaces to different physical envi- ronments. Current MR layouts, including the position and scale of virtual interface elements, need to be manually adapted by users ∗This work was done while Yifei Cheng was an intern at Tsinghua University. †The corresponding author. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. UIST’21, October 2021, Virtual © 2021 Association for Computing Machinery. ACM ISBN 978-1-4503-8635-7/21/10...$15.00 https://doi.org/10.1145/3472749.3474750 whenever they move between environments, and whenever they switch tasks. This process is tedious and time consuming, and ar- guably needs to be automated for MR systems to be beneficial for end users. We contribute an approach that formulates this challenge as a combinatorial optimization problem and automatically decides the placement of virtual interface elements in new environments. To achieve this, we exploit the semantic association between the virtual interface elements and physical objects in an environment. Our optimization furthermore considers the utility of elements for users’ current task, layout factors, and spatio-temporal consistency to previous layouts. All those factors are combined in a single linear program, which is used to adapt the layout of MR interfaces in real time. We demonstrate a set of application scenarios, showcasing the versatility and applicability of our approach. Finally, we show that compared to a naive adaptive baseline approach that does not 282 UIST’21, October 2021, Virtual Cheng and Yan, et al. take semantic associations into account, our approach decreased the number of manual interface adaptations by 33%. CCS CONCEPTS • Human-centered computing →Mixed / augmented reality; Virtual reality; User interface management systems.
Effect of Adaptive Guidance and Visualization Literacy on Gaze Attentive Behaviors and Sequential Patterns on Magazine-Style Narrative VisualizationsOSWALD BARRAL, SÉBASTIEN LALLÉ et al. · 2021We study the effectiveness of adaptive interventions at helping users process textual documents with embedded visualizations, a form of multimodal documents known as Magazine-Style Narrative Visualizations (MSNVs). The interventions are meant to dynamically highlight in the visualization the datapoints that are described in the textual sentence currently being read by the user, as captured by eye-tracking. These interventions were previously evaluated in two user studies that involved 98 participants reading excerpts of real-world MSNVs during a 1-hour session. Participants' outcomes included their subjective feedback about the guidance, and well as their reading time and score on a set of comprehension questions. Results showed that the interventions can increase comprehension of the MSNV excerpts for users with lower levels of a cognitive skill known as visualization literacy. In this article, we aim to further investigate this result by leveraging eye-tracking to analyze in depth how the participants processed the interventions depending on their levels of visualization literacy. We first analyzed summative gaze metrics that capture how users process and integrate the key components of the narrative visualizations. Second, we mined the salient patterns in the users' scanpaths to contextualize how users sequentially process these components. Results indicate that the interventions succeed in guiding attention to salient components of the narrative visualizations, especially by generating more transitions between key components of the visualization (i.e., datapoints, labels, and legend), as well as between the two modalities (text and visualization). We also show that the interventions help users with lower levels of visualization literacy to better map datapoints to the legend, which likely contributed to their improved comprehension of the documents. These findings shed light on how adaptive interventions help users with different levels of visualization literacy, informing the design of personalized narrative visualizations.
Towards User-Centric Intervention Adaptiveness: Influencing Behavior-Context Based Healthy Lifestyle InterventionsReceived September · 2020In the era of digital well-being, smart gadgets are the unobtrusive sources of acquiring infor- mation. A variety of personalized wellness applications support self-quantification based recommendations to provide wellness status for achieving personalized targets. However, these applications are unable to promote the induction of new healthy habits and thus are not too much effective for long term as users tend to loose their interest. Thus, we have proposed a methodology for User-Centric Adaptive Intervention based on behavior change theory for maintaining end-users’ interest. The methodology consists of four steps: (1) quantification of behavior based on contributing factors governed by expert-driven rules; (2) behavior-context based mapping for the identification of behavior status of the user; (3) selection of appropriate way of intervention to get fruitful outcomes; and finally (4) feedback based evaluation on the basis of recorded activities and questionnaires for satisfaction. A comprehensive healthy behavior index- based quantification supports the machine learning-based prediction model for behavior-context mapping. Furthermore, the evaluation is performed through implicit and explicit feedback analysis along with the accuracy of the behavior-context prediction model through multiple scenarios to cover comprehensive situations. The ensemble classifier suggests the accuracy of 98.02% for the behavior-context prediction model, which is higher than the other classifiers. The gain in behavior change is drawn from implicit feedback, which depicts that behavior context-based methods have improved the adaptation in behavior at a steady pace for the long term. The explicit feedback from 99 end-users of wellness application based on the proposed methodology obtained Good and Desired status for widely used System Usability Score and AttrakDiff tools respectively. INDEX TERMS User behavior, behavior-context, lifestyle, lifelog monitoring, self-quantification, healthy behavior index, adaptive interventions.
An Effective Clustering‑Based Web Page Recommendation Framework for E‑Commerce WebsitesHarpreet Singh · 2020The burgeoning e-commerce market has presented companies with the opportunity to grow their businesses through online platforms. But, the researchers have concluded that just 2.86% of e-commerce website visits lead to a purchase and one of the reasons for this missed opportunity is an unpleasant website browsing experience. Therefore, a pleasant browsing experience is the need of the hour whereby the web page recommendation systems (WPRS) provide high-quality navigation experience by providing suggestions about the web pages of interest and by taking the website users to their desired web pages in fewer clicks. In this context, this paper presents a method to improve the browsing experience of the website users by propos- ing two hybrid algorithms based on clustering for web page recommendation systems, namely a hybrid partitioning-based heuristic sequence clustering (HSC) algorithm inspired from K-medoid and DBSCAN algorithms and a hybrid tree-based sequence clustering (TSC) algorithm inspired from B-Trees and BIRCH algorithm. The testing has been performed using CTI, BMSWebView1, BMSWebView2 and MSNBC datasets. To measure the performance, the algorithm considered for the study has been evaluated using parameters like precision, recall, F1 measures and execution time. Also, an in-depth comparative analysis of state-of-the-art web page recommendation systems with the recommendation system considered for the study has been done. The results indicate that the proposed clustering-based framework was able to generate superior results than the other classes of algorithms.
Human-Machine Interaction Personalization: aMonica La Mura, Patrizia Lamberti · 2020The increasing spread of pervasive technology has led to the fast development of human-centered connected systems, such as cloud-based voice services, assisted driving systems, domotics control systems, personal digital assistants. The user interacts with these systems by speaking to an artificial intelligence, which interprets the speaker’s requests and takes decision accordingly. In such scenario, the real-time collection of personal information from the speaker’s voice is a key- function to develop in order to offer personalized services. Gender is part of the basic information needed to customize the user experience. Furthermore, knowledge about the sex of the speaker also proves useful in automatic speaker recognition and voice-based identity recognition systems, since it restricts the search space to individuals of one gender, thus speeding up the system response. Therefore, gender recognition techniques through speech analysis have largely attracted the researchers’ attention. Speech analysis is usually performed by extracting some features from the speech signal that can be affected by additional factors other than the gender: emotional state of the speaker, for example, is conveyed in the speech by altering some parameters that take part to the gender recognition process. At the same time, the outcome of emotion recognition systems based on speech analysis can be affected by the speaker’s gender. This paper briefly summarizes the techniques used to perform gender recognition through speech analysis and proposes a practice to take gender into account in emotion recognition methods.
Self-adaptation of Workflow Business Software to the User's Requirements and BehaviorUser Interface, User Experience et al. · 2020The main goal of the presented paper is to propose a method for adaptation of the user interface of workflow software to increase its efficiency, reduce the number of errors, and improve its UX. The authors assumed that the system adaptation will be achieved by application to intelligent methods for modeling user as well as system. In order to do this, a special tool for data gathering has been designed and in the next steps of the research, this tool will be also implemented in a real environment. A unique value of the paper is that after many years of theoretical research, the first attempt to implement a practical solution for self-adapting and the personalized interface for workflow systems was done. Janusz Sobecki et al. / Procedia Computer Science 176 (2020) 3506–3513 3507 adaptation [3]. This AI approach for user interface adaptation may be also enhanced with the application of user interface ontologies [4]. 1.1. Related Works In user interface design we should start with proper user model [1] however, we should always remember that ever-increasing number of users, especially of web-based systems, also brings the increase of differences among their users and interaction styles [3]. The user differences may reflex their demographical, psychological as well as sociological user characteristics, which have an influence on the users' information needs and interaction habits. The consequence of these differences is causing difficulties in modeling these users in the standard way [1], so since many years more sophisticated solutions have been proposed, for example, one enhanced with the application of ontologies [5], which was further applied in SOA systems development [4] and [6]. The information systems design and development have been enhanced by ontologies on at least several different levels, such as database integration, business logic, or Graphical User Interfaces (GUI) [6]. The before mentioned work presents an approach for mapping formal ontologies to GUI. This supports device-independent GUI construction and semi-automatic GUI modeling. This issue was also been raised in other work [7], as well as [8]. User interfaces have been also adopted by means of application different recommender methods such as Demographic Filtering, Content-Based Filtering, Collaborative Filtering or Hybrid Approach [9, 15], wherein user grouping or classification different machine learning algorithms may be applied, or the recommender method hybridization may be based
User interface design patterns and ontology models for adaptive mobile applications2020Mobile applications are an essential element in pervasive and ubiquitous computing, and they face many challenges during their generation process from the analysis of user needs to the design of specific mobile interfaces and their development in several technological platforms. Moreover, the rise of Ambient Intelligent and context-aware environments also introduces multiple interaction aspects to be considered when using mobile devices in this kind of scenarios. The present work seeks to examine the role of design patterns and ontology models in order to help with the generation of mobile applications, which can be adapted at runtime to the various user needs, different context scenarios, interactive design modes, or technology requirements. In this way, an ontology-based framework is introduced to represent, design, and support the adaptation of user interfaces in mobile appli- cations by using design patterns according to these user needs or preferences and the context around them. This framework provides developers with a client-server architecture that enables the access to an expert knowledge base of user, context, and pattern information together with a set of inference rules, which allow the dynamic selection of interface design patterns and the runtime adaptation of the user interface features. These ontology models and inference rules are key components of the proposed framework, and their implementation has helped to produce an example of mobile application supporting user interface adap- tation processes for disabled people, which can be required in Ambient Intelligent environments. Three examples of user scenarios have been considered to assess the framework potential, and usability dimensions have been tested by a limited set of users through the produced mobile application, making the usefulness of generated adaptive user interfaces apparent.
Exploring a Design Space of Graphical Adaptive Menus: Normal vs. Small ScreensJEAN VANDERDONCKT · 2019Graphical Adaptive Menus are Graphical User Interface menus whose predicted items of immediate use can be automatically rendered in a prediction window. Rendering this prediction window is a key question for adaptivity to enable the end-user to efficiently differentiate predicted items from normal ones and to consequently select appropriate items. Adaptivity for graphical menus has been investigated more for normal screens, such as desktops, than for small screens, such as smartphones, where real estate imposes severe rendering constraints. To address this question, this article defines and explores a design space where graphical adaptive menus are structured based on Bertin's eight visual variables (i.e., position, size, shape, value, color, orientation, texture, and motion) and their combination by comparing their rendering for small screens with respect to normal screens. Based on this design space, previously introduced graphical adaptive menus are revisited in terms of four stability properties (i.e., spatial, physical, format, and temporal), and new menu designs are introduced and discussed for both normal and small screens. The resulting set of graphical adaptive menu has been subject to a preference analysis from which a particular design emerged: the cloud menu, where predicted items are arranged in an adaptive tag cloud. We investigate empirically the effect of the cloud menu on the item selection time and the error rate with respect to a static menu and an adaptive linear menu. This article then suggests a set of usability guidelines for designers and practitioners to design graphical adaptive menus in general and cloud menus in particular.
Context- and Data-driven Satisfaction Analysis of User Interface Adaptations Based on Instant User FeedbackUsability testing · 2019Modern User Interfaces (UIs) are increasingly expected to be plastic, in the sense that they retain a constant level of usability, even when subjected to context (platform, user, and environment) changes at runtime. Adaptive UIs have been promoted as a solution for context variability due to their ability to automatically adapt to the context-of-use at runtime. However, evaluating end-user satisfaction of adaptive UIs is a challenging task, because the UI and the context-of-use are both constantly changing. Thus, an acceptance analysis of UI adaptation features should consider the context-of-use when adaptations are triggered. Classical usability evaluation methods like usability tests mostly focus on a posteriori analysis techniques and do not fully exploit the potential of collecting implicit and explicit user feedback at runtime. To address this challenge, we present an on-the-fly usability testing solution that combines continuous context monitoring together with collection of instant user feedback to assess end-user satisfaction of UI adaptation features. The solution was applied to a mobile Android mail application, which served as basis for a usability study with 23 participants. A data-driven end-user satisfaction analysis based on the collected context information and user feedback was conducted. The main results show that most of the triggered UI adaptation features were positively rated.
A survey of cyber‑physical system implementations of real‑time personalized interventionsRobert Steele · 2019Advances in sensor technology and machine learning as well as the widespread use of smartphones are shifting the focus of healthcare. Emerging paradigms such as cyber-physical systems (CPSs) make possible the transition from reactive to preventive care. CPSs can be implemented to achieve effective mobile health solutions and to provide sophisticated new mechanisms to monitor an individual’s state in real-time via the use of sensors and mobile devices. Despite the significant potential impact of such systems, their implementation poses a range of complex technical challenges. This article surveys the state-of-the-art in implementations of CPSs for real-time personalized interventions. A general three layer architecture which can be used to consider current implementations is first presented along with a description of its main components. We also propose a three level taxonomy in accordance with the system capabilities. Then, the principal technical challenges, human-machine interaction challenges and future directions are discussed. Fifteen of the state-of-the-art implementations are qualitatively evaluated in terms of sensor capabilities, just-in-time reaction, interruptibility, and adherence, among other characteristics. By reviewing the state-of-the-art of the systems that have been built to-date, the focus of the review is to summarize current technical challenges and future opportunities for both future CPS implementers and behavioral scientists designing CPS for personalized interventions.
Integrated model-driven development of self-adaptive user interfacesEnes Yigitbas · 2019Modern user interfaces (UIs) are increasingly expected to be plastic, in the sense that they retain a constant level of usability, even when subjected to context changes at runtime. Self-adaptive user interfaces (SAUIs) have been promoted as a solution for context variability due to their ability to automatically adapt to the context-of-use at runtime. The development of SAUIs is a challenging and complex task as additional aspects like context management and UI adaptation have to be covered. In classical model-driven UI development approaches, these aspects are not fully integrated and hence introduce additional complexity as they represent crosscutting concerns. In this paper, we present an integrated model-driven development approach where a classical model-driven development of UIs is coupled with a model-driven development of context-of-use and UI adaptation rules. We base our approach on the core UI modeling language IFML and introduce new modeling languages for context- of-use (ContextML) and UI adaptation rules (AdaptML). The generated UI code, based on the IFML model, is coupled with the context and adaptation services, generated from the ContextML and AdaptML model, respectively. The integration of the generated artifacts, namely UI code, context, and adaptation services in an overall rule-based execution environment, enables runtime UI adaptation. The benefit of our approach is demonstrated by two case studies, showing the development of SAUIs for different application scenarios and a usability study which has been conducted to analyze end-user satisfaction of SAUIs.
Personalized Explanations for Hybrid Recommender SystemsPigi Kouki · 2019Recommender systems have become pervasive on the web, shaping the way users see information and thus the decisions they make. As these systems get more complex, there is a growing need for transparency. In this paper, we study the problem of generating and visualizing personalized explanations for hybrid recommender sys- tems, which incorporate many different data sources. We build upon a hybrid probabilistic graphical model and develop an approach to generate real-time recommendations along with personalized explanations. To study the benefits of explanations for hybrid rec- ommender systems, we conduct a crowd-sourced user study where our system generates personalized recommendations and explana- tions for real users of the last.fm music platform. We experiment with 1) different explanation styles (e.g., user-based, item-based), 2) manipulating the number of explanation styles presented, and 3) manipulating the presentation format (e.g., textual vs. visual). We apply a mixed model statistical analysis to consider user personal- ity traits as a control variable and demonstrate the usefulness of our approach in creating personalized hybrid explanations with different style, number, and format. CCS CONCEPTS • Information systems →Decision support systems; Collabo- rative filtering; • Human-centered computing →Social network- ing sites; Empirical studies in visualization.
Information Dashboards and Tailoring Capabilities - A Systematic Literature ReviewAndrea Vazques-Ingelmo · 2019The design and development of information dashboards are not trivial. Several factors must be accounted; from the data to be displayed to the audience that will use the dashboard. However, the increase in popularity of these tools has extended their use in several and very different contexts among very different user profiles. This popularization has increased the necessity of building tailored displays focused on specific requirements, goals, user roles, situations, domains, etc. Requirements are more sophisticated and varying; thus, dashboards need to match them to enhance knowledge generation and support more complex decision-making processes. This sophistication has led to the proposal of new approaches to address personal requirements and foster individualization regarding dashboards without involving high quantities of resources and long development processes. The goal of this work is to present a systematic review of the literature to analyze and classify the existing dashboard solutions that support tailoring capabilities and the methodologies used to achieve them. The methodology follows the guidelines proposed by Kitchenham and other authors in the field of software engineering. As results, 23 papers about tailored dashboards were retrieved. Three main approaches were identified regarding tailored solutions: customization, personalization, and adaptation. However, there is a wide variety of employed paradigms and features to develop tailored dashboards. The present systematic literature review analyzes challenges and issues regarding the existing solutions. It also identifies new research paths to enhance tailoring capabilities and thus, to improve user experience and insight delivery when it comes to visual analysis. INDEX TERMS SLR, systematic literature review, tailoring, custom, personalized, adaptive, information dashboards.
A Framework for the Development of a Dynamic AdaptiveVivien Johnston · 2019 The aim of this paper is to present PhD research that aims to enhance the User Experience by proposing a framework that combines the three core components of: dynamic interfaces; adaptive interfaces; and intelligent interfaces. Initial research into the field has identified a gap at the intersection of these types of interaction. A dynamic interaction understands the user, their device and their physical environment to provide a basic User Experience. An adaptive interaction understands the user’s capabilities further to implement an enhanced experience via usability and accessibility whilst recognising the flow of the user and their pipeline. The intelligent interaction builds further upon this through the incorporation of Machine Learning algorithms that assist in making the interface intelligent and provide a personalised experience for each user based upon their end goal. This in turn will reduce a user’s cognitive load and enhance their interactive experience with an interface. CCS CONCEPTS • Human-centered computing~Human computer interaction (HCI) • Human-centered computing~Usability testing • Computing methodologies~Machine learning Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. ECCE 2019, September 10-13, 2019, BELFAST, United Kingdom © 2019 Association for Computing Machinery. ACM ISBN 978-1-4503-7166-7/19/09...$15.00 https://doi.org/10.1145/3335082.3335125
Rule based adaptive user interface for adaptive E-learning systemManohara Pai M. M. · 2018The term Adaptive E-learning System (AES) refers to the set of techniques and approaches that are combined together to offer online courses to the learners with the aim of providing customized resources and interfaces. Most of these systems focus on adaptive contents which are generated to the learners without considering the learning styles of the learners. Learning style of the learner defines the way of learning the contents. The system should not only meet the individual need of the contents but also the customized user interface on the portal. Hence, an AES should mainly focus on recommending learning contents with Adaptive User Interface (AUI) on the portal. The work in the paper proposes a generic approach to provide the learning contents with AUI components based on the learning styles of the learners. The learning style adopted for the work is the Felder-Silverman Learning Style Model (FSLSM). The proposed approach defines generic rules which are generated automatically for any online course with the adaptive contents. Also, the approach takes care of new learners by providing learning path as a user interface component on the portal. The experiment has been conducted on engineering students for a particular online course. The portal is validated using parameters of usability testing by generating test cases and statistical analysis has been carried out to identify the impact of AUI components on the learning process. The result shows the well adaptation of user interface components and contents based on learning styles.
“This App Would Like to Use Your Current Location to Better Serve You”: Importance of User Assent and System Transparency in Personalized Mobile ServicesTsai-Wei Chen · 2018Modern mobile apps aim to provide personalized services without appearing intrusive. A common strategy is to let the user initiate the service request (e.g., “click here to receive coupons for your favorite products”), a practice known as “overt personalization.” Another strategy is to assuage users’ privacy concerns by being transparent about how their data would be collected, utilized and stored. To test these two strategies, we conducted a 2 (Personalization: Overt vs. Covert) x 2 (Transparency: High vs. Low) factorial experiment, with a fifth control condition. Participants (N=302) interacted with GreenByMe, a prototype of an eco-friendly mobile application. Data show that overt personalization affects perceived control. Significant three-way interactions between power usage, perceived overt personalization and perceived information transparency was seen on perceived ease of use, trust in the app, user engagement and behavioral intention to use the app in the future. In addition, results reveal that perceived information transparency also promotes trust, which is negatively linked with privacy concerns and positively correlated with user engagement and product involvement. Author Keywords Location-Aware Computing; Contextual Computing; Usability Study; User Experience Design; Privacy ACM Classification Keywords H.5.m. Information interfaces and presentation (e.g., HCI): Miscellaneous.
Deep Sequential Recommendation for Personalized Adaptive User InterfacesUnknown · 2017Adaptive user-interfaces (AUIs) can enhance the usability of complex software by providing real-time contextual adapta- tion and assistance. Ideally, AUIs should be personalized and versatile, i.e., able to adapt to each user who may perform a variety of complex tasks. But this is difficult to achieve with many interaction elements when data-per-user is sparse. In this paper, we propose an architecture for personalized AUIs that leverages upon developments in (1) deep learning, par- ticularly gated recurrent units, to efficiently learn user inter- action patterns, (2) collaborative filtering techniques that en- able sharing of data among users, and (3) fast approximate nearest-neighbor methods in Euclidean spaces for quick UI control and/or content recommendations. Specifically, inter- action histories are embedded in a learned space along with users and interaction elements; this allows the AUI to query and recommend likely next actions based on similar usage patterns across the user base. In a comparative evaluation on user-interface, web-browsing and e-learning datasets, the deep recurrent neural-network (DRNN) outperforms state-of- the-art tensor-factorization and metric embedding methods. Author Keywords Adaptive User Interface; Deep Learning; Personalization ACM Classification Keywords I.2.6. Artificial Intelligence: Learning; H.5.2 Information In- terfaces and Presentation(e.g. HCI): User Interfaces
Model-based adaptive user interface based on context and user experience evaluationJamil Hussain, Anees Ul Hassan, Hafiz Syed Muhammad Bilal, Rahman Ali, Muhammad Afzal, Shujaat Hussain, Jaehun Bang,Oresti Banos, Sungyoung Lee · 2016Personalized services have greater impact on user experience to effect the level of user satisfaction. Many approaches provide personalized services in the form of an adaptive user interface. The focus of these approaches is lim- ited to specific domains rather than a generalized approach applicable to every domain. In this paper, we proposed a domain and device-independent model-based adaptive user interfacing methodology. Unlike state-of-the-art approaches, the proposed methodology is dependent on the evaluation of user context and user experience (UX). The proposed methodologyisimplementedasanadaptiveUI/UXauthoring (A-UI/UX-A) tool; a system capable of adapting user inter- face based on the utilization of contextual factors, such as user disabilities, environmental factors (e.g. light level, noise level, and location) and device use, at runtime using the adap- tation rules devised for rendering the adapted interface. To validate effectiveness of the proposed A-UI/UX-A tool and methodology, user-centric and statistical evaluation methods are used. The results show that the proposed methodology B Sungyoung Lee [sylee@oslab.khu.ac.kr](mailto:sylee@oslab.khu.ac.kr) Jamil Hussain [jamil@oslab.khu.ac.kr](mailto:jamil@oslab.khu.ac.kr) 1 Department of Computer Science & Engineering, Kyung Hee University (Global Campus), 1732 Deokyoungdae-ro, Giheung-gu, Yongin-si, Gyeonggi-do 446-701, Republic of Korea 2 Quaid-e-Azam College of Commerce, University of Peshawar, Peshawar, Pakistan 3 College of Electronics and Information Engineering, Sejong University, Seoul, South Korea 4 Telemedicine Group, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Postbox 217, 7500 AE Enschede, The Netherlands outperforms the existing approaches in adapting user inter- faces by utilizing the users context and experience.
Adaptive user modelling in car racing games using behavioural and physiological dataTheodosis Georgiou, Yiannis Demiris · 2015Personalised content adaptation has great potential to increase user engage- ment in video games. Procedural generation of user-tailored content increases the self-motivation of players as they immerse themselves in the virtual world. An adap- tive user model is needed to capture the skills of the player and enable automatic game content altering algorithms to fit the individual user. We propose an adaptive user modelling approach using a combination of unobtrusive physiological data to iden- tify strengths and weaknesses in user performance in car racing games. Our system creates user-tailored tracks to improve driving habits and user experience, and to keep engagement at high levels. The user modelling approach adopts concepts from the Trace Theory framework; it uses machine learning to extract features from the user’s physiological data and game-related actions, and cluster them into low level primi- tives. These primitives are transformed and evaluated into higher level abstractions such as experience, exploration and attention. These abstractions are subsequently used to provide track alteration decisions for the player. Collection of data and feed- back from 52 users allowed us to associate key model variables and outcomes to user responses, and to verify that the model provides statistically significant decisions per- sonalised to the individual player. Tailored game content variations between users in our experiments, as well as the correlations with user satisfaction demonstrate that our algorithm is able to automatically incorporate user feedback in subsequent procedural content generation. B Theodosis Georgiou theodosis.georgiou08@imperial.ac.uk Yiannis Demiris y.demiris@imperial.ac.uk 1 Personal Robotics Laboratory, Department of Electrical and Electronic Engineering, Imperial College London, Exhibition Road, South Kensington, London SW7 2BT, UK 123 268 T. Georgiou, Y. Demiris
Persuasive strategies and emotional states: towards designing personalized and emotion-adaptive persuasive systems2023Persuasive strategies have been widely operationalized in systems or applications to motivate behaviour change across diverse domains. However, no empirical evidence exists on whether or not persuasive strategies lead to certain emotions to inform which strategies are most appropriate for delivering interventions that not only motivate users to perform target behaviour but also help to regulate their current emotional states. We conducted a large-scale study of 660 participants to investigate if and how individ- uals including those at different stages of change respond emotionally to persuasive strategiesandwhy.Specifically,weexaminedtherelationshipbetweenperceivedeffec- tiveness of individual strategies operationalized in a system and perceived emotional states for participants at different stages of behaviour change. Our findings estab- lished relations between perceived effectiveness of strategies and emotions elicited in individuals at distinct stages of change and that the perceived emotions vary across stages of change for different reasons. For example, the reward strategy is associated with positive emotion only (i.e. happiness) for individuals across distinct stages of change because it induces feelings of personal accomplishment, provides incentives that increase the urge to achieve more goals, and offers gamified experience. Other strategies are associated with mixed emotions. Our work links emotion theory with behaviour change theories and stages of change theory to develop practical guidelines for designing personalized and emotion-adaptive persuasive systems. B Oladapo Oyebode oladapo.oyebode@dal.ca Darren Steeves darren@jackhabbit.com Rita Orji rita.orji@dal.ca 1 Faculty of Computer Science, Dalhousie University, Halifax, NS B3H 1W5, Canada 2 School of Health and Human Performance, Dalhousie University, Halifax, NS B3H 4R2, Canada 123 1176 O. Oyebode et al.
A Novel User Emotional Interaction Design Model Using Long and Short-Term Memory Networks and Deep Learning2021Emotional design is an important development trend of interaction design. Emotional design in products plays a key role in enhancing user experience and inducing user emotional resonance. In recent years, based on the user's emotional experience, the design concept of strengthening product emotional design has become a new direction for most designers to improve their design thinking. In the emotional interaction design, the machine needs to capture the user's key information in real time, recognize the user's emotional state, and use a variety of clues to finally determine the appropriate user model. Based on this background, this research uses a deep learning mechanism for more accurate and effective emotion recognition, thereby optimizing the design of the interactive system and improving the user experience. First of all, this research discusses how to use user characteristics such as speech, facial expression, video, heartbeat, etc., to make machines more accurately recognize human emotions. Through the analysis of various characteristics, the speech is selected as the experimental material. Second, a speech-based emotion recognition method is proposed. The mel-Frequency cepstral coefficient (MFCC) of the speech signal is used as the input of the improved long and short-term memory network (ILSTM). To ensure the integrity of the information and the accuracy of the output at the next moment, ILSTM makes peephole connections in the forget gate and input gate of LSTM, and adds the unit state as input data to the threshold layer. The emotional features obtained by ILSTM are input into the attention layer, and the self-attention mechanism is used to calculate the weight of each frame of speech signal. The speech features with higher weights are used to distinguish different emotions and complete the emotion recognition of the speech signal. Experiments on the EMO-DB and CASIA datasets verify the effectiveness of the model for emotion recognition. Finally, the feasibility of emotional interaction system design is discussed.
Computer Science ReviewMaaruf Ali, Peter S. Excell · 2021A review of research on universal usability, plasticity of user interface design and facilitation of interface development with universal usability is presented. The survey was based on 165 research papers spanning over fifty-five years. The foundations of adaptive or intelligent user interfaces (AUI or IUI) are presented, three core domains being focused upon: Artificial Intelligence (AI), User Modelling (UM) and Human–Computer Interaction (HCI). For comparison of the various AUIs, a proposed taxonomy is given. One conclusion is that an efficient training vector for fast optimal convergence of the machine-learning algorithm is a necessity, but key to this is the bounding of the dataset, the goal being to achieve an accurate user preference model, which has to be built from a limited number of datasets obtained from the human interaction. More research also needs to be conducted to ascertain the usefulness and effectiveness of IUIs compared against AUIs. With the global mobility of users, interface design must take account of the abilities and cultures of users, derived from actual user behaviour and not on their feedback. A key question is whether the interface should be adaptive under system control or be made adaptable under user control. A need is identified for an ‘‘afferential component’’ that stores a priori information about the end user, an ‘‘inferential component’’ that determines to what extent the user interface actually needs to be adapted, and the ‘‘efferential component’’ that actually determines how the adaptivity is applied seamlessly to the system. Application to e-learning is a priority: the use of machine intelligence to achieve appropriate learnability, ideally enhanced by ‘‘Playful interaction’’, was found to be desirable. Universal application of adaptation lies in the future, but AUI properties cannot be ascertained while disregarding the other parameters of the system in which it will be used. A more complete understanding of the human mental model is necessary, requiring a highly multidisciplinary approach and cooperation between diverse researchers. Finally, a performance evaluation of plasticity of user interface was conducted: it is concluded that the use of dynamic techniques can enhance the user experience to a much greater extent than more basic approaches, although optimisation of usability parameter trade-offs needs further attention. It is noted that most of the work reviewed originated from a limited range of cultural pe
Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to DesignQian Yang · 2020Artificial Intelligence (AI) plays an increasingly important role in improving HCI and user experience. Yet many chal­ lenges persist in designing and innovating valuable human-AI interactions. For example, AI systems can make unpredictable errors, and these errors damage UX and even lead to unde­ sired societal impact. However, HCI routinely grapples with complex technologies and mitigates their unintended conse­ quences. What makes AI different? What makes human-AI interaction appear particularly difficult to design? This paper investigates these questions. We synthesize prior research, our own design and research experience, and our observations when teaching human-AI interaction. We identify two sources of AI’s distinctive design challenges: 1) uncertainty surround­ ing AI’s capabilities, 2) AI’s output complexity, spanning from simple to adaptive complex. We identify four levels of AI sys­ tems. On each level, designers encounter a different subset of the design challenges. We demonstrate how these findings reveal new insights for designers, researchers, and design tool makers in productively addressing the challenges of human-AI interaction going forward. Author Keywords User experience, artificial intelligence, sketching, prototyping. CCS Concepts •Human-centered computing → Human computer inter­ action (HCI); Interaction design process and methods;
Interactive architectural approach (interactive architecture): An effective and adaptive process for architectural designMojtaba Parsaee, Parinaz Motealleh et al. · 2015This research attempts to offer a new approach for architectural design process that the concepts of interaction and multi-relations are being achieved through it. This approach, which is identified as an interactive architecture, suggests a process that a dynamic and mutual relation will create among all factors and parameters of design and the effects of each factor or parameters on final design will be considered. In fact, the main axis of the suggested approach is comprehensive interaction with all various aspects of design, since the design problems have multi-aspects, mostly. Thus, the final design will be resulted based on these mutual relations and it is a production which will have a maximum and optimum adaption with all factors and parameters. What makes this atti- tude more significant and crucial is the chaotic situation that is produced in architecture and urban designing of most cities especially in developing countries and leads to lack of identity in these cities. So, the interactive approach can be able to eliminate the challenges and create the fields of sustain- able architecture and urban development through an effective method. However, this process encounters to some constraints and challenges along with some potentials which are discussed in this essay. The research method is analytical-interpretative and based on qualitative analyses. ª 2015 The Authors. Production and hosting by Elsevier B.V. on behalf of Housing and Building National Research Center. This is an open access article under the CC BY-NC-ND license (http:// creativecommons.org/licenses/by-nc-nd/4.0/).
designed & built by Tanja Radovanovic