Filtered by themeEmotional response80 papersclear ✕

A Novel Emotion-Aware Networking Model for Enhanced User Experience in 5G networksViktor Stoynov · 2025The emergence of 5G networks has considerably broadened the capabilities and features of mobile networks. A notable development in this area is the incorporation of emotional intelligence into mobile networks, leading to the proposal of the Emotion-aware Networking Paradigm (ENP) in this paper. ENP strives to equip mobile networks with the ability to identify and understand user emotions and adapt services accordingly. This paper introduces a model for implementing ENP in 5G mobile networks, called the Emotion-aware Networking Model (ENM), detailing its structure, functions, and main characteristics. This paper also explores the challenges and prospects related to ENM and offers examples of potential use cases. Additionally, this paper presents the Emotion-Aware Service and User Profile Management Function (EASUPMF) for ENM, designed to unleash ENM's potential by managing user profiles and delivering personalized emotional services based on emotion recognition. Several new Key Performance Indicators (KPIs) are also established to assess ENM's performance, such as Emotional Diversity, Emotional Alignment, and Emotional Intensity. Our research indicates that ENM could transform the mobile network sector and enhance user experiences by delivering tailored services grounded in user emotions.

UX of AI & PersonalizationResearch Papers

Using user emotions to trigger UI adaptationUniv. Grenoble Alpes · 2025User experience is an important user interface quality factor that needs to be maintained during interaction. With this goal, we propose to adapt user interfaces to users’ emotions. This requires being able to detect at runtime negative emotions to trigger adaptations. However, emotions depend on users’ gender and age. This makes it difficult to identify negative emotions and their cause. This paper studies the categorization of emotions depending on users’ age and gender and two user experience dimensions (aesthetics and usability). Thanks to an experiment, it proposes some emotions thresholds that can be used for detecting usability and aesthetics problems from users’ age and gender. These results are used in a user interface adaptation system to infer negative emotions and user interface problems.

UX of AI & PersonalizationResearch Papers

Human-Centered AI: Enhancing User Interaction with Intelligent SystemsGalhenage Gayan Sudesh Suranga Perer · 2024This research examines Human- Centered AI (HCAI) and its contribution to user involvement and user experience with intelligent systems in the healthcare, finance, and education industries. HCAI focuses on deploying AI in a fashion that considers human abilities, values, and emotions in a way that enhances convenience, adaptability, and reliability. The study adopts a qualitative and quantitative mixed methodology in conducting surveys and interviews with users and AI developers examining the effects of human- centered design attributes explanation and user control on user satisfaction. The results imply that such systems of AI which follow the principles of human-centered design have more acceptance and endorsement among users. In particular, participants stressed the need for effective articulation of decision-making processes by AI tools and provision for some degree of manual control over the tools. At the same time, the analysis has uncovered the existence of persistent ethical problems, such as bias, privacy, reliability of AI systems, which need to be addressed further. According to the findings, the application of the HCAI approach can greatly boost the experience and confidence of users in using AI devices. Practical implications are related to the go and bias justice, implementing and enhancing information on explainability, feedback, privacy and integrated ethics into the systems. In this paper, we present additional development for the application of ethical artificial intelligence. Inde Term — Adaptability, Explainability, Human-Centered AI, Interaction Design, Personalization, Transparency, Trust, User Experience, Usability

UX of AI & PersonalizationResearch Papers

Utilizing emotion recognition technology to enhance user experience in real- timeYuanyuan Xu · 2024In recent years, advancements in human-computer interaction (HCI) have led to the emergence of emotion recognition technology as a crucial tool for enhancing user engagement and satisfaction. This study investigates the application of emotion recognition technology in real-time environments to monitor and respond to users’ emotional states, creating more personalized and intuitive interactions. The research employs convolutional neural networks (CNN) and long short-term memory networks (LSTM) to analyze facial expressions and voice emotions. The experimental design includes an experimental group that uses an emotion recognition system, which dynamically adjusts learning content based on detected emotional states, and a control group that uses a traditional online learning platform. The results show that real-time emotion monitoring and dynamic content adjustments significantly improve user experiences, with the experimental group demonstrating better engagement, learning outcomes, and overall satisfaction. Quantitative results indicate that the emotion recognition system reduced task completion time by 14.3%, lowered error rates by 50%, and increased user satisfaction by 18.4%. These findings highlight the potential of emotion recognition technology to enhance user experiences. However, challenges such as the complexity of multimodal data integration, real-time processing capabilities, and privacy and data security issues remain. Addressing these challenges is crucial for the successful implementation and widespread adoption of this technology. The paper concludes that emotion recognition technology, by providing personalized and adaptive interactions, holds significant promise for improving user experience and offers valuable insights for future research and practical applications.

UX of AI & PersonalizationResearch Papers

The Illusion of Empathy? Notes on Displays of Emotion in Human-Computer InteractionAndrea Cuadr · 2024From ELIZA to Alexa, Conversational Agents (CAs) have been delib­ erately designed to elicit or project empathy. Although empathy can help technology better serve human needs, it can also be deceptive and potentially exploitative. In this work, we characterize empathy in interactions with CAs, highlighting the importance of distin­ guishing evocations of empathy between two humans from ones between a human and a CA. To this end, we systematically prompt CAs backed by large language models (LLMs) to display empathy while conversing with, or about, 65 distinct human identities, and also compare how diferent LLMs display or model empathy. We fnd that CAs make value judgments about certain identities, and can be encouraging of identities related to harmful ideologies (e.g., Nazism and xenophobia). Moreover, a computational approach to understanding empathy reveals that despite their ability to display empathy, CAs do poorly when interpreting and exploring a user’s experience, contrasting with their human counterparts. CCS CONCEPTS • Human-centered computing → HCI theory, concepts and models; Empirical studies in HCI.

UX of AI & PersonalizationResearch Papers

Toward an Interactive Reading Experience: Deep Learning Insights and Visual Narratives of Engagement and EmotionJayasankar Santhosh, Akshay Palimar Pai et al. · 2024Engagement and emotion are critical components that significantly influence a reader’s experience during a reading task. Despite the crucial role of engagement and emotions in shaping our reading experience, accurately tracking these dynamic states during actual reading remains a significant challenge. This study bridges this gap by detecting engagement and emotion levels during a reading task by leveraging the power of state-of-the-art deep learning models and investigating the correlations between the engagement levels and emotions. An experiment was conducted involving 18 university students reading 14 documents followed by a questionnaire to rate their levels of engagement, valence, and arousal after reading each document. A Tobii 4C eye-tracker with a pro license along with an Empatica E4 wristband were utilized to record behavioral and physiological data from the participants. A range of deep learning models were utilized for computing the engagement, valence, and arousal values, employing both user-independent and user- dependent methods. Our investigation revealed distinct yet complementary strengths in two deep learning models: Transformer excelled in user-independent detection of engagement and emotion with an accuracy of 80.38% (engagement), 71.28% (arousal) and 73.98% (valence) while ResNet shined in the user-dependent setting with an accuracy of 93.56% (engagement), 90.62% (arousal) and 88.70% (valence) which highlights the interplay between individual differences and reading dynamics. Intriguingly, we observed strong, document-specific correlations between engagement and emotion states, suggesting that different texts evoke unique affective responses. We developed an interactive dashboard visualizing predicted engagement and emotions, offering real-time feedback and personalized learning possibilities. The dashboard features an engagement gauge that displays the reader’s level of engagement based on predicted class probabilities, and an emotion emoji serving as a visual cue that illustrates the predicted emotional state of the reader. This technology can inform the design of dynamic interfaces that adjust to individual reading styles and emotional responses, potentially enhancing comprehension and involvement. INDEX TERMS Digital reading, physiological sensing, eye tracking, deep learning, affective state.

UX of AI & PersonalizationResearch Papers

Emoticontrol : Emotions-based Control of User-Interfaces AdaptationsKARTHIK VAIDHYANATHAN, IIIT Hyderaba · 2023Emotions are integral to human nature, and their existence, duration, and evolution could lead to specific behaviors. If emotions and behaviors are ignored in the design of socio-technical systems, they will fail or cause discomfort. User interfaces (UIs) are elements of interactive systems able to trigger or moderate emotions. UIs are increasingly designed adaptive to users' various characteristics, intending to improve their satisfaction, performance, and decisions. However, previous adaptation supervising approaches are not effectively adopted in real life since they neglect the dynamic behaviors of humans or systems. This paper proposes Emoticontrol, a quality-driven approach to adapting UIs to users' emotions using Model-Free Reinforcement Learning (MFRL). The approach aims to maximize applying the essential adaptations and minimize the unnecessary ones towards users' enhanced quality of experience (QoE). The approach also considers improving the software quality of service (QoS) by designing software architecture alternatives. We chose emergency evacuation training as a suitable evaluation domain since people experience intense emotions in potential danger. We performed experiments with a mobile application we developed that acts as a recommender system in evacuation training. By taking contextual input of the users' basic emotions from face recognition, the application intelligently adapts its UI to quickly lead people to safe areas while keeping them emotionally controlled. We consider software performance a crucial QoS; thus, we adopt and test architectures that facilitate an acceptable level of performance. The evaluation process confirms the efficiency and effectiveness of the MFRL in iterations, as well as compared to other UI adaptation techniques.

UX of AI & PersonalizationResearch Papers

User Interface and Architecture Adaption Based onMahyar T. Moghaddam∗, Mina Alipour et al. · 2023This paper shows how emotions and behavior considerations in socio-technical systems lead to high-quality self-adaptations, both at application and architecture levels. In our approach, an interactive control system assesses the reconfigurations that enhance the quality of service (QoS) while considering humans’ quality of experience (QoE). We use a Model-Free Reinforcement Learning (MFRL) approach to self- adapt user interfaces (UIs) to users’ emotions. The approach aims to maximize applying the essential adaptations and minimize the unnecessary ones towards users’ QoE, i.e., task comple- tion and satisfaction. If the control system detects a drop in QoS in emotion-based adaptations or other functions, another level of adaptation reconfigures the architecture towards better quality. We chose emergency evacuation training as a suitable evaluation domain since people experience intense emotions in such potential danger. We performed experiments with a mobile application we developed that acts as a recommender system in emergency training. By taking contextual input of the users’ basic emotions from face recognition and their mobility behavior, the application intelligently adapts its UI to quickly lead people to safe areas while keeping them emotionally stable. In addition to UI adaptation, the system is capable of architecture-level adaptations to decrease response time if required. The evaluation process confirms the efficiency of the MFRL in iterations, as well as compared to other possible UI adaptation techniques. The emerging results also show that architecture-level adaptations positively impact the system performance and users’ emotions and performance. Index Terms—Software Architecture, Emotions, Behaviors, Reinforcement Learning, User Interface, Emergency.

UX of AI & PersonalizationResearch Papers

Zero-shot multitask intent and emotion prediction from multimodal data: A benchmark studyMauajama Firdaus b, Dushyant Singh Chauhan c · 2023Empathy involves comprehending and sharing the emotions of another person. In the realm of conversational AI, empathy pertains to the AI’s capacity to understand and respond suitably to the user’s emotions and needs. Conversational AI with empathetic capabilities can heighten the user experience by making interactions more personalized and natural. At present, machine learning algorithms are commonly utilized in existing conversational AI systems to recognize emotions and corresponding empathetic intents from annotated data. Nonetheless, this approach is not without limitations, being expensive and time-consuming. Our present work takes a holistic approach to empathy in conversational AI, where we propose a novel zero-shot multitask framework, the Zero-shot Intent Emotion Detection (ZIED) network, identifies both emotions and intents in a multimodal setting. We developed an end-to-end model that concurrently captures textual, audio, and visual representations and integrates the different modalities using cross-attention mechanisms. Our experimental results, based on the EmoInt-MD dataset, show that incorporating all three modalities results in the best performance for both emotion and empathetic intent detection. We observed a noteworthy improvement of over 6% and 4% for intent and emotion, respectively, for various ratios of seen and unseen classes.

UX of AI & PersonalizationResearch Papers

Toward Changing Users behavior with Emotion-based Adaptive SystemsMina Alipour · 2023Interactive computer systems’ designers emphasize the importance of considering humans, their emotions, and behaviors as first-class entities. Emotions are integral parts of human nature, and ignor- ing that can lead the interactive systems to failure, low quality, or discomfort. User interfaces (UIs) are increasingly becoming adap- tive to users’ various characteristics, intending to improve users’ satisfaction, performance, and decisions. However, the previous approaches proposed for supervising such adaptations are not effec- tively adopted in real-life problems. This paper proposes the novel approach to adapting UIs to users’ emotions using Model-Free Re- inforcement Learning (MFRL). The approach aims to maximize applying the essential adaptations and minimize the unnecessary ones towards users’ task completion and satisfaction. We chose emergency evacuation training as a suitable evaluation domain since people experience intense emotions in potential danger. We performed experiments with a mobile application we developed that acts as a recommender system in emergency training. By taking contextual input of the users’ basic emotions from face recognition, the application intelligently adapts its UI to quickly lead people to safe areas while arousing target emotions. The research includes lit- erature analysis, surveys, and further adopting an iterative process in implementation and experimentation. The evaluation process confirms the efficiency and effectiveness of the MFRL in iterations, as well as compared to other possible UI adaptation techniques, i.e., rule-based and sequential adaptation.

UX of AI & PersonalizationResearch Papers

Interactive Music Genre Exploration with Visualization and Mood ControlYu Liang · 2021Recommender systems can be used to help users discover novel items and explore new tastes, for example in music genre explo- ration. However, little work has studied how to improve users’ understandability and acceptance of the novel items as well as sup- port users to explore a new domain. In this paper, we investigate how two different visualizations and mood control influence the perceived control, informativeness and understandability of a mu- sic genre exploration tool, and further to improve the helpfulness for new music genre exploration. Specifically, we compare a bar chart visualization used by earlier work to a contour plot which allows users to compare their musical preferences with both the recommended tracks as well as the new genre. Mood control is implemented with two sliders to set a preferred mood on energy and valence features (that correlate with psychological mood di- mensions). In the online user study, mood control was manipulated between subjects, and the visualizations were compared within subjects. During the study (N=102), we measured users’ subjective perceptions, experiences and the interactions with the system. Our results show that the contour plot visualization is perceived more helpful to explore new genres than the bar chart visualization, as the contour plot is perceived to be more informative and under- standable. Users spent significantly more time and used the mood control more in the contour plot than in the bar chart visualiza- tion. Overall, our results show that the contour plot visualization combined with mood control serves as the most helpful way for new music genre exploration, because the mood control is easier to understand and use when made transparent via an informative visualization. CCS CONCEPTS • Human-centered computing →User studies; Information visualization; User interface design; • Information systems → Recommender systems; Personalization. IUI ’21, April 14–17, 2021, College Station, TX, USA © 2021 Copyright held by the owner/author(s). ACM ISBN 978-1-4503-8017-1/21/04. https://doi.org/10.1145/3397481.3450700

UX of AI & PersonalizationResearch Papers

Deep Learning for Emotion Driven User ExperiencesCarmen Bisogni, Lucia Cascone et al. · 2021Deep knowledge about user characteristics and behaviors opens new and promising landscapes to the User Experience. Thanks to emerging machine learning techniques, a new form of communication chan- nel among users and applications may be exploited for customizing and finely tuning the dynamic behav- ior of applications to the peculiarities of their users. This work investigates the empathic improvement of the User Experiences and exploits inferences on user expressions for activating gaming and entertain- ment events, that are adopted in a cinematic way to create dynamic application behaviors. The presented approach is applied to a third/first-person horror adventure and a classic table game. As already verified in a preliminary phase of the research, user impressions, collected as subjective evaluation in a controlled experiment, are positive and encourage further steps, like the evaluation of other inferences on users. © 2021 Published by Elsevier B.V.

UX of AI & PersonalizationResearch Papers

An Emotion-Oriented Problem Space for UIMina Alipour · 2021Emotions significantly affect the human interaction process with computers. They constitute a dynamic user’s charac- teristic that can be crucial for adapting user interfaces (UI) to the user’s context. However, their impact on UI adaptation concepts and techniques is not well understood. This paper proposes a problem space that studies the design dimensions to be considered in UI adaptation to emotions. In particular, this emotion-oriented problem space for UI adaptation, highlights the temporal aspects of emotions. It is obtained from two literature reviews realized to identify the gaps in existing problem spaces and the potentials of including emotional aspects inside them. The proposed problem space can benefit all adaptive systems that aim to improve users’ and system’s performance based on users’ reactions to the system. Index Terms—User interface adaptation, Problem space, Emo- tion adaptation,Temporal adaptation.

UX of AI & PersonalizationResearch Papers

Emotions on the Go: Mobile Emotion Assessment in Real-Time using Facial ExpressionsThomas Kosch · 2020Exploiting emotions for user interface evaluation became an increas- ingly important research objective in Human-Computer Interaction. Emotions are usually assessed through surveys that do not allow information to be collected in real-time. In our work, we suggest the use of smartphones for mobile emotion assessment. We use the front-facing smartphone camera as a tool for emotion detection based on facial expressions. Such information can be used to reflect on emotional states or provide emotion-aware user interface adapta- tion. We collected facial expressions along with app usage data in a two-week field study consisting of a one-week training phase and a one-week testing phase. We built and evaluated a person-dependent classifier, yielding an average classification improvement of 33% compared to classifying facial expressions only. Furthermore, we correlate the estimated emotions with concurrent app usage to draw insights into changes in mood. Our work is complemented by a discussion of the feasibility of probing emotions on-the-go and potential use cases for future emotion-aware applications. CCS CONCEPTS • Human-centered computing →Smartphones; Mobile devices; Ubiquitous and mobile computing design and evaluation methods.

UX of AI & PersonalizationResearch Papers

Seemo: A Computational Approach to See EmotionsZhe Liu, Anbang Xu et al. · 2018Successful human interactions are based on becoming aware of other’s emotion and making adaptations accordingly. However, understanding emotion is a complex task that has generated countless debates among researchers over the past decades. The abstractive nature of human emotion highlights the need for a new data-driven approach that can better describe and compare across fine-grained emotional states. In this study, we propose Seemo, a novel neural embedding framework, which allows us to map human emotions into vector space representations. Seemo is trained using Twitter data and is evaluated on two fundamental use cases in traditional emotion research: determining the underlying dimensions of emotions and identifying the set of basic emotions. The evaluation reveals that on both tasks Seemo can generate results consistent with the mainstream theories. Results also show that the vector space representation of Seemo can effectively decode the important relationships between emotions that were usually not explicitly presented. Author Keywords Emotion; affective computing; social computing; computational social science ACM Classification Keywords H.5.2. Information Interfaces and Presentation: Group and Organization Interfaces

UX of AI & PersonalizationResearch Papers

Moodplay: Interactive Music Recommendation Based on Artists' Mood SimilarityIvana Andjelkovic, Denis Parra et al. · 2018A large amount of research in recommender systems focuses on algorithmic accuracy and optimization of ranking metrics. However, recent work has unveiled the importance of other aspects of the recommendation process, including explanation, transparency, control and user experience in general. Building on these aspects, this paper introduces MoodPlay , an interactive music-artists recommender system which integrates content and mood-based filtering in a novel interface. We show how MoodPlay allows the user to explore a music collection by musical mood dimensions, building upon GEMS, a music-specific model of affect, rather than the traditional Circumplex model. We describe system architecture, algorithms, interface and interactions followed by use-case and offline evaluations of the system, providing evidence of the benefits of our model based on similarities between the typical moods found in an artist’s music, for contextual music recommendation. Finally, we present results of a user study (N = 279) in which four versions of the interface are evaluated with varying degrees of visualization and interaction. Results show that our proposed visualization of items and mood information improves user acceptance and understanding of both the underlying data and the recommendations. Furthermore, our analysis reveals the role of mood in music recommendation, considering both artists’ mood and users’ self-reported mood in the user study. Our results and discussion highlight the impact of visual and interactive features in music recommendation, as well as associated human-cognitive limitations. This research also aims to inform the design of future interactive recommendation systems.

UX of AI & PersonalizationResearch Papers

Wearable ESM: Differences in the Experience Sampling Method across Wearable Devices2016The Experience Sampling Method is widely used for collecting self-report responses from people in natural settings. While most traditional approaches rely on using a phone to trigger prompts and record information, wearable devices now offer new opportunities that may improve this method. This research quantitatively and qualitatively studies the experience sampling process on head-worn and wrist-worn wearable devices, and compares them to the traditional “smartphone in the pocket.” To enable this work, we designed and implemented a custom application to provide similar prompts across the three types of devices and evaluated it with 15 individuals for five days (75 days total), in the context of real-life stress measurement. We found significant differences in response times across devices, and captured tradeoffs in interaction types, screen size, and device familiarity that can affect both users’ experience and the reports made by users. Author Keywords Experience Sampling Method; Ecological Momentary Assessment; wearable devices; smartwatch; smartphone; smart-eyewear; Google Glass. ACM Classification Keywords H.5.2. Information interfaces and presentation: User Interfaces.

UX of AI & PersonalizationResearch Papers

Designing Responsive Interactive Applications by Emotion-Tracking and Pattern-Based Dynamic User Interface AdaptationSanim Rashi, Christian Herdin · 2016Model-based user interface development environments (MB-UIDEs) can be enhanced by pattern-based frameworks to allow for richer design capa‐ bilities and more flexible responsive behavior during the runtime of the imple‐ mented target application. In this paper an experimental system prototype for integrating facial analysis and eye-tracking into a pattern-based dynamic user interface adaptation process is discussed. The resulting system evaluates the emotional state of the system users to trigger the HCI-pattern-based adaptation of the user interface. By monitoring the emotional states of the users over longer time periods, while the system changes its behavior and its appearance, conclu‐ sions about the perceived quality dimensions of the interactive application can be drawn.

UX of AI & PersonalizationResearch Papers

Affective modelling of users in HCI using EEGJyotish Kumara, Jyoti kumar · 2016Emotions have potential to play a role in HCI which is primarily dominated by cognitive measures. Human physiological communication channels are dominated by emotions. Emotion affects several human activities like communication, learning, decision making, cognition, perception etc. Further, as emotions are difficult to interpret and hard to measure, technologists and designers have been struggling to incorporate them in design and technology. On the other hand, advancement of technology has both necessitated and enabled us to understand emotions and put them to use in contexts like human computer interaction. This study reports an attempt to model emotions by means of electroencephalography (EEG). Video stimuli of four representative basic emotions based on Navarasa theory of Ancient Indian treatise called Natya Shastra were shown to participants and EEG data was collected. Power spectrum analysis of EEG signals associated with emotions was done. Further, the EEG analysis findings were compared with the subject’s self-reports about their emotional states during the experiment. EEG results have shown significantly consistent frequency patterns across the brain lobes for a given emotion. This study suggests that human emotions can be modeled for use in HCI either as an affect assessment tool or for affect based intelligent interactions. © 2015 The Authors. Published by Elsevier B.V. Peer-review under responsibility of the Scientific Committee of IHCI 2015.

UX of AI & PersonalizationResearch Papers

Developing Emotion-Aware, Advanced Learning Technologies: A Taxonomy of Approaches and FeaturesClaude Frasson, Nathan C. Hall · 2016A growing body of work on intelligent tutoring systems, affective computing, and artificial intelligence in education is exploring creative, technology-driven ap- proaches to enhance learners’ experience of adaptive, positively-valenced emotions while interacting with advanced learning technologies. Despite this, there has been no published work to date that captures this topic’s breadth. We took up this grand challenge by integrating related empirical studies and existing conceptual work and proposing a theoretically-guided taxonomy for the development and improvement of emotion-aware systems. In particular, multiple strategies system developers may use to help learners experience positive emotions are mapped out, including those that require different amounts and types of information about the user, as well as when this information is required. Examples from the literature are provided to illustrate how different emotion- aware system approaches can be combined to take advantage of different types of data, both prior to and during the learner-system interaction. High-level system features that emotion-aware systems can tailor to learners in order to elicit positive emotions are also described and exemplified. Theoretically, the taxonomy is primarily informed by the control-value theory of achievement emotions (Pekrun 2006, 2011) and its assumptions about the relationship between distal and proximal antecedents and the elicitation and Int J Artif Intell Educ (2017) 27:268–297 DOI 10.1007/s40593-016-0126-8 Note. This manuscript is based on an extended version of: Harley, J. M., Lajoie, S. P., Frasson, C., & Hall, N.C. (2015a). An integrated emotion-aware framework for intelligent tutoring systems. In C. Conati & N. Heffernan (Eds.), Lectures Notes in Artificial Intelligence: Vol. 9112. Artificial Intelligence in Education (pp. 620-624). Switzerland: Springer. * Jason M. Harley jharley1@ualberta.ca 1 Educational Psychology, University of Alberta, 6-102 Education North, Edmonton, AB T6G 2G5, Canada 2 Educational and Counselling Psychology, McGill University, 3700 McTavish Street 614, Montréal, QC H3A 1Y2, Canada 3 Computer Science and Operations Research, Université de Montréal, 2920 Chemin de la Tour, Pavillon André-Aisenstadt 2194, Montréal, QC H3C 3J7, Canada regulation of emotion. The taxonomy expands upon a dichotomy of emotion-aware systems proposed by D’Mello and Graesser (2015) and is intended to guide the design of emotion-aware systems that can fos

UX of AI & PersonalizationResearch Papers

A Comparative Study on different approaches of Real Time Human Emotion Recognition based on Facial Expression DetectionDey Anurag · 2015Facial Expression Recognition lies in one of the crucial areas of research for human-computer interaction and human emotion identification. For a system to recognize a facial expression it needs to come across multiple variability of human face like color, texture, posture, expression, orientation and so on. The first step to recognize a facial expression of a person with various facial movements of the muscles beneath the eyes, nose and lips are to be detected and further classifying those features by comparing them with a set of trained data values using a good classifier for recognizing the emotion. In this paper a comparative study of the different approaches initiated for automatic real-time facial expression recognition is undertaken along with their benefits and flaws which will further help in developing and improving the system.

UX of AI & PersonalizationResearch Papers

Understanding perception of algorithmic decisions: Fairness, trust, and emotion in response to algorithmic managementMin Kyung Lee · 2013Algorithms increasingly make managerial decisions that people used to make. Perceptions of algorithms, regardless of the algorithms’ actual performance, can significantly influence their adoption, yet we do not fully understand how people perceive decisions made by algorithms as compared with decisions made by humans. To explore perceptions of algo- rithmic management, we conducted an online experiment using four managerial decisions that required either mechan- ical or human skills. We manipulated the decision-maker (algorithmic or human), and measured perceived fairness, trust, and emotional response. With the mechanical tasks, algorithmic and human-made decisions were perceived as equally fair and trustworthy and evoked similar emotions; however, human managers’ fairness and trustworthiness were attrib- uted to the manager’s authority, whereas algorithms’ fairness and trustworthiness were attributed to their perceived efficiency and objectivity. Human decisions evoked some positive emotion due to the possibility of social recognition, whereas algorithmic decisions generated a more mixed response – algorithms were seen as helpful tools but also possible tracking mechanisms. With the human tasks, algorithmic decisions were perceived as less fair and trustworthy and evoked more negative emotion than human decisions. Algorithms’ perceived lack of intuition and subjective judg- ment capabilities contributed to the lower fairness and trustworthiness judgments. Positive emotion from human decisions was attributed to social recognition, while negative emotion from algorithmic decisions was attributed to the dehumanizing experience of being evaluated by machines. This work reveals people’s lay concepts of algorithmic versus human decisions in a management context and suggests that task characteristics matter in understanding people’s experiences with algorithmic technologies.

UX of AI & PersonalizationResearch Papers

User experience evaluation methods: Current state and development needsArnold P.O.S. Vermeeren, Effie Lai-Chong Law, Virpi Roto, Marianna Obrist, Jettie Hoonhout, Kaisa Väänänen-Vainio-Mattila · 2010The recent shift of emphasis to user experience (UX) has rendered it a central focus of product design and evaluation. A multitude of methods for UX design and evaluation exist, but a clear overview of the current state of the available UX evaluation methods is missing. This is partly due to a lack of agreement on the essential characteristics of UX. In this paper, we present the results of our multi-year effort of collecting UX evaluation methods from academia and industry with different approaches such as literature review, workshops, Special Interest Groups sessions and an online survey. We have collected 96 methods and analyzed them, among other criteria, based on the product development phase and the studied period of experience. Our analysis reveals development needs for UX evaluation methods, such as early-stage methods, methods for social and collaborative UX evaluation, establishing practicability and scientific quality, and a deeper understanding of UX. Author Keywords User Experience, Evaluation method, Methodological development needs ACM Classification Keywords H5.2. User Interfaces (D.2.2, H.1.2, I.3.6): Evaluation/methodology

UX of AI & PersonalizationResearch Papers

User experience - A research agendaMarc Hassenzahl, Noam Tractinsky · 2006Over the last decade, ‘user experience’ (UX) became a buzzword in the field of human–computer interaction (HCI) and interaction design. As technology matured, interactive products became not only more useful and usable, but also fashionable, fascinating things to desire. Driven by the impression that a narrow focus on interactive products as tools does not capture the variety and emerging aspects of technology use, practitioners and researchers alike, seem to readily embrace the notion of UX as a viable alternative to traditional HCI. And, indeed, the term promises change and a fresh look, without being too specific about itsdefinite meaning. The present introduction to the special issue on ‘Empirical studies of the user experience’ attempts to give a provisional answer to the question of what is meant by ‘the user experience’. It provides a cursory sketch of UX and how we think UX research will look like in the future. It is not so much meant as a forecast of the future, but as a proposal – a stimulus for further UX research.

UX of AI & PersonalizationResearch Papers

Approaching Awe, a Moral, Spiritual, and Aesthetic EmotionDacher Keltner, Jonathan HaidtIn this paper we present a prototype approach to awe. We suggest that two appraisals are central and are present in all clear cases of awe: perceived vastness, and a need for accommodation, defined as an inability to assimilate an experience into current mental structures. Five additional appraisals account for variation in the hedonic tone of awe experiences: threat, beauty, exceptional ability, virtue, and the supernatural. We derive this perspective from a review of what has been written about awe in religion, philosophy, sociology, and psychology, and then we apply this perspective to an analysis of awe and related states such as admiration, elevation, and the epiphanic experience.

Emotional DesignResearch Papers

1 Fear, Emotion, and ScienceComputers are beginning to acquire the ability to ex- press and recognize affect, and may soon be given the ability to “have emotions.” The essential role of emotion in both human cognition and perception, as demonstrated by recent neurological studies, indi- cates that affective computers should not only pro- vide better performance in assisting humans, but also might enhance computers’ abilities to make de- cisions. This paper presents and discusses key issues in “affective computing,” computing that relates to, arises from, or influences emotions. Models are sug- gested for computer recognition of human emotion, and new applications are presented for computer- assisted learning, perceptual information retrieval, arts and entertainment, and human health and inter- action. Affective computing, coupled with new wear- able computers, will also provide the ability to gather new data necessary for advances in emotion and cog- nition theory. 1 Fear, Emotion, and Science Nothing in life is to be feared. It is only to be under- stood. – Marie Curie Emotions have a stigma in science; they are believed to be inherently non-scientific. Scientific principles are derived from rational thought, logical arguments, testable hypotheses, and repeatable experiments. There is room alongside science for “non-interfering” emotions such as those involved in curiosity, frustration, and the pleasure of discovery. In fact, much scien- tific research has been prompted by fear. Nonetheless, the role of emotions is marginalized at best. Why bring “emotion” or “affect” into any of the deliberate tools of science? Moreover, shouldn’t it be completely avoided when considering properties to design into computers? After all, computers control significant parts of our lives – the phone system, the stock market, nuclear power plants, jet landings, and more. Who wants a computer to be able to “feel angry” at them? To feel contempt for any living thing? In this essay I will submit for discussion a set of ideas on what I call “affective computing,” computing that relates to, arises from, or influences emotions. This will need some further clari- fication which I shall attempt below. I should say up front that I am not proposing the pursuit of computerized cingulotomies1 or even into the business of building “emotional computers”. 1The making of small wounds in the ridge of the limbic sys- tem known as the cingulate gyrus, a surgical procedure to aid severely depressed patients. Nor will I propose answers

Emotional DesignResearch Papers

Review of eye tracking metrics involved in emotional and cognitive processesVasileios Skaramagkas, Giorgos Giannakakis et al.Eye behaviour provides valuable information reveal- ing one’s higher cognitive functions and state of affect. Although eye tracking is gaining ground in the research community, it is not yet a popular approach for the detection of emotional and cognitive states. In this paper, we present a review of eye and pupil tracking related metrics (such as gaze, fixations, saccades, blinks, pupil size variation, etc.) utilized towards the detection of emotional and cognitive processes, focusing on visual attention, emotional arousal and cognitive workload. Besides, we investigate their involvement as well as the computational recognition meth- ods employed for the reliable emotional and cognitive assessment. The eye-tracking publicly available datasets employed in relevant research efforts were concentrated and described their specifi- cations and details. The multimodal approaches which combine eye-tracking features with other modalities (e.g. biosignals), along with artificial intelligence and machine learning techniques were also surveyed in terms of their recognition/classification accuracy. The limitations, current open research problems and prospective future research directions were discussed for the usage of eye- tracking as the primary sensor modality. This study aims to comprehensively present the most robust and significant eye/pupil metrics based on available literature towards the development of a robust emotional or cognitive computational model. Index Terms—eye tracking, gaze, pupil, fixations, saccades, smooth pursuit, blinks, stress, visual attention, emotional arousal, cognitive workload, emotional arousal datasets, cognitive work- load datasets Vasileios Skaramagkas, Giorgos Giannakakis, Emmanouil Ktistakis, Dim- itris Manousos, Ioannis Karatzanis are with the Institute of Computer Science, Foundation for Research and Technology Hellas (FORTH), GR-700 13 Heraklion, Crete, Greece (Email: vskaramag@ics.forth.gr, ggian@ics.forth.gr, mandim@ics.forth.gr, karatzan@ics.forth.gr) Giorgos Giannakakis is with the Institute of AgriFood and Life Sciences, University Research Centre, Hellenic Mediterranean University, Heraklion, Greece. Emmanouil Ktistakis is with the Institute of Computer Science, Foundation for Research and Technology Hellas (FORTH) and the Laboratory of Optics and Vision, School of Medicine, University of Crete, Heraklion, Greece (Email: mankti@ics.forth.gr) Nikolaos S. Tachos and Evanthia E. Tripoliti, are with the Department of Biomedical Rese

Emotional DesignResearch Papers

Emotional Design in Digital User ExperienceTanja Radovanović, Dijana KovačevićDesign and human interaction have, in the last two decades, spread from urban environments to digital ones, as the use of digital products has become a daily norm and a necessity for most of the world's population. In the process of making a successful product design, its function, construction, usability, price, and materials were almost always considered. Still, in this paper, we are shedding light on how people perceive products through emotions and why it is so important for users and product success to include this variable in the design strategy process to get a better user experience. Considering the amount of use of digital products, there is a need to make them designed and optimized for our emotional well-being, inclusivity, and gender equality. Emotions are part of every human experience, and they are brought on by neurophysiological changes, triggered by thoughts, feelings, and behavioral responses, and are fundamental in our decision-making. The impact of emotions is an emerging research topic in every field connected to human experience, from psychology to computer science, urban planning, etc. The questions we are asking are: ‘How do products elicit emotions?’, ‘How can designers influence these emotions?’ and ‘What are the patterns that can be used in the design of websites, apps, AR/VR, and metaverse spaces?’

Emotional DesignResearch Papers

The Future of Emotion in Human-Computer InteractionGreg Wadley · 2022Emotion has been studied in HCI for two decades, with specifc tra­ ditions interested in sensing, expressing, transmitting, modelling, experiencing, visualizing, understanding, constructing, regulating, manipulating or adapting to emotion in human-human and human- computer interactions. This CHI 2022 workshop on the Future of Emotion in Human-Computer Interaction brings together in­ terested researchers to take stock of research on emotion in HCI to-date and to explore possible futures. Through group discussion and collaborative speculation we will address questions such as: What are the relationships between digital technology and human emotion? What roles does emotion play in HCI research? How should HCI researchers conceptualize emotion? When should HCI researchers use interdisciplinary theories of emotion or create new theory? Can specifc emotions be designed for, and where is this knowledge likely to be applied? What are the implications of emo­ tion research for design, ethics and wellbeing? What is the future of emotion in human-computer interaction? CCS CONCEPTS • Human-centered computing → Human computer interaction (HCI).

Emotional DesignResearch Papers

Library and Information Science ResearchMaja Kuhar, Tanja Merˇcun · 2022In the field of digital libraries, research on user experience is sparse, especially in terms of emotions, impressions, and stimulation evoked by interaction with the digital library. Given the many different methods and tools available for assessing user experience, two questionnaires and eye-tracking were explored to see how each can contribute to understanding user experience in digital libraries. An eye-tracking study with 30 participants was carried out using two digital libraries. Analysis of the questionnaires revealed that overall, one digital library was experienced more positively, with the difference most evident in the hedonic quality. The eye-tracking data revealed different gaze patterns in the two digital libraries, with significant difference in measure values particularly on the search boxes. When eye-tracking was combined with the questionnaire data, several corre­ lations were found, indicating that the search box position and the intuitiveness of the homepage had an impact on the user experience.

Emotional DesignResearch Papers

Psychology of Objects and Their Interaction with Our Culture and Society2022Numerous designers, sociologists, and psychologists have written about the relationships we establish with objects. Some speak of emotional connections, while others completely distance themselves from the connotation of emotions, valuing only the object’s function. Also, it should be noted that we are talking about inanimate objects, which can only offer us experiences related to the function for which they were created. This article aims to investigate the relationship between the object and the consumer, considering the society in which we live. We are taking into account the psychology of objects and how they play such an essential role in our lives, from their origins to the present. The evolution of object design is parallel to that of society, and it must be so because it has to respond to the needs of each moment. Most of the objects are created for practical purposes, but despite not having a defined use, one could say that decorative objects also have their function: to embellish. The field of study of this article intends to demonstrate also that even practical objects, if they have an aesthetic aspect, are easier to use, respecting specific criteria to be listed. It is about searching, classifying and analyzing each criterion to find a tool for understanding and hierarchical organization with which the individual can order the surrounding stimuli within their world of values and concepts. The methodology used is monographic- theoretical (we are dealing with a topic, an “abstract problem that may or may not have been the subject of other reflections”). It is divided into two parts, one about the theory of objects and the other that deals with the interaction of the object, through its interface, with society, and its psychological qualities. We will also establish right from the beginning the concept of interface as a communicating form and as a communication context of the object. We will take the interface as a communicating aspect of the object with the world, a “language” specific to each object. Just as we humans have our language to communicate, each object has its interface corresponding to its destination (the function for which it was designed). And depending on the “language” used (the interface), we get one response or another from the interlocutor. Each interface represents an identity, the identity of each object through which it communicates with the outside. We will refer to an influential author, Donald Norman, among others, who

Emotional DesignResearch Papers

Research on the Influence of Visual Factors on Emotion Regulation Interaction2021To guide the design direction of emotion regulation products that improve the positive emotions of users, investigation into the correlation between relevant visual factors and multi-dimensional complex emotions is needed. In the present study, an extended product emotion measurement method was adopted to describe the multi-dimensional emotional set of each influencing factor and calculate their weight according to the order. The positive and negative emotion indicators of all influencing factors were compared and the evaluation and ranking factors that affect users' emotional value of emotion regulation products were analyzed. The experimental results reveal that specific emotion mapping scenes on positive emotion are the most significant among the key factors affecting user emotion. Further, the influence of emotional stickers, interactive data visualization, and text on positive emotions decreased in turn. The influence of emotional text on positive emotion was the lowest. Through investigating the visual factors that affect the psychological emotions of users, the development of emotion regulating products could be guided in a more scientific and reasonable manner.

Emotional DesignResearch Papers

A Novel User Emotional Interaction Design Model Using Long and Short-Term Memory Networks and Deep Learning2021Emotional design is an important development trend of interaction design. Emotional design in products plays a key role in enhancing user experience and inducing user emotional resonance. In recent years, based on the user's emotional experience, the design concept of strengthening product emotional design has become a new direction for most designers to improve their design thinking. In the emotional interaction design, the machine needs to capture the user's key information in real time, recognize the user's emotional state, and use a variety of clues to finally determine the appropriate user model. Based on this background, this research uses a deep learning mechanism for more accurate and effective emotion recognition, thereby optimizing the design of the interactive system and improving the user experience. First of all, this research discusses how to use user characteristics such as speech, facial expression, video, heartbeat, etc., to make machines more accurately recognize human emotions. Through the analysis of various characteristics, the speech is selected as the experimental material. Second, a speech-based emotion recognition method is proposed. The mel-Frequency cepstral coefficient (MFCC) of the speech signal is used as the input of the improved long and short-term memory network (ILSTM). To ensure the integrity of the information and the accuracy of the output at the next moment, ILSTM makes peephole connections in the forget gate and input gate of LSTM, and adds the unit state as input data to the threshold layer. The emotional features obtained by ILSTM are input into the attention layer, and the self-attention mechanism is used to calculate the weight of each frame of speech signal. The speech features with higher weights are used to distinguish different emotions and complete the emotion recognition of the speech signal. Experiments on the EMO-DB and CASIA datasets verify the effectiveness of the model for emotion recognition. Finally, the feasibility of emotional interaction system design is discussed.

Emotional DesignResearch Papers

Review The Cognitive-Emotional Design and Study of Architectural Space: A Scoping Review of Neuroarchitecture and Its Precursor ApproachesJuan Luis Higuera-Trujillo · 2021Humans respond cognitively and emotionally to the built environment. The modern possibility of recording the neural activity of subjects during exposure to environmental situations, using neuroscientific techniques and virtual reality, provides a promising framework for future design and studies of the built environment. The discipline derived is termed “neuroarchitecture”. Given neuroarchitecture’s transdisciplinary nature, it progresses needs to be reviewed in a contextualised way, together with its precursor approaches. The present article presents a scoping review, which maps out the broad areas on which the new discipline is based. The limitations, controversies, benefits, impact on the professional sectors involved, and potential of neuroarchitecture and its precursors’ approaches are critically addressed.

Emotional DesignResearch Papers

COLLABORATIVE EMOTIONAL MAPPING AS A TOOL FOR URBAN MOBILITY PLANNING2021In this article, we present a framework to collect and represent people’s emotions, considering the urban mobility context of Curitiba. As a procedure, we have interviewed individuals during an intermodal challenge. The participants have described their experiences of urban mobility while using different transport modes. We have we used emojis as graphic symbols representing emotional data, once it is a modern language widely incorporated in everyday life as well as evokes a natural emotional association with the data we collected. We built an online geoinformation solution for visualising the emotional phenomenon. As a result, we found that the proposed methodology captures environmental factors as well as specific urban features triggering positive and negative/neutral emotions. Therefore, we validated the methodology of collaborative emotional mapping through volunteered geographic information, collecting and representing emotions on maps through emojis. Thus, here we argue this is a valid way to represent emotions and incorporate a modern language to maps. Based on the results and broader literature, we affirm this is a valuable alternative to increase knowledge about cities, once mapping emotions could assist urban planners in identifying variables, generating positive and negative feelings over the city space, which drives urban planning within a citizen-centred perspective.

Emotional DesignResearch Papers

Article Do Products Respond to User Desires? A Case Study. Errors and Successes in the Design Process, under the Umbrella of Emotional Design2020This article introduces a methodological approach to the evaluation of different industrial products according to Norman’s approach and dimensions, focusing on a specific case study. The study also shows different possibilities to guide industrial designers during the design process in order to create products with high emotional value. For those, the case study was done with 330 target specific users, submitting nine prototypes (designed for different targets) to the user experience evaluation and product perception analysis. The evaluated proposals were selected from a total of 45. The results show the visceral, behavioural and reflective levels perceived by those users to whom each product is intended, as well as the target deviation within the design process. In this sense, the emotional response reveals the asymmetric character of perception according to Norman’s dimensions.

Emotional DesignResearch Papers

NeuroDesign: Making decisions and solving problems through understanding of the human brain2020This paper introduces an emerging research field called NeuroDe- sign, which combines psychology, neuroscience, computer science, and design. It applies the cutting-edge cross-domain research methods to collect the designer’s physiological data and psychological data, which has essential experimental support significance for this research field. Studies on NeuroDe- sign are based on neuroscience and use psychology methods and computer models to study design-related activities. The combination of neuroscience and design is an emerging field, and researching in this field has considerable significance.

Emotional DesignResearch Papers

Can emotional design really evoke emotion in multimedia learning?2020The aim of this study was to investigate the effects of emotional design on learners’ performance and emotions. If emotional design has any effects on learners’ performance and emotions, then we attempted to explore dimensions that are accounted for such effects. 316 Chinese university students participated in this study. The students were divided into two groups: NED group - students in this group learned material based on neutral design, and PED group - students in this group learned material based on positive design. We explored the differences between two groups in student learning performance as well as emotion. Prior knowledge, retention, and transfer tests were also carried out and outcomes were compared across two groups. In addition, student emotion was measured using a positive affect scale and biofeedback instruments. The results showed that PED group outperformed NED group on retention and transfer tests. However, insignificant difference was found between two groups on student emotion. Our results suggest that, although the effect of emotional design was insignificant on student emotion, it was significant on student learning performance (i.e. on retention and transfer tests). Based on our results, several implications were drawn and suggestions were made for educators and researchers.

Emotional DesignResearch Papers

Using Emotional Design To Make Memories And Enhance Using Emotional Design To Make Memories And Enhance Relationships Relationships2019We have all experienced this. When we see a thing, the memory of it will come back in our minds no matter how many years have passed. This is the power of memory. What follows is our feelings and emotional reaction to this memory. Reminders of happy memories can bring back pleasant feelings tied to the original experience, regulate positive emotion and promote better well-being. This paper will focus on using emotional design to generate and recall positive memories in order to develop healthy relationships.

Emotional DesignResearch Papers

Emotional design: the development of a process to envision emotion-centric new product ideas2019There is ample evidence, in many sectors, of the crucial importance of the emotional experiences in the interaction between users and products. Generating products with richer and significant emotional features is a complex challenge. In order to better face this challenge, professionals responsible for designing and developing new products could be facilitated with techniques and tools to understand emotions and to convey specific emotions in the new products. This paper presents the development of a process to support product design teams to envision emotion-focused new product ideas - Emotion- Driven Innovation (E-DI). We have adopted the process research methodology proposed by Platts, which encompasses four main steps: 1) state-of-the-art review, 2) process creation, 3) process development, and 4) process validation. This paper presents the results of the three first steps. The state-of-the-art literature review has been the foundation of the process creation step, which resulted in a three-phase workshop-based process: Emotion Knowledge Acquisition, Emotion Goal Definition, and Idea Generation. In the third step of the research methodology, the feasibility, usability, and utility have been tested through four studies which have involved master design students from Portugal and Italy. The results of these four tests show that Emotion-Driven Innovation process supports designers 1) to identify the occurrence of emotions in certain category of products present in the market, 2) to apply this information to make strategic decisions when defining the emotional intentions for the new product, and 3) to focus their creative thinking to develop strong and meaningful emotion-centric ideas. Teresa Alaniz et al. / Procedia Computer Science 158 (2019) 474–484 475 emotional attachment to products (Mugge, Schifferstein, & Schoormans, 2005; Schifferstein & Zwartkruis-Pelgrim, 2008). Emotions are “high-intensity, specific feeling states that are directed at a particular object, and direct ongoing thoughts and behaviours” (Desmet, Vastenburg, and Romero, 2016). Generating products with significant emotional features is a complex challenge, as professionals responsible for designing and developing new products should be able to focus the design effort in eliciting specific emotions. This challenge has been addressed in the design literature of the last 20 years, resulting in the development of different tools supporting the task of “designing for emotions” (e.g. Desm

Emotional DesignResearch Papers

Emotional MachinesJordi Vallverdú · 2019Artificial Intelligence (AI) is the motor that fuels the most profound revolution in the history of humankind. The new era of information society [10], even called "the Fourth Revolution" [8], has produced deep changes into sciences, economies, and societies [9]. This revolution is not only about formal heuristics, or the called "algorithmic society", but also is explicitly related to the creation of strong interactions between humans and machines. Consequently, these machines must be able to deal with the most intrinsic feature of human nature: emotions. If emotions had been historically considered as disturbing elements of human rationality, the neurological revolution and new experimental tools such as magnetic scanning of the brain (with great success for fMRI) made possible a complete Copernican turn into the evaluation of the role of emotions in cognitive frameworks [13,14]. This process led experts in natural and artificial cognition to consider the necessity of including emotions into their models [37]. Affective computing or social robotics [7,44] increased not only the necessity of studies about how to improve the emotional interaction between humans and machines [57,59] but also how to design cognitive architectures which included biomimetic elements related with emo-

Emotional DesignResearch Papers

Emotional Maps: Participatory Crowdsourcing of Citizens´ Perceptions of Their Urban Environment2018*Public participation and civic engagement in the urban planning process are societal trends that stretch across countries, cultures, and classes. After decades of communist regimes in the Eastern Bloc, where there was basically no civic participation, civic society in the Czech Republic began to engage in discussions with the authorities, and citizens became more active in local planning. In 1994 eleven municipalities started the Network of Healthy Cities of the Czech Republic as a platform for sharing good practices in sustainable development and local participation. In the last three years, members of the Network have used emotional mapping activities to facilitate and improve the process of participatory planning. This paper describes the timeline of development and the deployment of an emotional mapping methodology in various workshops in the Healthy Cities network. A total of forty-six emotional mapping workshops were organised in thirty-five municipalities of the Czech Republic. The paper presents the change from crayon-based maps to digital web-mapping platforms; and presents a case study of the Prague 12 district, where emotional mapping workshops were used to explore the perception of safety, among other issues.*

Emotional DesignResearch Papers

Emotional Design on User Experience-based Development System2018In UX, user as a center of the process has crucial role in determining the quality of a system. System has broad definition. In this study, system definition restricted to the outcome of information technology (IT) product. So far, there are so many approaches which are involving user as a center of process. Involving user in the UX process is not limited as evaluator in the measurement. Moreover, user research should be conducted deeply aims to excavate all about user deeper. Functionality and usability are two measurements methods which ensure user can experience using system intuitively. In order to excavate intuitive experience, it is required to figure out user deeper. Furthermore, physiological and psychological aspects are mandatory to be discussed. Psychology and physiology theories are related to the processes of designing system. This study aims to conduct argumentative literature review about the emotional design on the user experience (UX). Papers reviewed had been selected and limited related to the problems. Result of this study is proposed methodology. This methodology is proposed aims to gain deeper perspective on user research. Hopefully, this methodology can be considered to strengthen ideas about user mental model theories into system development.

Emotional DesignResearch Papers

Designing User Interfaces in Emotionally-Sensitive Applications2018A method for analysing emotion and motivation for design of affective user interfaces is described. Theories from psychology of emotion and motivation are applied in user-centred design to analyse desired influences on users, and plan appropriate UI features, based on a scenario-based approach that analyses affective situations. The method informs design of multimedia and agent-based user interfaces for persuasive technology applications and domains where the user interface may have emotive effects. Use of method is illustrated with a case study in health informatics for a persuasive technology application.

Emotional DesignResearch Papers

Drivers of Consumers' Emotional Engagement with Everyday Products: An Intensive Review of the Literature and an Attempt to Conceptualize the Consumer-Product Interactions Within the Emotional Design Process2017....................................................................................................................................................... iii

Emotional DesignResearch Papers

Developing Emotional Design: Emotions as Cognitive Processes and their Role in the Design of Interactive TechnologiesAmon Rapp · 2017In the last 20 years, the debate on the role of emotions in the field of industrial design has grown exponentially. Emotional Design emerged as the effort to promote positive emotions \(Norman, 2007\) or pleasure in users \(Jordan, 2002; Green and Jordan, 2003\) by means of design properties of products and services. According to Van Gorp and Adams \(2012\), design based on emotions can affect overall user experience deeply, since emotions influence decision making, affect attention, memory, and generate meaning. It is possible to identify two main approaches to applied emotional design. The first is based on the modification of object's aesthetic appearance or interface, the latter focuses on promoting fluent and engaging interactions.

Emotional DesignResearch Papers

Designing Products with Added Emotional Value: Development and Appllcation of an Approach for Research Through Design2017*In this paper a design approach is introduced for designing products with added emotional value. First, the approach is established, based on a theoretical framework and a non-verbal instrument to measure emotional responses. Second, the value of the design approach was assessed by applying it to the design of mobile telephones. Mobile telephones were found to be useful vehicles as people appear to have strong feelings about this product. A user study was conducted which resulted in the identification of two user groups ('trend followers' and 'security seekers') and for each group an emotional profile. Four telephones were designed which, for each group, either were intended to or were not intended to match the group's profile. Finally, these designs were evaluated with the nonverbal instrument. The results indicate that the approach is appropriate for designing products with added emotional value. The advantages and disadvantages of the approach are discussed and further research directions indicated*

Emotional DesignResearch Papers

Emotional Design in Web Interfaces2017In the area of human-computer interaction, over the last decade, there has been a growing interest on emotional factors, valuing above all the user experience. Emotions play a crucial role - in terms of both performance and influence - in areas such as attention, motivation, memory, decision- making and behavior. Therefore, not only emotion influences the interaction with websites but they also trigger emotional responses, and these responses can determine which website users choose. Therefore, were analyzed the emotional responses triggered in the interaction with Duolingo's interface (a learning languages website) taking into account the different components of emotional design, using data gathering instruments such as eye tracking and self-reporting methods. In this way, the present work intended to contribute to the design of interfaces that appeal in a greater extent to the users' emotions, in order to improve their user experience while increasing their level of engagement.

Emotional DesignResearch Papers

Positive Technology, Computing, and Design: Shaping a Future in Which Technology Promotes Psychological Well-BeingAndrea Gaggioli · 2017More and more of our daily activities depend on some kind of interactive device or digital service. Furthermore, the use of information and communication technologies (ICTs) is not limited to the long hours that we spend at the office. Our free time, too, has been increasingly colonized by technology-mediated experiences delivered through smartphones, tablets, and other personal wearable devices. Even sport activities have been infiltrated by technologies from fitness trackers to wearable action cams.

Emotional DesignResearch Papers

The Discrete Emotions Questionnaire: A New Tool for Measuring State Self-Reported EmotionsCindy Harmon-Jones1, Brock Bastian et al. · 2016Several discrete emotions have broad theoretical and empirical importance, as shown by converging evidence from diverse areas of psychology, including facial displays, develop- mental behaviors, and neuroscience. However, the measurement of these states has not progressed along with theory, such that when researchers measure subjectively experi- enced emotions, they commonly rely on scales assessing broad dimensions of affect (posi- tivity and negativity), rather than discrete emotions. The current manuscript presents four studies that validate a new instrument, the Discrete Emotions Questionnaire (DEQ), that is sensitive to eight distinct state emotions: anger, disgust, fear, anxiety, sadness, happiness, relaxation, and desire. Emotion theory supporting the importance of distinguishing these specific emotions is reviewed.

Emotional DesignResearch Papers

The Potential of Virtual Reality for the Investigation of AweAnna Esposito · 2016The emotion of awe is characterized by the perception of vastness and a need for accommodation, which can include a positive and/or negative valence. While a number of studies have successfully manipulated this emotion, the issue of how to elicit particularly intense awe experiences in laboratory settings remains. We suggest that virtual reality (VR) is a particularly effective mood induction tool for eliciting awe. VR provides three key assets for improving awe. First, VR provides users with immersive and ecological yet controlled environments that can elicit a sense of "presence," the subjective experience of "being there" in a simulated reality. Further, VR can be used to generate complex, vast stimuli, which can target specific theoretical facets of awe. Finally, VR allows for convenient tracking of participants' behavior and physiological responses, allowing for more integrated assessment of emotional experience. We discussed the potential and challenges of the proposed approach with an emphasis on VR's capacity to raise the signal of reactions to emotions such as awe in laboratory settings.

Emotional DesignResearch Papers

Emotional Design in Multimedia Learning: How Emotional Intelligence Moderates Learning OutcomesJeya Amanth · 2016This study is designed as a preliminary study to explore the effects of emotional intelligence (EI) on achievement, perceived intrinsic motivation and perceived satisfaction when expose to an emotional designed Multimedia Learning Environment (MLE) that was designed to induce either positive, neutral or negative emotions. All three designs had similar content and narration but differed in visual element such as colour, font size, font style and images. Based on the findings, it was reported that students performed better in the design used to induce negative emotion (NegD design) followed by the positive (PosD) and Neutral (NeuD). There is no significant difference in levels of emotional intelligence towards these learning outcomes; however, students with Low EI performed better overall. EI only qualified perceived satisfaction when using a MLE designed to induce emotions and it was found that students with Low EI preferred the design that induces positive emotions. In addition, High EI students favored designs with emotionality (positive or negative) compared to neutral design. Index Terms—Emotional Design, Engineering Education, Emotional Intelligence, Multimedia- Based Learning, Aesthetics.

Emotional DesignResearch Papers

Emotion and Decision MakingJennifer S. Lerner · 2015A revolution in the science of emotion has emerged in recent decades, with the potential to create a paradigm shift in decision theories. The research reveals that emotions constitute potent, pervasive, predictable, sometimes harmful and sometimes beneficial drivers of decision making. Across dif- ferent domains, important regularities appear in the mechanisms through which emotions influence judgments and choices. We organize and analyze what has been learned from the past 35 years of work on emotion and de- cision making. In so doing, we propose the emotion-imbued choice model, which accounts for inputs from traditional rational choice theory and from newer emotion research, synthesizing scientific models. 799 Annu. Rev. Psychol. 2015.66:799-823. Downloaded from www.annualreviews.org Access provided by 109.228.76.45 on 09/07/22. For personal use only. Click here for quick links to Annual Reviews content online, including: • Other articles in this volume • Top cited articles • Top downloaded articles • Our comprehensive search Further ANNUAL REVIEWS Bounded rationality: the idea that decision making deviates from rationality due to such inherently human factors as limitations in cognitive capacity and willpower, and situational constraints Normative: how and/or what people should ideally judge or decide Emotion: multifaceted, biologically mediated, concomitant reactions (experiential, cognitive, behavioral, expressive) regarding survival-relevant events JDM: judgment and decision making Contents

Emotional DesignResearch Papers

Emotions in Design for ValuesPieter Desmet · 2015The contributions to this handbook show that technology is not value neutral, as is often thought. In this chapter, we argue that the inherent value-ladenness of technology evokes positive and negative emotions of the people who encounter or use it, by touching upon their personal and moral values. These emotions enable people to make concrete practical and moral judgments and to act accord- ingly. In this chapter, it is therefore proposed that emotions of users and designers alike should not be marginalized as being irrational and irrelevant, but instead be embraced as valuable gateways to values. Emotions reveal those values that matter to our well-being given a particular design or technology, and they are an important source of moral knowledge by being crucial to our capacity of moral reflection. This chapter discusses six sources of emotions in human-technology interaction and proposes how an understanding of user emotions can support design processes. In addition, the chapter discusses how emotions can resolve the lack of moral considerations in traditional approaches that assess the desirability of technology. It is argued that emotions do this by opening the gateway to moral considerations, such as responsibility, autonomy, risk, justice, and equity. This means that moral emotions can – and should – play an important role in the development of technology and can be considered to be indicators of success and failure in value-driven design processes.

Emotional DesignResearch Papers

Unconscious Human Behaviour in Product Design: Designers' Perception, Analysis, and Reflection2014The purpose of this paper is to evaluate a new perimeter of design thinking with respect to the value of unconscious human behaviour, as well as the direction for the development of innovative product design. In this study, Verbal Protocol Analysis (VPA) is used as a method to bring out into the open that somewhat mysterious cognitive ability of designers. Designers were asked to sketch a conceptual product design based on given design brief. The design brief consist with four images of interaction between user and products which are categorized into four attributes of unconscious everyday human behaviour. In this session, designers verbalized their thoughts, feelings and beliefs while doing their conceptual sketches. There are two objectives in this study. The first objective of this paper is to find out what words are generally used by designers to describe their perception towards the theory of unconscious human behaviour in product design. The second objective is to determine how designers reflect the theory by generating the innovative concept. This has led to the following implications: 1. The identification of general understanding and perception of the theory of unconscious human behaviour in product design, including the similarities and contradicting elements. 2. The development of an understanding on how these perceptions, expressed as an adjective, influences or can be used as a basis of identifying problem in design. The study has shown that in finding a fit between human values, designers should start to understand critically and look at every tiny factor existing in human unconscious behaviour. It is hoped the study will establish an understanding of the value of unconscious human behaviour, achieve a new knowledge and develop significant information on understanding the user’s implicit needs to design concept of an innovative solution. Key Words: unconscious human behaviour; design thinking; conceptual sketches

Emotional DesignResearch Papers

Using a simulated environment to investigate experiences reported during space travel2013Taylor & Francis makes every effort to ensure the accuracy of all the information (the "Content") contained in the publications on our platform. However, Taylor & Francis, our agents, and our licensors make no representations or warranties whatsoever as to the accuracy, completeness, or suitability for any purpose of the Content. Any opinions and views expressed in this publication are the opinions and views of the authors, and are not the views of or endorsed by Taylor & Francis. The accuracy of the Content should not be relied upon and should be independently verified with primary sources of information. Taylor and Francis shall not be liable for any losses, actions, claims, proceedings, demands, costs, expenses, damages, and other liabilities whatsoever or howsoever caused arising directly or indirectly in connection with, in relation to or arising out of the use of the Content.

Emotional DesignResearch Papers

Cognitive approaches to emotions2013**Article** in Trends in Cognitive Sciences · January 2014 DOI: 10.1016/j.tics.2013.12.004 · Source: PubMed CITATIONS 167 READS 5,099 **2 authors: Some of the authors of this publication are also working on these related projects:** Reasoning, modulation and model theory View project Keith Oatley University of Toronto **185** PUBLICATIONS **11,062** CITATIONS SEE PROFILE Phil Johnson-Laird Princeton University **380** PUBLICATIONS **28,539** CITATIONS SEE PROFILE

Emotional DesignResearch Papers

Unconscious Human Behavior at Visceral Level of Emotional Design2013In the near future, the emphasis on product design innovation will be on finding a fit between technology and human values. However, there is still a limited discussion available on the unconscious human behaviour as well as inadequate literature related to the visceral level of emotional design. The purpose of this study is to manipulate the respect to the emotional design, as well as the direction for the development of innovative product design. © 2013 Published by Elsevier Ltd. Selection and peer-review under responsibility of the Centre for Environment- Behaviour Studies (cE-Bs), Faculty of Architecture, Planning & Surveying, Universiti Teknologi MARA, Malaysia.

Emotional DesignResearch Papers

Emotions Are RealLisa Feldman Barrett · 2012It is obvious that emotions are real, but the question is what kind of "real" are they? In this article, I outline a theoretical approach where emotions are a part of social reality. I propose that physical changes (in the face, voice, and body, or neural circuits for behavioral adaptations like freezing, fleeing, or fighting) transform into an emotion when those changes take on psychological functions that they cannot perform by their physical nature alone. This requires socially shared conceptual knowledge that perceviers use to create meaning from these physical changes (as well as the circuitry that supports this meaning making). My claim is that emotions are, *at the same time*, socially constructed and biological evident. Only when we understand all the elements that construct emotional episodes, in social, psychological, and biological terms, will we understand the nature of emotion.

Emotional DesignResearch Papers

Positive Psychology and Digital Games: The Role of Emotions and Psychological Flow in Serious Games DevelopmentAndreas Alexiou, Michaéla Schippers et al. · 2012In this paper we will discuss how positive psychology can contribute to the design of digital games and in particular training applications like Serious Games. While digital games have been known for their ability to deeply immerse users, stimulate the senses and tap into a broad range of emotions, it has proven rather challenging to use them as a vehicle for pedagogy. Relevant research is still at its infancy and many of the mechanisms that foster knowledge creation and enhance learning need to be mapped out before scripted in the game. The theory of psychological flow and the role of positive emotions in broadening people's thought-action repertoires bring some practical insights and pave the path for tackling some important design questions. Yet there are still major challenges and uncharted waters to be explored in order for the technology to deliver what has been promised.

Emotional DesignResearch Papers

Emotional Design in Human Factors and Ergonomics2010The concept of emotion is closely related to affect, which is an encompassing term and it consists of emotions, feelings, moods, and evaluations (Simon, Clark, & Fiske, 1982). The most important concept is probably emotion. Nevertheless, in psychology, the theories about emotion consider it a 'very confused and confusing field of study' (Ortony, Clore, & Collins, 1988) and thus there is no consensus on a definition. Various factors are associated with emotions, including subjective factors, environmental factors, and neural and hormonal processes. In this chapter, we make use of the summary of emotion provided by Kleinginna and Kleinginna (1981), which incorporates the key elements of definitions in psychology as follows: (1) Emotions give rise to affective experience, such as pleasure or displeasure. (2) Emotions stimulate us to generate cognitive explanations to attribute the cause to ourselves or to the environment, for example. (3) Emotions trigger a variety of internal adjustments in the autonomic nervous system, such as an increased heart rate and a decreased skin conductance response. (4) Emotions elicit behaviors that are often, but not always, expressive (laughing or crying), goal-directed (approaching or avoiding), and adaptive (removal of a potential threat).

Emotional DesignResearch Papers

Framework of Product Experience2007In this paper, we introduce a general framework for product experience that applies to all affective responses that can be experienced in human-product interaction. Three distinct components or levels of product experiences are discussed: aesthetic experience, experience of meaning, and emotional experience. All three components are distinguished in having their own lawful underlying process. The aesthetic level involves a product's capacity to delight one or more of our sensory modalities. The meaning level involves our ability to assign personality or other expressive characteristics and to assess the personal or symbolic significance of products. The emotional level involves those experiences that are typically considered in emotion psychology and in everyday language about emotions, such as love and anger, which are elicited by the appraised relational meaning of products. The framework indicates patterns for the processes that underlie the different types of affective product experiences, which are used to explain the personal and layered nature of product experience.

Emotional DesignResearch PapersUX of AI & Personalization

Nine sources of product emotion2007This paper introduces a framework of nine sources of product-evoked emotions, which each can be considered to be the outcome of a unique pattern of eliciting conditions. Three main theories of product affect served as the fundament for this framework that combines the two key variables ‘stimulus’ (related to the product) and ‘concern’ (related to the person). The framework of nine sources of product emotion can be used as a basis for understanding and exploring the complex and layered emotional responses often elicited by products and services. Because the framework is based on empirical evidence of how people experience emotions, and of how products elicit emotions, it can support designers in their efforts to design for emotions. In addition, the framework can be used to structure research efforts reported in the research literature and to identify opportunities for new research efforts.

Emotional DesignResearch Papers

EXPLOITING EMOTIONS FOR SUCCESSFUL PRODUCT DESIGN2007The ever-increasing competitiveness in product design is resulting in good product functionality and usability no longer being sufficiently effective differentiators in the market place. As a result stakeholder’s attention is shifting to other product attributes such as the pleasurable emotions experienced during interaction. Designing for product-emotions is a relatively new emerging field in product design which is however being accredited increasing importance because of its new product development and marketing potential. This research paper reports the research being conducted at the Concurrent Engineering Research Unit (CERU) in the Department of Manufacturing Engineering (DME) at the University of Malta (UOM) via a research project entitled Demo. This research contributes to this field with the development of a phenomena model of product emotion elicitation that will lead to the future development of the required knowledge to provide an envisaged computational Design for Emotion (DFe) support for designers.

Emotional DesignResearch Papers

The focus of UX research is to design and develop systems that must support usability and user’s affective needs and goals[10-11]. UX research has gained more interest due to limitations of the conventional usability models [4]. UX studies do not only focus on task related aspects but also on affective qualities, sensation, meaning and value of interactive systems, products and services [12-14]. In order to better understand the concept of UX, many frameworks and models are proposed e.g. [11, 14, 15] that include various integrated UX constructs and measures. These frameworks are presented from different perspectives that include interaction-centered, user-centered and system-centered [16, 17]. It is also focused to understand and document different types of experience created while interacting with systems. Experience is described as a constant stream of “self-talk” that occurs while interaction is carried out with products e.g. using instant messaging systems. An experience is described as something that can be articulated e.g. watching a movie and sitting on free fall ride. Co-experience is described as the motions and meanings created together while interacting with products e.g. playing mobile messaging games with friends. UX can be created either positive or negative depending on systems qualities perceived by users [18-20]. It introduces a valid point of interest to research that how positive UX of interactive systems can be created, measured and modeled [19]. Thus, UX is being studied extensively in HCI field to design systems to be more useful, pleasant and attractive [14, 18]. Despite the availability of different frameworks and models, there is still no consensus on the definition of UX [3, 10, 21]. It is argued that UX encompasses various integrated aspects and shares diverse views. The wider scope and incoherent views on UX make it more complex [4, 10]. It presents many challenges such as selecting and validating the core constructs, factors and relevant2006In recent years, the notion of User Experience (UX) has gained a greater attention among HCI researchers in academia and industry. Due to its importance, several frameworks and models have been proposed to design and assess UX of interactive systems. These models guide to improve the design and help to determine the quality of interactive systems, products and services. UX is highly subjective, dynamic, and context dependent; it evolves during the interaction with the system. Different factors collectively influence UX and present a challenging task to define, model, measure and validate it. The less attention is paid to understand and underline these factors; this paper is an attempt to understand and underline the core UX factors based on literature review. These factors make UX more complex, diverse and vague in nature. It is recommended to incorporate the management aspect in UX process that may help to overwhelming the issues of complexity, diversity and vagueness.

Emotional DesignResearch Papers

Emotional Design; Application of a Research-Based Design Approach2006In this paper, we discuss an approach to ‘design for wow’ that focuses on the emotions that constitute a wow-experience. In this approach, the eliciting conditions of these emotions are used to define a product character with a high wow-impact. In addition to the approach, a measurable wow-index is introduced. First, a concept of wow is described in which wow is explained as a combination of fascination, pleasant surprise, and desire. The eliciting conditions of these three emotions are examined and combined to a ‘wow-appraisal.’ This concept is applied in the design of a mobile telephone. A combination of qualitative and quantitative research methods was used to formulate concern themes relevant for the wow-appraisal. These themes were used to create a layered product character and a prototype of the final design. An evaluation study demonstrated that the product designed with this approach rated higher on the wow-index than alter- native products.

Emotional DesignResearch Papers

Feelings and Consumer Decision Making 1Seunghee Han, Jennifer S. Lerner · 2006This article presents the Appraisal Tendency Framework (ATF) (Lerner & Keltner, 2000, 2001; Lerner & Tiedens, 2006) as a basis for predicting the influence of specific emotions on consumer decision making. In particular, the ATF addresses how and why specific emotions carry over from past situations to color future judgments and choices. After reviewing the main assumptions and the five main principles of the framework, two streams of research are presented. One stream addresses emotional carry-over effects on the assessment of risk; the other addresses carry-over effects on the assessment of monetary value. Because risk assessment and value assessment are fundamental psychological processes, understanding them has the potential to yield manifold implications for consumer judgment and decision making. The concluding sections highlight limitations and future directions of the framework. Feelings and Consumer Decision Making 3 3 Feelings and Consumer Decision Making: The Appraisal-Tendency Framework

Emotional DesignResearch Papers

REVIEW ESSAY: EMOTIONAL DESIGN by DONALD A. NORMANJohn Mueller · 2004The previous books do not need to be read to appreciate "Emotional Design," but that would enrich the feeling of synthesis that is reached in the fourth volume. Norman's past efforts have focused largely on long neglected usability issues, but now his work moves to combine functionality with aesthetics, and with rational explanation. Norman describes his personal journey in the final chapter on "Personal Reflections." I recommend that chapter be read first, as an orientation for newcomers to the everyday-things series, or as refresher for those who have read the earlier volumes.

Emotional DesignResearch Papers

Design and Emotion: Time for a New Direction?Terence Love · 2004This paper describes research investigating why the extensive effort in Design and Emotion research and publications has not had more significant effect in improving design theory and practice in spite of the large amounts of funding expended, the number of research projects and research centers and the large number of publications. The analyses point to two foundational research issues that appear to have been overlooked and which point to why Design and Emotion research culture is failing to make radical and significant impacts on design theory, design research, design practice and design education across all the major fields of design in the art and design, technical design and other design sectors. The paper concludes with a brief outline of the changes likely to make the Design and Emotion field more effective in improving design outcomes, design practice, design research and design theory. Key words: Design and Emotion, theory failure, design practice failure, cognitive neuroscience.

Emotional DesignResearch Papers

From Disgust to Desire: How Products Elicit Emotions2003| Article · October 2003 | | | |-------------------------------------------------------------------------------------|--------------------------------------------------------------------|-------| | | DOI: 10.1201/9780203608173-c2 | | | | | | | CITATIONS | | READS | | 20 | | 1,281 | | 1 author: | | | | | Pieter Desmet | | | | Delft University of Technology | | | | 158 PUBLICATIONS 6,877 CITATIONS | | | | SEE PROFILE | | | | | | | Some of the authors of this publication are also working on these related projects: | | | | | Design - + Negative emotions for Positive experiences View project | | | | PHD Project View project | |

Emotional DesignResearch Papers

Emotion in Human–Computer InteractionScott Brave · 2002Emotion is a fundamental component of being human. Joy, hate, anger, and pride, among the plethora of other emotions, motivate action and add meaning and richness to virtually all human experience. Traditionally, human–computer interaction (HCI) has been viewed as the "ultimate" exception; users must discard their emotional selves to work efficiently and rationality with computers, the quintessentially unemotional artifact. Emotion seemed at best marginally relevant to HCI and at worst oxymoronic. Recent research in psychology and technology suggests a different view of the relationship between humans, computers, and emotion. After a long period of dormancy and confusion, there has been an explosion of research on the psychology of emotion (Gross, 1999). Emotion is no longer seen as limited to the occasional outburst of fury when a computer crashes inexplicably, excitement when a video game character leaps past an obstacle, or frustration at an incomprehensible error message. It is now understood that a wide range of emotions plays a critical role in every computer-related, goal-directed activity, from developing a three-dimensional (3D) CAD model and running calculations on a spreadsheet, to searching the Web and sending an e-mail, to making an online purchase and playing solitaire. Indeed, many psychologists now argue that it is impossible for a person to have a thought or perform an action without engaging, at least unconsciously, his or her emotional systems (Picard, 1997b).

Emotional DesignResearch Papers

The role of emotions in marketingElyria Kemp, Steven W. Kopp · 1999*Emotions are mental states of readiness that arise from appraisals of events or one ' s own thoughts. In this article, the authors discuss the differentiation of emotions from affect, moods, and attitudes, and outline an appraisal theory of emotions. Next, various measurement issues are considered. This is followed by an analysis of the role of arousal in emotions. Emotions as markers, mediators, and moderators of consumer responses are then analyzed. The authors turn next to the influence of emotions on cognitive processes, which is followed by a study of the implications of emotions for volitions, goal-directed behavior, and decisions to help. Emotions and customer satisfaction are briefly explored, too. The article closes with a number of questions for future research.*

Emotional DesignResearch Papers

Human factors for pleasure in product usePatrick W. Jordan · 1998The importance of user centred design is increasingly being recognised. Perhaps the most significant evidence for thJs is the growing number of human factors professionals employed both in academia and in industry. Further evidence includes the burgeoning literature addressing issues relating to user centred design, th.e number of conferences concerned with human factors issues and the use of slogans such as 'ergonomically designed' in product advertisements.

Emotional DesignResearch Papers

Pleasure with Products: Design based on KanseiSeungHee Lee · 1997When a designer starts to design the form of a new product, she needs to integrate many demands and wishes that the prospective users of the product may have. Not only technical and objective demands are important, but also aesthetic, emotional, and other experiential factors, some of which are hard or impossible to express objectively. In design practice, the designer has to balance between objective and subjective properties, between functional technology and emotional expressiveness, between information and inspiration. Design development by '*Kansei* (subjective criteria) science' or '*Kansei* engineering' is a new approach which originated in these conditions.

Emotional DesignResearch Papers

What's Basic About Basic Emotions?1990A widespread assumption in theories of emotion is that there exists a small set of basic emotions. From a biological perspective, this idea is manifested in the belief that there might be neurophysiological and anatomical substrates corresponding to the basic emotions. From a psychological perspective, basic emotions are often held to be the primitive building blocks of other, nonbasic emotions. The content of such claims is examined, and the results suggest that there is no coherent nontrivial notion of basic emotions as the elementary psychological primitives in terms of which other emotions can be explained. Thus, the view that there exist basic emotions out of which all other emotions are built, and in terms of which they can be explained, is questioned, raising the possibility that this position is an article of faith rather than an empirically or theoretically defensible basis for the conduct of emotion research. This suggests that perhaps the notion of basic emotions will not lead to significant progress in the field. An alternative approach to explaining the phenomena that appear to motivate the postulation of basic emotions is presented.

Emotional DesignResearch Papers

The Philosophy of Emotions1989"What is an emotion?" That question was asked in precisely that form by William James, as the title of an essay he wrote for *Mind* well over 100 years ago (James, 1884). But philosophers have been concerned about the nature of emotion since Socrates and the "pre-Socratics" who preceded him, and although the discipline has grown up (largely because of Socrates and his student Plato) as the pursuit of reason, the emotions have always lurked in the background—often as a threat to reason and a danger to philosophy and philosophers. One of the most enduring metaphors of reason and emotion has been the metaphor of master and slave, with the wisdom of reason firmly in control and the dangerous impulses of emotion safely suppressed, channeled, or (ideally) in harmony with reason. But the question "What is an emotion?" has proved to be as difficult to resolve as the emotions have been to master. Just when it seems that an adequate definition is in place, some new theory rears its unwelcome head and challenges our understanding.

Emotional DesignResearch Papers

Patterns of Cognitive Appraisal in EmotionCraig A. Smith, Phoebe C. Ellsworth · 1985There has long been interest in describing emotional experience in terms of underlying dimensions, but traditionally only two dimensions, pleasantness and arousal, have been reliably found. The reasons for these findings are reviewed, and integrating this review with two recent theories of emotions (Roseman, 1984; Scherer, 1982), we propose eight cognitive appraisal dimensions to differentiate emotional experience. In an investigation of this model, subjects recalled past experiences associated with each of 15 emotions, and rated them along the proposed dimensions. Six orthogonal dimensions, pleasantness, anticipated effort, certainty, attentional activity, self-other responsibility~control, and situational control, were recovered, and the emotions varied systematically along each of these dimensions, indicating a strong relation between the appraisal of one's circumstances and one's emotional state. The patterns of appraisal for the different emotions, and the role of each of the dimensions in differentiating emotional experience are discussed.

Emotional DesignResearch Papers

Mapping the Passions: Toward a High-Dimensional Taxonomy of Emotional Experience and Expression1985What would a comprehensive atlas of human emotions include? For 50 years, scientists have sought to map emotion- related experience, expression, physiology, and recognition in terms of the “basic six”—anger, disgust, fear, happiness, sadness, and surprise. Claims about the relationships between these six emotions and prototypical facial configurations have provided the basis for a long-standing debate over the diagnostic value of expression (for review and latest installment in this debate, see Barrett et al., p. 1). Building on recent empirical findings and methodologies, we offer an alternative conceptual and methodological approach that reveals a richer taxonomy of emotion. Dozens of distinct varieties of emotion are reliably distinguished by language, evoked in distinct circumstances, and perceived in distinct expressions of the face, body, and voice. Traditional models—both the basic six and affective-circumplex model (valence and arousal)—capture a fraction of the systematic variability in emotional response. In contrast, emotion- related responses (e.g., the smile of embarrassment, triumphant postures, sympathetic vocalizations, blends of distinct expressions) can be explained by richer models of emotion. Given these developments, we discuss why tests of a basic-six model of emotion are not tests of the diagnostic value of facial expression more generally. Determining the full extent of what facial expressions can tell us, marginally and in conjunction with other behavioral and contextual cues, will require mapping the high-dimensional, continuous space of facial, bodily, and vocal signals onto richly multifaceted experiences using large-scale statistical modeling and machine-learning methods.

Emotional DesignResearch Papers

SENSORY URBANISM AND PLACEMAKING2019Sensory Urbanism is an experimental prototyping project exploring the potential of immersive Virtual Reality (VR) environments to support the incorporation of sensory and intangible aspects of place. The study investigates how sensory exploration of urban places can be integrated into decision making regarding the future of cities. In the past, numerous studies reported various sophisticated ‘livability’ measures, deeming to determine what makes a city a great place to live in. While a part of these measures can be quantified and be represented as text, graphs or images, most of the qualitative aspects of place are inherently abstract and sensory. These aspects have to be experienced to be understood and therefore they are extremely difficult to communicate using conventional representation means. The proposition explored in this study is that the increasing ubiquity of VR and Augmented Reality (AR) technologies can provide new opportunities to engage with the multi-sensory and temporal aspects of urban place. A mixed media approach was adopted, tapping into a temporal dimension as well as visual, aural and kinesthetic range of human senses. The paper reports on the development of the VR sensory urbanism prototype and the initial pilot study that demonstrated the proof-of-concept.

HCI & Adaptive InterfacesResearch Papers

Mapping citizens' emotions: participatory planning support system in Olomouc, Czech RepublicJiří Pánek · 2018Community mapping and emotional cartography have close links to participatory planning in the urban environment. The case study presented in this paper describes the deployment of the Emotional Maps platform for the collection and visualisation of spatial data related to the participatory planning of public space. The results (Main Map) presented are a combination of paper-based and web-map surveys. 2117 respondents from Olomouc (2% of the city’s population) marked 25,760 points, lines and polygons, and made 4801 comments. Six spatial questions were asked in the survey and four of them are presented in the attached map. The questions were related to the general attractiveness of the city, safety, satisfaction with public transport and suggestions for the future development of some areas. The outcomes of the survey served as the groundwork for the Strategic Plan of Olomouc for 2017–2023. ARTICLE HISTORY Received 24 October 2017 Revised 6 November 2018 Accepted 7 November 2018

HCI & Adaptive InterfacesResearch Papers