Pages: 54

The Human–Computer Interaction (HCI) discipline has been driven by the vision of computing systems that work well for the people using them, promoting usability, user experience, inclusivity, and user acceptance as well as producing design guidelines and methods that promote accessible and friendly user interaction. Although the field is relatively young, it has shown remarkable continuous progress and an impressive impact in shaping the evolving, and omnipresent in our daily activities, technological world around us. Considering the increasing potential of the HCI field upon the ongoing technological developments that bear the promise, or potentially the threat, to (radically) change our lives, this chapter carries out a review of the field, looking at its origins, analyzing fundamental concepts and theories, exploring its current state and interaction paradigms as they have been shaped across various technological domains, and elaborating on its impact on society. Informed by this detailed analysis, this chapter concludes with an outlook into the near future, anticipating the heightened role that HCI is expected to play amidst global challenges and technological breakthroughs, moving from human-centered design to humanity-centered design.

Pages: 32

Interactions of humans with computers, whether directly or indirectly, invariably involve physical information being provided to the humans that must be sensed and perceived. Consequently, humans’ perceptions of their interactions with computerized systems and their ability to see, hear, feel, and understand the information provided are essential to proper functioning of the systems. This chapter provides an overview of topics in sensation and perception, with an emphasis on relevance to Human–Computer Interaction. Unlike most overviews of this type, this chapter includes a discussion of fundamental issues concerning various uses of the terms, theoretical perspectives, and methodological concerns about how to measure different aspects. Critical aspects of visual and auditory perception are examined, including topics relevant to everyday life, such as face perception and music perception, that are not often included in overviews. Finally, the topic of multimodal perception is examined in some detail because interaction in most physical and cyber environments involves multiple sensory modalities. This involvement of multiple modalities is especially evident in the multimodal and XR interfaces that are becoming ubiquitous nowadays, as well as in the robots, automatic vehicles, and other artificial intelligence implementations with which people must interact on an increasing basis.

Pages: 36

Human information processing is inherent to human–computer interaction (HCI). The human information-processing approach is based on the idea that human performance, from perception to action, is a function of several processing stages. It allows HCI to be characterized as a complex system that can be analyzed in terms of subsystems and their interrelation. In this chapter, we survey methods used to study human information processing and summarize major findings and the theoretical frameworks developed to explain them. We also tie the methods, findings, and theories to HCI issues to illustrate their use. The topics of attention and memory are elaborated upon as areas of relevance to HCI professionals. Guidelines for design based on attention and memory principles are summarized.

Pages: 28

This chapter covers different perspectives from which language and communication are relevant to the realm of Human-Computer Interaction (HCI), especially if we consider that human-computer interaction is a sign-mediated communication process. Among other key elements for that discussion, we herein cover how HCI studies can be illuminated by concepts from Linguistics (definitions of language, linguistic analysis levels, deixis, the cooperative principle of conversation, speech acts, and conversation analysis), Communication Studies (communication models, language functions), Semiotics (semiotic engineering, semiosis, types of signs and communicability) and Languages in HCI (design languages, languages at the user interface and languages for end-user development). Borrowing concepts, theories and methods from those areas helps us better understand interaction as communication from an interdisciplinary perspective, and HCI as an advantageous point of view to understand human communication with computer systems, or mediated by them.

Pages: 16

Mental models are considered the panacea for user-friendly interactions. The root cause of interaction problems is the difference between the mental models of users and designers. Looking deeper under the surface of varied and unstable interaction behaviors and subjective feedback, mental models can help practitioners explore users’ cognitive processes. To leverage mental models in Human–Computer Interaction, this chapter first clarifies the nebulous concept of mental models, analyzes the overlaps and differences with six related concepts (i.e., mental representations, schema and scripts, semantic networks, cognitive maps, predictive cognition, and conceptual models), summarizes the characteristics and representations of mental models, and introduces methods to elicit mental models and further analyzes the derived results, including five methods of qualitative analysis, five methods of clustering methods, and quantitative metrics of network and graph analysis. Finally, it presents a case study to elaborate on how mental models could be used to improve the interaction between older adults and smartphones.

Pages: 48

Human error has long been recognized as a critical contributor to accidents and incidents in various domains and contexts. Researchers and practitioners have devoted themselves to human error identification, analysis, and control. This chapter provides a general review of fundamental and state-of-the-art human error theories, models, and methods, including human error mechanisms, factors contributing to human errors, human error classification and taxonomies in different domains, and human error analysis methods. Building on this foundation, the subsequent section explores special issues arising from Human–Computer Interaction. The focal point resolves around the detrimental impacts of the inappropriate use of computers and other emerging technologies on human cognitive activities, leading to human error. Finally, this chapter elaborates on general strategies and design guidelines regarding human error prevention and control.

Pages: 26

The focus of this chapter is on the perspectives on human actions that were adopted in HCI and on how these perspectives influenced HCI research. It is argued that, historically, particular views on human actions played a major role in determining the specific research agendas, methodologies, and outcomes of HCI studies. The discussion in this chapter follows a general trend in HCI research toward increasingly more advanced notions on human actions and a respective series of extensions of the scope of the field from users’ tasks to meaningful actions in real-life contexts. The implications of the broadened scope of HCI for conceptual analyses, empirical studies, and design explorations are discussed. This chapter concludes with reflections on new conceptual developments, addressing transformative and emancipatory effects of technology on human, and even non-human, beings.

Pages: 15

In this chapter, we introduce the concepts of affect in general and more closely of emotion in the context of user interfaces and human–computer interaction (HCI). In an introduction, we shall deal with HCI design (such as emotional design and cuteness engineering) and the impact of emotions in user experience in general. Then, we will give a definition and outline modelling concepts of affect and emotion from a psychological perspective as well as rooting it in engineering as relevant to HCI. Next, we will elaborate on how these influence human intentions, behaviours, and decision-making. We will then touch upon measuring affect and emotion before moving to Affective Computing – the home discipline to affect, emotion, and computing. There, we will deal with not only automatic recognition and synthesis but also applications in HCI. Concluding on affective computing, we will deal with current challenges and ways out before summarising the content in a nutshell. Affect and emotion are omnipresent in our daily interactions among humans – they will soon be in our HCI.

Pages: 23

This chapter explores social and organizational psychology and its importance in Human–Computer Interaction (HCI) by providing insights into how people interact and function within organizations. Historical and theoretical underpinnings are discussed to provide a sense of the evolution of social and organizational psychology over time while highlighting important turning points that have shaped the current state of the field. Additionally, they provide conceptual frameworks that have been used to understand the macro- and micro-organizational themes covered in this chapter. The sections on the fundamentals of micro- and macro-organizational psychology cover topics related to the individual, personnel, teams, organizations, training, and development. Each section concludes with an application to HCI to provide a more complete and nuanced understanding of the topic at hand and to help situate the reader within the broader context of HCI.

Pages: 28

Decision-making is pervasive in human behaviour. People make many decisions every day, but most are inconsequential. It is only when the outcome of a decision can be evaluated against some criterion that its quality and correctness can be assessed. However, such decisions are often taken in critical situations with time pressure, incomplete information, and conflicting goals. ‘Right’ and ‘wrong’ decisions are often judgements made in hindsight. This chapter examines the intimate relationship between the study of decision-making and human error and provides an overview of the three most common paradigms for its scientific study: normative decision-making, naturalistic decision-making, and process models of decision-making. This chapter ends by considering approaches to enhancing the quality of decision-making through training and decision-aiding.

Pages: 49

The role of theory in human–computer interaction (HCI) is of utmost importance. HCI theory serves as a fundamental framework for comprehending the dynamics of HCIs and offers valuable guidance in the design of interactive systems. However, the significance of HCI theory extends beyond the creation of new interactive systems, as it also facilitates the evaluation of existing systems and the identification of areas for enhancement. Drawing from a range of disciplines such as Human Factors & Ergonomics, Psychology, Design Studies, Computer Science and Information Sciences, Social Sciences, Humanities, Arts and Neurophysiology and Neuroscience, this chapter presents a comprehensive overview of the knowledge foundations that inform the field of Human–Computer Interaction Design. Furthermore, this chapter delves into the multifaceted realm of HCI design, addressing the prevalent confusion surrounding terminology. It outlines four primary design approaches, commencing with “Author-Centred Design” and its potential limitations, followed by an exploration of “Systems-Centred Design” and its analytical nature, highlighting its value in crafting user-centric solutions. The focal point of this chapter lies in the detailed examination of “User-Centred Design,” tracing its historical roots and methodological elements, all underpinned by ISO standards. Lastly, this chapter introduces “Activity-Centred Design,” emphasising the importance of user behaviour and tasks. Throughout this chapter, the emphasis is placed on the criticality of selecting a design paradigm that aligns with the specific needs of the project and the expertise of the designer.

Pages: 34

Numerous theories and models have emerged to explain human behavior in adopting interactive technologies, aiming to understand the factors that drive user acceptance. Despite theoretical differences, the common goal is to explore why certain innovations are embraced by users. This chapter provides a high-level introduction, directing readers to exemplary research on various facets of technology acceptance and adoption. It delves into the historical background of technology adoption at individual level (TechA@IL) and provides a chronological overview of 17 influential theoretical approaches. A number of indicative integrated (hybrid) models, designed to capture the diversity and richness of the field, along with a representative sample of studies across different application domains, are also offered. To categorize the core predictors of the 17 approaches thematically, three dimensions of influence are identified: user, task and technology, as well as social and environmental aspects. Additionally, a variety of external predictors are presented to extend the major theoretical perspectives and tailor them to particular contexts. To facilitate the design of research models specific to the given context, the Technology Acceptance and Adoption Research Approach (TA2RA) is introduced. TA2RA emphasizes a systematic approach that adheres to actionable guidelines and delineates a series of steps to facilitate the use of existing research in TechA@IL. With the ongoing development of technologies and the diverse user landscape, there are ample opportunities for further advancements in understanding technology adoption and sustainable use.

Pages: 39

This chapter presents a high-level overview of HCI-relevant research on privacy and trust. While this chapter mostly presents timeless aspects of privacy and trust, it aims to offer a primer targeted at researchers and practitioners who work on contemporary computing technologies, in particular artificial intelligence (AI) systems and social technologies. The two main components of this primer are a section covering theoretical perspectives that can be employed to conceptualize privacy and trust, and a section covering the methods that can be employed to measure these concepts. Specific opportunities for HCI researchers and practitioners are provided throughout this chapter.

Pages: 20

Ethics is important in Human–Computer Interaction (HCI) as the very nature of HCI work is that it relies on interactions with humans, and it is concerned with innovative technologies, the impact of which, on individuals and society, must be considered. This chapter focuses on these two intersections with ethics in HCI. Following a brief historical and philosophical introduction, this chapter looks at the participation of humans in HCI work with a focus on how they are recruited, informed, and protected. With practical tools to assist HCI researchers to think very carefully about these stages, this chapter asks the reader to think about whether it is ethical to include users without acknowledging their contribution, whether consent is always needed, and what users should understand about the outcomes of research work. In the section on design, design for good, persuasive design and design in sensitive contexts is critiqued with the intention that readers will think more critically about the products they might design towards. This chapter concludes by looking towards a future design space where ethical practice is more situated in context and where consent is more deeply considered and gathered in more meaningful ways.