Trust in Automation

How Correct and Defect Decision Support Systems Influence Trust, Compliance, and Performance in Supply Chain and Quality Management – A Behavioral Study Using Business Simulation Games

philipp — Sat, 22 Aug 2020 16:14:42 +0000

How Correct and Defect Decision Support Systems Influence Trust, Compliance, and Performance in Supply Chain and Quality Management – A Behavioral Study Using Business Simulation Games philipp Sat, 08/22/2020 - 18:14

Abstract

Supply Chains and production networks are complex sociotechnical cyber-physical systems whose performance is determined by system, interface, and human factors. While the influence of system factors (e.g., variances in de- livery times and amount, queuing strategies) is well understood, the influence of interface and human factors on supply chain performance is currently insuffi- ciently explored. In this article, we analyze how performance is determined by the correctness of Decision Support Systems and specifically, how correct and defect systems influence subjective and objective performance, subjective and objective compliance with the system, as well as trust in the system. We present a behavioral study with 50 participants and a business simulation game with a market driven supply chain. Results show that performance (-21%), compliance (-35%), and trust (-25%) is shaped by the correctness of the system. However, this effect is only substantial in later stages of the game and occluded at the be- ginning. Also, people’s subjective evaluations and the objective measures from the simulation are in congruence. The article concludes with open research questions regarding trust and compliance in Decision Support Systems as well as actionable knowledge on how Decision Support Systems can mitigate supply chain disruptions.

Brauner, P., Calero Valdez, A., Philipsen, R., Ziefle, M.: How Correct and Defect Decision Support Systems Influence Trust, Compliance, and Performance in Supply Chain and Quality Management – A Behavioral Study Using Business Simulation Games. In: Nah, F. and Tan, C. (eds.) HCI in Business, Government, and Organizations (HCIGO), HCI International 2017. pp. 333–348. Springer, Cham (2017).

DOI

https://doi.org/10.1007/978-3-319-58484-3_26

Tags

Related Project(s):

Integrative Production Technology for High-Wage countries

Figures and Tables (selection):

A Research Framework for Human Aspects in the Internet of Production – An Intra-company Perspective

philipp — Thu, 20 Aug 2020 13:19:34 +0000

A Research Framework for Human Aspects in the Internet of Production – An Intra-company Perspective philipp Thu, 08/20/2020 - 15:19

Abstract

Digitalization in the production sector aims at transferring concepts and methods from the Internet of Things (IoT) to the industry and is, as a result, currently reshaping the production area. Besides technological progress, changes in work processes and organization are relevant for a successful implementation of the “Internet of Production” (IoP). Focusing on the labor organization and organizational procedures emphasizes to consider intra-company factors such as (user) acceptance, ethical issues, and ergonomics in the context of IoP approaches. In the scope of this paper, a research approach is presented that considers these aspects from an intra-company perspective by conducting studies on the shop floor, control level and management level of companies in the production area. Focused on four central dimensions—governance, organization, capabilities, and interfaces—this contribution presents a research framework that is focused on a systematic integration and consideration of human aspects in the realization of the IoP.

Brauner, P., Brillowski, F., Dammers, H., Königs, P., Kordtomeikel, F., Petruck, H., Schaar, A.K., Schmitz, S., Steuer-Dankert, L., Mertens, A., Gries, T., Leicht-Scholten, C., Nagel, S., Nitsch, V., Schuh, G., Ziefle, M.: A Research Framework for Human Aspects in the Internet of Production – An Intra-company Perspective. Adv. Intell. Syst. Comput. 1216 AISC, 3–17 (2020).

DOI

https://doi.org/10.1007/978-3-030-51981-0_1

Tags

Related Project(s):

Internet of Production (IoP)

Figures and Tables (selection):

Defective Still Deflective – How Correctness of Decision Support Systems Influences User’s Performance in Production Environments

philipp — Wed, 19 Aug 2020 08:30:45 +0000

Defective Still Deflective – How Correctness of Decision Support Systems Influences User’s Performance in Production Environments philipp Wed, 08/19/2020 - 10:30

Abstract

The increasing dynamic and complexity of todays global supply chains and the growing amount and complexity of information challenge decision makers in manufacturing companies. Decision Support Systems (DSS) can be a viable solution to address these challenges and increase the overall decision efficiency and effectivity. However, a thought-through design and implementation of these systems is crucial for their efficacy. This article presents the current state-of-the-art of Decisions Support Systems and highlights their benefits and pitfalls. Also, we present an empirical study in which we compared different levels of decision support and decision automation in a simulated supply chain game environment. We identify and quantify how human factors influence the decision quality and decision performance in this supply chain scenario. We show that an adequately designed system raises the overall performance. However, insufficiently designed systems have the reverse effect and lead operators to miss severe situations, which can have fatal consequences for manufacturing companies.

Brauner, P., Calero Valdez, A., Philipsen, R., Ziefle, M.: Defective Still Deflective – How Correctness of Decision Support Systems Influences User’s Performance in Production Environments. In: Nah, F.F.-H. and Tan, C.-H. (eds.) HCI in Business, Government, and Organizations (HCIGO), Held as Part of HCI International 2016. pp. 16–27. Springer International Publishing Switzerland 2016 (2016). https://doi.org/10.1007/978-3-319-39399-5_2.

DOI

https://doi.org/10.1007/978-3-319-39399-5_2

Tags

Related Project(s):

Internet of Production (IoP)

Figures and Tables (selection):

The Interaction of Causal Attribution of Performance and Compliance with Decision Support Systems in Cyber-Physical Production Systems - An Empirical Study Using a Business Simulation Game

philipp — Tue, 18 Aug 2020 08:27:33 +0000

The Interaction of Causal Attribution of Performance and Compliance with Decision Support Systems in Cyber-Physical Production Systems - An Empirical Study Using a Business Simulation Game philipp Tue, 08/18/2020 - 10:27

Abstract

Supply Chains and production networks are complex socio-technical systems whose performance is determined by system, interface, and human factors. While the influence of system factors (e.g., variances in delivery times and amount, queuing strategies) is increasingly well understood, the influence of the interface and human factors is currently insufficiently explored. Previous research has shown that decision support systems may help to enhance performance by improving the interface. In this work, we address the users' trust in a decision support system. In a user study (n=40), using a business simulation game, we investigated how four dimensions of attribution theory relate to trust in decision support systems and further to task performance. The results show that human factors, especially trust in automation and attribution theory relate to the performance in the business simulation game. We conclude that attribution relates to job compliance and performance in material disposition tasks and supply chain management.

Brauner, P., Philipsen, R., Calero Valdez, A., Ziefle, M.: The Interaction of Causal Attribution of Performance and Compliance with Decision Support Systems in Cyber-Physical Production Systems - An Empirical Study Using a Business Simulation Game. Springer International Publishing (2018).

DOI

https://doi.org/10.1007/978-3-319-60486-2_2

Tags

Related Project(s):

Internet of Production (IoP)

Integrative Production Technology for High-Wage countries

Figures and Tables (selection):

Why Consider the Human-in-the-loop in Automated Cyber-physical Production Systems? Two Cases from Cross-company Cooperation

philipp — Tue, 18 Aug 2020 08:06:39 +0000

Why Consider the Human-in-the-loop in Automated Cyber-physical Production Systems? Two Cases from Cross-company Cooperation philipp Tue, 08/18/2020 - 10:06

Abstract

Industry 4.0 and the Internet of Production can increase efficiency and effectiveness of workflows in manufac- turing companies and production networks. Despite ubiquitous automation, people are essential in socio-technical cyber-physical production systems due to unique cognitive capabilities, as final arbitrators, or for ethical and legal reasons. However, the design of interfaces between the human-in-the-loop and production systems poses challenges not yet been sufficiently elaborated in research and practice. We present two behavioural studies in the context of inter-company collaboration that show why con- sidering the human-in-the-loop is crucial: The first study shows that information complexity and individual differences shape the overall decision quality. With increasing information complexity, the decision speed decreases and the decision accuracy descends. Consequently, a fine balance between necessary, abundant, and superfluous information must be found. The second experiment studies human decision making in complex environments using a business simulation. We found that correct decision aids can augment the human-in-the-loop’s decision making and that these can increase usability, trust, and proft. Yet, incorrect decision support has the opposite effect. Guidelines for designing socio-technical cyber-physical production systems and a research agenda conclude this article.

Brauner, P., Ziefle, M.: Why Consider the Human-in-the-loop in Automated Cyber-physical Production Systems? Two Cases from Cross-company Cooperation. In: International Conference on Industrial Informatics (INDIN 2019). pp. 861–866. IEEE (2019).

DOI

https://doi.org/10.1109/INDIN41052.2019.8972142

Tags

Related Project(s):

Internet of Production (IoP)

Integrative Production Technology for High-Wage countries

Figures and Tables (selection):

Development and Evaluation of a Research Framework for Measuring the Reliance on Automation in Situations of Risk and Moral Dilemma

philipp — Tue, 18 Aug 2020 08:01:56 +0000

Development and Evaluation of a Research Framework for Measuring the Reliance on Automation in Situations of Risk and Moral Dilemma philipp Tue, 08/18/2020 - 10:01

Abstract

Digitalization is changing the working world of tomorrow and com- plex decisions are increasingly being made by hybrid teams of people and auto- mated decision support systems. The interaction of user, task, and interface plays a decisive role, but is insufficiently studied, especially in the context of decision making under uncertainty, risk, and moral dilemmas. In this article, we present a web-based research framework for exploring this factor space with empirical user studies. The framework builds on a combination of tools for linking a user model, with the outcome of game-based decision scenarios, and the participants’ evaluations. To validate the framework, we conducted a user study with N = 64 participants and found that the system responded sensitively to factors from each of the three areas user, task, and interface. Consequently, the framework facilitates the systematic investigation of the factor space, the identification and quantification of relevant factors and the description of interactions between the factors. A systematic understanding of these factors is necessary for the development of future joint cognitive systems and Decision Support Systems.

Liehner, G.L., Brauner, P., Schaar, A.K., Ziefle, M.: Development and Evaluation of a Research Framework for Measuring the Reliance on Automation in Situations of Risk and Moral Dilemma. In: HCII 2020, LNCS 12199,. pp. 280–295 (2020). https://doi.org/10.1007/978-3-030-49907-5.

DOI

https://doi.org/10.1007/978-3-030-49907-5_20

Tags

Related Project(s):

Internet of Production (IoP)

Figures and Tables (selection):

What happens when Decision Support Systems fail? — The Importance of Usability on Performance in Erroneous Systems

philipp — Sun, 16 Aug 2020 08:33:11 +0000

What happens when Decision Support Systems fail? — The Importance of Usability on Performance in Erroneous Systems philipp Sun, 08/16/2020 - 10:33

Abstract

With the advent of artificial intelligence (AI) methods, smart decision support systems (DSSs) are becoming ubiquitous. Such systems help reduce complexity for operators by automating data integration tasks and recommending actions. However, these systems are sometimes flawed. It is not sufficiently understood whether, when and why operators comply with such systems in erroneous or correct cases. We empirically investigate compliance with correct and defective DSSs, the influence of correct and erroneous DSS’s on performance and subjective factors related to compliance. In the study, a business game was used as an experimental setting in which 40 users took part. The impact of system correctness on user acceptance, trust, compliance and overall performance was investigated. The results show that the defective system reduces trust in automation (−47%), reduces usefulness (−58%), reduces acceptance (−62%) and reduces overall performance (−32%). Overall, the defective system was less user- friendly (−27%). Nevertheless, users who rated the system’s usability higher, outperformed users who rated it lower. Usability is therefore an intermediary that compensates for the negative influence of erroneous DSSs.

Brauner, P., Philipsen, R., Valdez, A.C., Ziefle, M., Philipsen, R.: What happens when Decision Support Systems fail? — The Importance of Usability on Performance in Erroneous Systems. Behav. Inf. Technol. 38, 1225–1242 (2019).

DOI

https://doi.org/10.1080/0144929X.2019.1581258

Tags

Related Project(s):

Internet of Production (IoP)

Figures and Tables (selection):