Experiment

How Correct and Defect Decision Support Systems Influence Trust, Compliance, and Performance in Supply Chain and Quality Management – A Behavioral Study Using Business Simulation Games

philipp — Sat, 22 Aug 2020 16:14:42 +0000

How Correct and Defect Decision Support Systems Influence Trust, Compliance, and Performance in Supply Chain and Quality Management – A Behavioral Study Using Business Simulation Games philipp Sat, 08/22/2020 - 18:14

Abstract

Supply Chains and production networks are complex sociotechnical cyber-physical systems whose performance is determined by system, interface, and human factors. While the influence of system factors (e.g., variances in de- livery times and amount, queuing strategies) is well understood, the influence of interface and human factors on supply chain performance is currently insuffi- ciently explored. In this article, we analyze how performance is determined by the correctness of Decision Support Systems and specifically, how correct and defect systems influence subjective and objective performance, subjective and objective compliance with the system, as well as trust in the system. We present a behavioral study with 50 participants and a business simulation game with a market driven supply chain. Results show that performance (-21%), compliance (-35%), and trust (-25%) is shaped by the correctness of the system. However, this effect is only substantial in later stages of the game and occluded at the be- ginning. Also, people’s subjective evaluations and the objective measures from the simulation are in congruence. The article concludes with open research questions regarding trust and compliance in Decision Support Systems as well as actionable knowledge on how Decision Support Systems can mitigate supply chain disruptions.

Brauner, P., Calero Valdez, A., Philipsen, R., Ziefle, M.: How Correct and Defect Decision Support Systems Influence Trust, Compliance, and Performance in Supply Chain and Quality Management – A Behavioral Study Using Business Simulation Games. In: Nah, F. and Tan, C. (eds.) HCI in Business, Government, and Organizations (HCIGO), HCI International 2017. pp. 333–348. Springer, Cham (2017).

DOI

https://doi.org/10.1007/978-3-319-58484-3_26

Tags

Related Project(s):

Integrative Production Technology for High-Wage countries

Figures and Tables (selection):

Effects of Data Presentation and Perceptual Speed on Speed and Accuracy in Table Reading for inventory Control

philipp — Thu, 20 Aug 2020 13:45:11 +0000

Effects of Data Presentation and Perceptual Speed on Speed and Accuracy in Table Reading for inventory Control philipp Thu, 08/20/2020 - 15:45

Abstract

BACKGROUND: The increasing amount of available data in digital working environments raise considerable usability challenges. Beyond the trend for automation of such processes, strategic decisions still depend on humans in the loop who have to perceive, understand and process increasingly complex information and to make quick and correct decisions with considerable consequences for the effectiveness of the production process.
OBJECTIVE: This work is concerned with a baseline experiment in which effects of data presentations and information complexity on speed and accuracy taking table reading for inventory control as an example.
METHODS: Experimentally, the information complexity (number of lines per table, number of digits, specificity of labels) as well as operators cognitive ability (perceptual speed) was examined in terms of decision speed and accuracy. In addition, learnability effects were assessed.
RESULTS: Results show a significant effect of all factors on task performance. With increasing information complexity decision speed is considerably decreased. Operators’ perceptual speed modulates performance. Low perceptual speed in conjunction with insufficient data presentation results in significantly lower task performance.
CONCLUSIONS: Usability and user-centered information displaying is of vital importance for efficient operators’ performance and to balance mental workload. The findings contribute to an understanding of the contribution of single factors in combination to mental workload and may lead to better managerial decisions concerning the design of working conditions (e.g. by automating processes).

Ziefle, M., Brauner, P., Speicher, F.: Effects of Data Presentation and Perceptual Speed on Speed and Accuracy in Table Reading for inventory Control. Occup. Ergon. 12, 119–129 (2015). https://doi.org/10.3233/OER-150229.

DOI

https://doi.org/10.3233/OER-150229

The Role of Human Factors in Production Networks and Quality Management

philipp — Thu, 20 Aug 2020 13:36:31 +0000

The Role of Human Factors in Production Networks and Quality Management philipp Thu, 08/20/2020 - 15:36

Abstract

Quality management in production networks is often neglected. To raise awareness for this subject, we developed an educational game in which players are responsible for managing orders and investments in quality assurance of a manufacturing company. To understand individual performance differences and playing strategy, we conducted a web-based study with 127 participants. Individual performance differences were discovered. Players who closely observe the company data and frequently modify order levels and quality investments perform significantly better. Furthermore, we found that the game model works and that the awareness towards quality assurance increases through the interaction with the game. Hence, the game is a suitable educational tool for teaching decision making in quality management.

Philipsen R., Brauner P., Stiller S., Ziefle M., Schmitt R. (2014) The Role of Human Factors in Production Networks and Quality Management. In: Nah F.FH. (eds) HCI in Business. HCIB 2014. Lecture Notes in Computer Science, vol 8527. Springer, Cham.

DOI

https://doi.org/10.1007/978-3-319-07293-7_8

Tags

Related Project(s):

Integrative Production Technology for High-Wage countries

Figures and Tables (selection):

Übertragbarkeit singulärer MINT-Interesse-initiierender außerschulischer Maßnahmen

philipp — Mon, 17 Aug 2020 12:13:16 +0000

Übertragbarkeit singulärer MINT-Interesse-initiierender außerschulischer Maßnahmen philipp Mon, 08/17/2020 - 14:13

Abstract

In diesem Artikel wird die Auswertung einer singulärenInformatik-und Technikinteresse-initiierenden Maßnahme geschildert. Dabei werden als maßgebliche Einflussfaktoren das Selbstkonzept, die Selbsteinschätzung, die Expertise im Umgang mit Technik und die Zukunftsperspektive im Informatik und naturwissenschaftlichen Bereich untersucht.Die Ergebnisse zeigen weder einen alters- noch einen geschlechtsspezifischen Effekt in der Wirkung des Kurses, jedoch erwartungsgemäß
einen signifikanten Unterschied in der geschlechtsbedingten Prädisposition.
Zur Untersuchung, ob erfolgreiche außerschulische mono-edukative Maßnahmen auch in einem ko-edukativen Klassenverband gleiche Ergebnisse erzielen können, haben wir im zweitenSchritt eine kontrollierte Studie mit Schulklassen der Region Aachen durchgeführt. Durch dieseZufallsstichprobe können Alterseffekte oder ein Effekt durch die freiwillige Teilnahme am Kurs minimiert werden.Die Ergebnisse zeigen, dass erfolgreiche mono-edukative Workshop- Konzepte auch in einem ko-edukativen Klassenverband vergleichbar wirken.

Leonhardt, T., Brauner, P., Siebert, J., Schroeder, U.: Übertragbarkeit singulärer MINT-Interesse-initiierender außerschulischer Maßnahmen. In: Thomas, M. (ed.) in INFOS 2011, 14. GI-Fachtagung Informatik und Schule, September 2011. pp. 127–136. Gesellschaft für Informatik, Bonn (2011).

Tags

Related Project(s):

Didactical approaches to raise interest in STEM & G&D computer science curriculum

Human Factors in Supply Chain Management – Decision Making in Complex Logistic Scenarios

philipp — Mon, 17 Aug 2020 11:43:18 +0000

Human Factors in Supply Chain Management – Decision Making in Complex Logistic Scenarios philipp Mon, 08/17/2020 - 13:43

Abstract

Human behavior in supply chains is insufficiently explored. Wrong decisions by decision makers leads to insufficient behavior and lower performance not only for the decision maker, but also for other stakeholders along the supply chain. In order to study the complex decision situation, we developed a supply chain game in which we studied experimentally the decisions of different stakeholder within the chain. 121 participants took part in a web-based supply chain game. We investigated the effects of gender, personality and technical competency on the performance within the supply chain. Also, learnability and the effect of presence of point-of-sale data are investigated. Performance depended on the position within the chain and fluctuating stock levels were observed in form of the bullwhip effect. Furthermore, we found that risk taking had an impact on the performance and that the performance improved after the first round of the game.

Brauner, P., Runge, S., Groten, M., Schuh, G., Ziefle, M.: Human Factors in Supply Chain Management – Decision Making in Complex Logistic Scenarios. In: Yamamoto, S. (ed.) Proceedings of the 15th HCI International 2013, Part III, LNCS 8018. pp. 423–432. Springer-Verlag Berlin Heidelberg, Germany, Las Vegas, Nevada, USA (2013).

DOI

https://doi.org/10.1007/978-3-642-39226-9_46

Tags

Related Project(s):

Integrative Production Technology for High-Wage countries

Internet of Production (IoP)

Figures and Tables (selection):

The Effect of Tangible Artifacts, Gender and Subjective Technical Competence on Teaching Programming to Seventh Graders

philipp — Mon, 17 Aug 2020 10:51:10 +0000

The Effect of Tangible Artifacts, Gender and Subjective Technical Competence on Teaching Programming to Seventh Graders philipp Mon, 08/17/2020 - 12:51

Abstract

This study compares the effect of using tangible robots to using visual representations for introducing seventh graders (12 to 13 year old) to computer programming. The impact was measured on learning outcome, self-efficacy, class feedback and attitudes towards STEM (science, technology, engeneering and mathematics) topics. Results show that using robots to learn computer program- ming is beneficial, although no overall effect towards STEM topics could be shown. A huge gender gap in regard to subjective technical competence (STC) was found that negatively affected the participants’ performance. We provide approaches to leverage this gap and increase learning outcome and interest in STEM topics.

Brauner, P., Leonhardt, T., Ziefle, M., Schroeder, U.: The Effect of Tangible Artifacts, Gender and Subjective Technical Competence on Teaching Programming to Seventh Graders. In: Hromkovic, J., Královiè, R., and Vahrenhold, J. (eds.) Proceedings of the 4th International Conference on Informatics in Secondary Schools (ISSEP 2010), LNCS 5941. pp. 61–71. Springer-Verlag Berlin Heidelberg, Zurich, Switzerland (2010).

DOI

https://doi.org/10.1007/978-3-642-11376-5_7

Tags

Related Project(s):

Didactical approaches to raise interest in STEM & G&D computer science curriculum

Konzeption, Entwicklung und Analyse eines greifbaren Turtles in Hinblick auf die Steigerung der Computerselbstwirksamkeit von Schülerinnen und Schülern

philipp — Sun, 16 Aug 2020 09:35:51 +0000

Konzeption, Entwicklung und Analyse eines greifbaren Turtles in Hinblick auf die Steigerung der Computerselbstwirksamkeit von Schülerinnen und Schülern philipp Sun, 08/16/2020 - 11:35

Abstract

This thesis investigates the effect of using a tangible turtle (LEGO Mindstorms robot) in contrast to a visual representation for introducing pupils to computer programming.
Its impact was measured on a newly constructed computer programming self-efficacy scale, class feedback, learning outcome, and attitude towards STEM topics.
Results show that a tangible turtle is indeed useful and increases learning outcome and attitude towards programming, although no overall effect towards STEM topics could be proven. The self-efficacy scale provides some form of validity but will need further refinements.
This work presented here has profound implications for future studies as a huge gender gap in regard to the locus of control when interacting with technology was found that negatively affected the participants performance. Further studies should therefore focus on increasing the locus of control when interacting with technology.

Brauner, P.: Konzeption, Entwicklung und Analyse eines greifbaren Turtles in Hinblick auf die Steigerung der Computerselbstwirksamkeit von Schülerinnen und Schülern, Diplomarbeit, RWTH Aachen (2009).

Tags

Related Project(s):

Didactical approaches to raise interest in STEM & G&D computer science curriculum

What happens when Decision Support Systems fail? — The Importance of Usability on Performance in Erroneous Systems

philipp — Sun, 16 Aug 2020 08:33:11 +0000

What happens when Decision Support Systems fail? — The Importance of Usability on Performance in Erroneous Systems philipp Sun, 08/16/2020 - 10:33

Abstract

With the advent of artificial intelligence (AI) methods, smart decision support systems (DSSs) are becoming ubiquitous. Such systems help reduce complexity for operators by automating data integration tasks and recommending actions. However, these systems are sometimes flawed. It is not sufficiently understood whether, when and why operators comply with such systems in erroneous or correct cases. We empirically investigate compliance with correct and defective DSSs, the influence of correct and erroneous DSS’s on performance and subjective factors related to compliance. In the study, a business game was used as an experimental setting in which 40 users took part. The impact of system correctness on user acceptance, trust, compliance and overall performance was investigated. The results show that the defective system reduces trust in automation (−47%), reduces usefulness (−58%), reduces acceptance (−62%) and reduces overall performance (−32%). Overall, the defective system was less user- friendly (−27%). Nevertheless, users who rated the system’s usability higher, outperformed users who rated it lower. Usability is therefore an intermediary that compensates for the negative influence of erroneous DSSs.

Brauner, P., Philipsen, R., Valdez, A.C., Ziefle, M., Philipsen, R.: What happens when Decision Support Systems fail? — The Importance of Usability on Performance in Erroneous Systems. Behav. Inf. Technol. 38, 1225–1242 (2019).

DOI

https://doi.org/10.1080/0144929X.2019.1581258

Tags

Related Project(s):

Internet of Production (IoP)

Figures and Tables (selection):

Interactive FUrniTURE – Evaluation of Smart Interactive Textile Interfaces for Home Environments

philipp — Sun, 16 Aug 2020 08:24:23 +0000

Interactive FUrniTURE – Evaluation of Smart Interactive Textile Interfaces for Home Environments philipp Sun, 08/16/2020 - 10:24

Abstract

Ubiquitous computing strives to reach the \emph{calm computing} state where sensors and actuators disappear from the foreground of our surroundings into the fabric of everyday objects. Despite the great progress in embedded technology, artificial interfaces, such as remote controls and touch screens, remain the dominant media for interacting with smart everyday objects. Motivated by recent advancements in smart textile technologies, we investigate the usability and acceptance of fabric-based controllers in the smart home environment. In this article we describe the development and evaluation of three textile interfaces for controlling a motorized recliner armchair in a living room setting. The core of this contribution is the empirical study with twenty participants that contrasted the user experience of three textile-based interaction techniques to a standard remote control. Despite the slightly lower reliability of the textile interfaces, their overall acceptance was higher. The study shows that the hedonic quality and attractiveness of textile interfaces have higher impact on user acceptance compared to pragmatic qualities, such as efficiency, fluidity of interaction, and reliability. Attractiveness profits from the direct and nearly invisible integration of the interaction device into textile objects such as furniture.

Brauner, P., van Heek, J., Ziefle, M., Hamdan, N.A., Borchers, J.: Interactive FUrniTURE – Evaluation of Smart Interactive Textile Interfaces for Home Environments. In: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. pp. 151--160. ACM Press, Brighton, England (2017).

DOI

http://doi.acm.org/10.1145/3132272.3134128

Tags

Related Project(s):

Smart Interactive Textiles (IntuiTex)

Figures and Tables (selection):