Automation-induced monitoring inefficiency: role of display location

doi:10.1006/ijhc.1996.0081

International Journal of Human-Computer Studies

Volume 46, Issue 1, January 1997, Pages 17-30

https://doi.org/10.1006/ijhc.1996.0081 Get rights and content

Abstract

Operators can be poor monitors of automation if they are engaged concurrently in other tasks. However, in previous studies of this phenomenon the automated task was always presented in the periphery, away from the primary manual tasks that were centrally displayed. In this study we examined whether centrally locating an automated task would boost monitoring performance during a flight-simulation task consisting of system monitoring, tracking and fuel resource management sub-tasks. Twelve nonpilot subjects were required to perform the tracking and fuel management tasks manually while watching the automated system monitoring task for occasional failures. The automation reliability was constant at 87.5% for six subjects and variable (alternating between 87.5% and 56.25%) for the other six subjects. Each subject completed four 30 min sessions over a period of 2 days. In each automation reliability condition the automation routine was disabled for the last 20 min of the fourth session in order to simulate catastrophic automation failure (0% reliability). Monitoring for automation failure was inefficient when automation reliability was constant but not when it varied over time, replicating previous results. Furthermore, there was no evidence of resource or speed accuracy trade-off between tasks. Thus, automation-induced failures of monitoring cannot be prevented by centrally locating the automated task.

References (0)

Cited by (54)

Automation-induced efficiency and inefficiency: transformative views from air and ground vehicle industry experts
2023, Transportation Research Procedia
Over years, we have witnessed automation maturity, thus it has become a hot topic in vehicle manufacturing industries. With higher automation poised to appear on roads and air networks, it is vital that we evaluate possible constrains. The results presented in this paper are deduced from a comprehensive interview study, with 20 air and ground vehicle experts. This paper offers the reader a fruitful discussion on automation-induced efficiency and inefficiency from the experience perspectives of experts, and bridge the knowledge gap and contributes to knowledge in the field of automated driving, trucking, flying and farming. The lessons learned show that the industrialisation of vehicle automation is largely hinged by transport and economic demands, and there is still a long way before it is a central part of human life, as there are issues that still needs to be resolved and designed for.
Driving with and without automation on the motorway–an observational study
2021, Journal of Intelligent Transportation Systems: Technology, Planning, and Operations
User-related assessment of a level 3 automated driving system, providing functions such as lane- and distance-keeping, stop & go driving, lane change and overtaking, was carried out on a motorway in Germany with the aim to assess user-related issues of automated driving, i.e., behavior when driving with automation on motorways, user experiences, reactions and acceptance. Twenty-one persons drove twice along the test route once with the system switched off and once with the system active. Driving data were logged and driving behavior was observed by two observers in the car and the drivers answered questionnaires. The results revealed that the drivers used the system as it was intended to be used and that the system affected driving positively in several ways, resulting in better speed adaptation, less speed variation, better distance keeping, better lane choice, better indicator usage and fewer dangerous lane changes. No differences with regard to subjective workload were shown. The system was perceived as being both useful and satisfactory. However, it was found that the system did not react to other drivers’ intention to make a lane change, especially in situations where they were attempting to merge onto the motorway. Further development is needed to improve the system’s ability to recognize other vehicles’ intention to enter the vehicle’s own lane. Also, the phenomenon of the driver “feeling guilty” because of the system’s reckless behavior by not allowing other drivers to merge onto the motorway or hindering other cars behind due to lengthy overtaking should be investigated further.
History and future of human-automation interaction
2019, International Journal of Human Computer Studies
Citation Excerpt :
Work in this area has been published in every decade, but particularly in the 1990s and early 2000s. The range of settings in which time-sensitive and safety-critical tasks have been studied is diverse and varied: from monitoring dynamic processes in factories (e.g., Lee and Moray, 1994), power plants (e.g., Vicente et al., 2001), and other professional settings (e.g., Bahner et al., 2008; van Gigh, 1971), to flight monitoring (e.g., Singh et al., 1997; Skitka et al., 1999, 2000), and semi-automated driving (e.g., Rajaonah et al., 2008, Seppelt and Lee, 2007). The diversity of domains (and the importance of preventing incidents) has allowed an exploration of deep general topics throughout the history of IJHCS, which remain relevant for today's research.
We review the history of human-automation interaction research, assess its current status and identify future directions. We start by reviewing articles that were published on this topic in the International Journal of Human-Computer Studies during the last 50 years. We find that over the years, automated systems have been used more frequently (1) in time-sensitive or safety-critical settings, (2) in embodied and situated systems, and (3) by non-professional users. Looking to the future, there is a need for human-automation interaction research to focus on (1) issues of function and task allocation between humans and machines, (2) issues of trust, incorrect use, and confusion, (3) the balance between focus, divided attention and attention management, (4) the need for interdisciplinary approaches to cover breadth and depth, (5) regulation and explainability, (6) ethical and social dilemmas, (7) allowing a human and humane experience, and (8) radically different human-automation interaction.
Changes in driver glance behavior when using a system that automates steering to perform a low-speed parallel parking maneuver
2018, Transportation Research Part F: Traffic Psychology and Behaviour
Citation Excerpt :
For instance, status information and instructions from automatic parking systems can be presented within or near the rearview camera image. However, display location has not been shown to reliably affect the incidence of automation-induced complacency (e.g., Singh, Molloy, & Parasuraman, 1997). Second, the findings indicated that drivers may rely more on automation when it chooses a course of action (i.e., selecting a parking space) than when drivers make this choice.
Drivers adapt their glance behavior when using automation, which may detract attention from their surroundings. Glance behavior during parallel parking maneuvers performed with and without automated steering was compared. Drivers directed a smaller proportion of their glances toward the parking space and spent less time looking at it when using automation than when not using automation. The proportion of glances and time spent looking at the instrument cluster containing information from the automation increased significantly. Drivers also spent a significantly larger proportion of time looking at the instrument cluster and a smaller proportion looking forward and rearward when using automation while approaching a parking space. The system selected the parking space in the approach phase, which may have drawn attention to the instrument cluster. In conclusion, when using automated steering during parallel parking drivers monitored their surroundings less and looked at system displays more presumably to supervise the automation. The safety implications of these changes in glance behavior should be explored in future research.
Operators adaptation to imperfect automation - Impact of miss-prone alarm systems on attention allocation and performance
2014, International Journal of Human Computer Studies
Citation Excerpt :
For the system monitoring task, percentage of detected system failures was defined as the percentage of all engine failures detected correctly by the human operator (control condition) or the human and alarm system together (joint performance in the alarm conditions). For the tracking task as well as the resource management task the root mean squared errors (RMSE; Parasuraman et al., 1993; Prinzel et al., 2001; Singh et al., 1997) were calculated. The RMSE for the tracking task was calculated as a measure of mean deviation from the central target position, based on deviation data sampled at an interval of 5 s.
Operators in complex environments are often supported by alarm systems that indicate when to shift attention to certain tasks. As alarms are not perfectly reliable, operators have to select appropriate strategies of attention allocation to compensate for unreliability and to maintain overall performance. This study explores how humans adapt to differing alarm reliabilities. Within a multi-task simulation consisting of a monitoring task and two other concurrent tasks, participants were assigned to one of five groups. In the manual control group none of the tasks was supported by an alarm system, whereas the four experimental groups were supported in the monitoring task by a miss-prone alarm system differing in reliability, i.e. 68.75%, 75%, 87.5%, 93.75%. Compared to the manual control group, all experimental groups benefited from the support by alarms, with best performance for the highest reliability condition. However, for the lowest reliability group the benefit was associated with an increased attentional effort, a more demanding attention allocation strategy, and a declined relative performance in a concurrent task. Results are discussed in the context of recent automation research.
Applying the skill-rule-knowledge framework to understanding operators' behaviors and workload in advanced main control rooms
2014, Nuclear Engineering and Design
Citation Excerpt :
The mental workload has become increasingly important because modern computerized technologies may impose severe requirements on human mental or information processing capabilities during tasks. In advanced MCRs, the physical workload, in comparison to the mental workload, is a relatively trivial part of what is required to achieve the operator's mission (Singh et al., 1997). Several methods have been developed to measure mental workloads.
For the past years, a number of researches have focused on operators’ behaviors and workloads in advanced main control rooms (MCRs) in either the procedure-domain or knowledge-domain and in either workload-increased or workload-decreased conditions. Different job positions connote different responsibilities and abilities that are required to perform the job successfully. However, it may be inappropriate to apply a dichotomy in these issues. In this study, we clarified these controversial points through the analysis of the time, frequency, and workload of the behaviors based on Rasmussen's skill–rule–knowledge classification (SRK framework) according to the supervisor operator (SRO), reactor operator (RO), and assistant reactor operator (ARO). The results showed that, for the SRO, rule- and knowledge-based behaviors occurred more often than skill-based behavior in terms of time and frequency, and knowledge-based behavior was the main source of workload. For the RO, no significant differences were found among the three behavior types in terms of frequency and workload, but more time was spent on rule-based behaviors than on skill- and knowledge-based behaviors. The ARO spent more time performing skill-based behaviors than rule- and knowledge-based behaviors, but in terms of frequency and workload, rule-based behavior was the predominant type. Operators’ behaviors contribute to a plant's defense-in-depth approach to safety and serve a vital function in ensuring its safe operation. Research on behavioral taxonomies of advanced MCRs has many significant benefits in both scientific-theoretical and applied practical fields.

View all citing articles on Scopus

^☆: This paper was presented at the 33rd Annual Conference of The Psychonomic Society, held in St. Louis, MO, USA from November 13 to 15, 1992, by the first author.

^f2: Author for correspondence.

View full text

Regular ArticleAutomation-induced monitoring inefficiency: role of display location☆

Abstract

Regular Article
Automation-induced monitoring inefficiency: role of display location☆