Beyond Identity: Incorporating System Reliability Information Into an Automated Combat Identification System

Objective: The aim of this study was to evaluate display formats for an automated combat identification (CID) aid. Background: Verbally informing users of automation reliability improves reliance on automated CID systems. A display can provide reliability information in real time. Method: We developed and tested four visual displays that showed both target identity and system reliability information. Display type (pie, random mesh) and display proximity (integrated, separated) of identity and reliability information were manipulated. In Experiment 1, participants used the displays while engaging targets in a simulated combat environment. In Experiment 2, participants briefly viewed still scenes from the simulation. Results: Participants relied on the automation more appropriately with the integrated display than with the separated display. Participants using the random mesh display showed greater sensitivity than those using a pie chart. However, in Experiment 2, the sensitivity effects were limited to lower reliability levels. Conclusion: The integrated display format and the random mesh display were the most effective displays tested. Application: We recommend the use of the integrated format and a random mesh display to indicate identity and reliability information with an automated CID system.