arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Anne Linja

2 papers · 2020–2021

2020: 12021: 1
2020peak 1 in 20202021

Frequent co-authors

Papers

showing 1–2 of 2 RSS

Authoring Guide for Cognitive Tutorials for Artificial Intelligence: Purposes and Methods

Shane T. Mueller, Yin-Yin Tan, Anne Linja +2 more

Artificial Intelligence · PsyArXiv (OSF Preprints) · · cited 5× · DOI ↗ · more like this ·

The Cognitive Tutorial concept is based on the view that the genuine cognitive challenges to forming functional and accurate mental models of AI systems can be formalized, documented, and "trained in." Its purpose is to serve as a means of global explanation of an AI or machine learning system. A Cognitive Tutorial is created specifically to accelerate proficiency at learning to use intelligent software tools. Therefore, it would be a valuable addition to any "toolkit" for ensuring that intelligent systems are explainable, are adequately explained to users, and the users are satisfied with their understanding of the system. This Report describes the procedures for creating a Cognitive Tutorial, the modules that comprise a Cognitive Tutorial, and example Cognitive Tutorials applied to two AI systems.

The Unreasonable Ineptitude of Deep Image Classification Networks

Shane T. Mueller, Priyansh Agarwal, Anne Linja +2 more

Artificial Intelligence · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · · cited 5× · DOI ↗ · more like this ·

The success of deep image classification networks has been met with enthusiasm and investment from both the academic community and industry. We hypothesize users will expect these systems to behave similarly to humans, and to succeed and fail in ways humans do. To investigate this, we tested six popular image classifiers on imagery from ten tool categories, examining how 17 visual transforms impacted both human and AI classification. Results showed that (1) none of the visual transforms we examined produced substantial impairment for human recognition; (2) human errors were limited to mostly to functional confusions; (3) almost all visual transforms impacted nearly every image classifier negatively and often catastrophically; (4) human expectations about performance of AI classifiers map more closely onto human error than AI performance; and (5) models trained with an enriched training…