arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Tim Miller

280 papers · 1989–2026

1989: 11990: 01991: 01992: 01993: 01994: 01995: 11996: 01997: 01998: 01999: 02000: 22001: 22002: 42003: 32004: 02005: 62006: 52007: 102008: 62009: 42010: 72011: 82012: 42013: 22014: 82015: 142016: 142017: 112018: 112019: 152020: 122021: 202022: 132023: 252024: 252025: 292026: 18
1989peak 29 in 20252026

Frequent co-authors

Papers

showing 1–25 of 280 RSS

Explanation in Artificial Intelligence: Insights from the Social Sciences

Tim Miller

cs.AI · · cited 5,708× · arXiv ↗ · more like this ·

There has been a recent resurgence in the area of explainable artificial intelligence as researchers and practitioners seek to make their algorithms more understandable. Much of this research is focused on explicitly explaining decisions or actions to a human observer, and it should not be controversial to say that looking at how humans explain to each other can serve as a useful starting point for explanation in artificial intelligence. However, it is fair to say that most work in explainable artificial intelligence uses only the researchers' intuition of what constitutes a `good' explanation. There exists vast and valuable bodies of research in philosophy, psychology, and cognitive science of how people define, generate, select, evaluate, and present explanations, which argues that people employ certain cognitive biases and social expectations towards the explanation process. This…

Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI

Alon Jacovi, Ana Marasović, Tim Miller +1 more

cs.AI · · cited 701× · arXiv ↗ · more like this ·

Trust is a central component of the interaction between people and AI, in that 'incorrect' levels of trust may cause misuse, abuse or disuse of the technology. But what, precisely, is the nature of trust in AI? What are the prerequisites and goals of the cognitive mechanism of trust, and how can we promote them, or assess whether they are being satisfied in a given interaction? This work aims to answer these questions. We discuss a model of trust inspired by, but not identical to, sociology's interpersonal trust (i.e., trust between people). This model rests on two key properties of the vulnerability of the user and the ability to anticipate the impact of the AI model's decisions. We incorporate a formalization of 'contractual trust', such that trust between a user and an AI is trust that some implicit or explicit contract will hold, and a formalization of 'trustworthiness' (which…

IARPA Janus Benchmark - C: Face Dataset and Protocol

Brianna Maze, Jocelyn Adams, James A. Duncan +8 more

Computer Vision and Pattern Recognition · · cited 647× · DOI ↗ · more like this ·

Although considerable work has been done in recent years to drive the state of the art in facial recognition towards operation on fully unconstrained imagery, research has always been restricted by a lack of datasets in the public domain. In addition, traditional biometrics experiments such as single image verification and closed set recognition do not adequately evaluate the ways in which unconstrained face recognition systems are used in practice. The IARPA Janus Benchmark-C (IJB-C) face dataset advances the goal of robust unconstrained face recognition, improving upon the previous public domain IJB-B dataset, by increasing dataset size and variability, and by introducing end-to-end protocols that more closely model operational face recognition use cases. IJB-C adds 1,661 new subjects to the 1,870 subjects released in IJB-B, with increased emphasis on occlusion and diversity of…

Formalizing Trust in Artificial Intelligence

Alon Jacovi, Ana Marasović, Tim Miller +1 more

Artificial Intelligence · · cited 475× · DOI ↗ · more like this ·

Trust is a central component of the interaction between people and AI, in that 'incorrect' levels of trust may cause misuse, abuse or disuse of the technology. But what, precisely, is the nature of trust in AI? What are the prerequisites and goals of the cognitive mechanism of trust, and how can we promote them, or assess whether they are being satisfied in a given interaction? This work aims to answer these questions. We discuss a model of trust inspired by, but not identical to, interpersonal trust (i.e., trust between people) as defined by sociologists. This model rests on two key properties: the vulnerability of the user; and the ability to anticipate the impact of the AI model's decisions. We incorporate a formalization of 'contractual trust', such that trust between a user and an AI model is trust that some implicit or explicit contract will hold, and a formalization of…

IARPA Janus Benchmark-B Face Dataset

Cameron Whitelam, Emma Taborsky, Austin Blanton +9 more

Computer Vision and Pattern Recognition · · cited 449× · DOI ↗ · more like this ·

Despite the importance of rigorous testing data for evaluating face recognition algorithms, all major publicly available faces-in-the-wild datasets are constrained by the use of a commodity face detector, which limits, among other conditions, pose, occlusion, expression, and illumination variations. In 2015, the NIST IJB-A dataset, which consists of 500 subjects, was released to mitigate these constraints. However, the relatively low number of impostor and genuine matches per split in the IJB-A protocol limits the evaluation of an algorithm at operationally relevant assessment points. This paper builds upon IJB-A and introduces the IARPA Janus Benchmark-B (NIST IJB-B) dataset, a superset of IJB-A. IJB-B consists of 1,845 subjects with human-labeled ground truth face bounding boxes, eye/nose locations, and covariate metadata such as occlusion, facial hair, and skintone for 21,798 still…

Explainable Reinforcement Learning Through a Causal Lens

Prashan Madumal, Tim Miller, Liz Sonenberg +1 more

cs.LG · · cited 438× · arXiv ↗ · more like this ·

Prevalent theories in cognitive science propose that humans understand and represent the knowledge of the world through causal relationships. In making sense of the world, we build causal models in our mind to encode cause-effect relations of events and use these to explain why new events happen. In this paper, we use causal models to derive causal explanations of behaviour of reinforcement learning agents. We present an approach that learns a structural causal model during reinforcement learning and encodes causal relationships between variables of interest. This model is then used to generate explanations of behaviour based on counterfactual analysis of the causal model. We report on a study with 120 participants who observe agents playing a real-time strategy game (Starcraft II) and then receive explanations of the agents' behaviour. We investigated: 1) participants' understanding…

Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciences

Tim Miller, Piers Howe, Liz Sonenberg

cs.AI · · cited 433× · arXiv ↗ · more like this ·

In his seminal book `The Inmates are Running the Asylum: Why High-Tech Products Drive Us Crazy And How To Restore The Sanity' [2004, Sams Indianapolis, IN, USA], Alan Cooper argues that a major reason why software is often poorly designed (from a user perspective) is that programmers are in charge of design decisions, rather than interaction designers. As a result, programmers design software for themselves, rather than for their target audience, a phenomenon he refers to as the `inmates running the asylum'. This paper argues that explainable AI risks a similar fate. While the re-emergence of explainable AI is positive, this paper argues most of us as AI researchers are building explanatory agents for ourselves, rather than for the intended users. But explainable AI is more likely to succeed if researchers and practitioners understand, adopt, implement, and improve models from the vast…

Explainable artificial intelligence models using real-world electronic health record data: a systematic scoping review

Seyedeh Neelufar Payrovnaziri, Zhaoyi Chen, Pablo Rengifo‐Moreno +5 more

Artificial Intelligence · Journal of the American Medical Informatics Association · · cited 311× · DOI ↗ · more like this ·

OBJECTIVE: To conduct a systematic scoping review of explainable artificial intelligence (XAI) models that use real-world electronic health record data, categorize these techniques according to different biomedical applications, identify gaps of current studies, and suggest future research directions. MATERIALS AND METHODS: We searched MEDLINE, IEEE Xplore, and the Association for Computing Machinery (ACM) Digital Library to identify relevant papers published between January 1, 2009 and May 1, 2019. We summarized these studies based on the year of publication, prediction tasks, machine learning algorithm, dataset(s) used to build the models, the scope, category, and evaluation of the XAI methods. We further assessed the reproducibility of the studies in terms of the availability of data and code and discussed open issues and challenges. RESULTS: Forty-two articles were included in this…

Explainable AI is Dead, Long Live Explainable AI! Hypothesis-driven decision support

Tim Miller

cs.AI · · cited 222× · arXiv ↗ · more like this ·

In this paper, we argue for a paradigm shift from the current model of explainable artificial intelligence (XAI), which may be counter-productive to better human decision making. In early decision support systems, we assumed that we could give people recommendations and that they would consider them, and then follow them when required. However, research found that people often ignore recommendations because they do not trust them; or perhaps even worse, people follow them blindly, even when the recommendations are wrong. Explainable artificial intelligence mitigates this by helping people to understand how and why models give certain recommendations. However, recent research shows that people do not always engage with explainability tools enough to help improve decision making. The assumption that people will engage with recommendations and explanations has proven to be unfounded. We…

Contrastive Explanation: A Structural-Model Approach

Tim Miller

cs.AI · · cited 198× · arXiv ↗ · more like this ·

This paper presents a model of contrastive explanation using structural casual models. The topic of causal explanation in artificial intelligence has gathered interest in recent years as researchers and practitioners aim to increase trust and understanding of intelligent decision-making. While different sub-fields of artificial intelligence have looked into this problem with a sub-field-specific view, there are few models that aim to capture explanation more generally. One general model is based on structural causal models. It defines an explanation as a fact that, if found to be true, would constitute an actual cause of a specific event. However, research in philosophy and social sciences shows that explanations are contrastive: that is, when people ask for an explanation of an event -- the fact -- they (sometimes implicitly) are asking for an explanation relative to some contrast…

Invertible Concept-based Explanations for CNN Models with Non-negative Concept Activation Vectors

Ruihan Zhang, Prashan Madumal, Tim Miller +2 more

cs.CV · · cited 159× · arXiv ↗ · more like this ·

Convolutional neural network (CNN) models for computer vision are powerful but lack explainability in their most basic form. This deficiency remains a key challenge when applying CNNs in important domains. Recent work on explanations through feature importance of approximate linear models has moved from input-level features (pixels or segments) to features from mid-layer feature maps in the form of concept activation vectors (CAVs). CAVs contain concept-level information and could be learned via clustering. In this work, we rethink the ACE algorithm of Ghorbani et~al., proposing an alternative invertible concept-based explanation (ICE) framework to overcome its shortcomings. Based on the requirements of fidelity (approximate models to target models) and interpretability (being meaningful to people), we design measurements and evaluate a range of matrix factorization methods with our…

Explainable AI is Dead, Long Live Explainable AI!

Tim Miller

Artificial Intelligence · · cited 147× · DOI ↗ · more like this ·

In this paper, we argue for a paradigm shift from the current model of explainable artificial intelligence (XAI), which may be counter-productive to better human decision making. In early decision support systems, we assumed that we could give people recommendations and that they would consider them, and then follow them when required. However, research found that people often ignore recommendations because they do not trust them; or perhaps even worse, people follow them blindly, even when the recommendations are wrong. Explainable artificial intelligence mitigates this by helping people to understand how and why models give certain recommendations. However, recent research shows that people do not always engage with explainability tools enough to help improve decision making. The assumption that people will engage with recommendations and explanations has proven to be unfounded. We…

A Grounded Interaction Protocol for Explainable Artificial Intelligence

Prashan Madumal, Tim Miller, Liz Sonenberg +1 more

cs.AI · · cited 106× · arXiv ↗ · more like this ·

Explainable Artificial Intelligence (XAI) systems need to include an explanation model to communicate the internal decisions, behaviours and actions to the interacting humans. Successful explanation involves both cognitive and social processes. In this paper we focus on the challenge of meaningful interaction between an explainer and an explainee and investigate the structural aspects of an interactive explanation to propose an interaction protocol. We follow a bottom-up approach to derive the model by analysing transcripts of different explanation dialogue types with 398 explanation dialogues. We use grounded theory to code and identify key components of an explanation dialogue. We formalize the model using the agent dialogue framework (ADF) as a new dialogue type and then evaluate it in a human-agent interaction study with 101 dialogues from 14 participants. Our results show that the…

Broad-Coverage Parsing Using Human-Like Memory Constraints

William Schuler, Samir Abdelrahman, Tim Miller +1 more

Artificial Intelligence · Computational Linguistics · · cited 90× · DOI ↗ · more like this ·

Human syntactic processing shows many signs of taking place within a general-purpose short-term memory. But this kind of memory is known to have a severely constrained storage capacity—possibly constrained to as few as three or four distinct elements. This article describes a model of syntactic processing that operates successfully within these severe constraints, by recognizing constituents in a right-corner transformed representation (a variant of left-corner parsing) and mapping this representation to random variables in a Hierarchic Hidden Markov Model, a factored time-series model which probabilistically models the contents of a bounded memory store over time. Evaluations of the coverage of this model on a large syntactically annotated corpus of English sentences, and the accuracy of a a bounded-memory parsing strategy based on this model, suggest this model may be cognitively…

Planning Over Multi-Agent Epistemic States: A Classical Planning Approach

Christian Muise, Vaishak Belle, Paolo Felli +4 more

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 89× · DOI ↗ · more like this ·

Many AI applications involve the interaction of multiple autonomous agents, requiring those agents to reason about their own beliefs, as well as those of other agents. However, planning involving nested beliefs is known to be computationally challenging. In this work, we address the task of synthesizing plans that necessitate reasoning about the beliefs of other agents. We plan from the perspective of a single agent with the potential for goals and actions that involve nested beliefs, non-homogeneous agents, co-present observations, and the ability for one agent to reason as if it were another. We formally characterize our notion of planning with nested belief, and subsequently demonstrate how to automatically convert such problems into problems that appeal to classical planning technology. Our approach represents an important first step towards applying the well-established field of…

Conceptualising Contestability: Perspectives on Contesting Algorithmic Decisions

Henrietta Lyons, Eduardo Velloso, Tim Miller

cs.CY · · cited 81× · arXiv ↗ · more like this ·

As the use of algorithmic systems in high-stakes decision-making increases, the ability to contest algorithmic decisions is being recognised as an important safeguard for individuals. Yet, there is little guidance on what `contestability'--the ability to contest decisions--in relation to algorithmic decision-making requires. Recent research presents different conceptualisations of contestability in algorithmic decision-making. We contribute to this growing body of work by describing and analysing the perspectives of people and organisations who made submissions in response to Australia's proposed `AI Ethics Framework', the first framework of its kind to include `contestability' as a core ethical principle. Our findings reveal that while the nature of contestability is disputed, it is seen as a way to protect individuals, and it resembles contestability in relation to human…

Crossing the agent technology chasm: Lessons, experiences and challenges in commercial applications of agents

Steve Munroe, Tim Miller, Roxana Belecheanu +3 more

Information Systems · The Knowledge Engineering Review · · cited 69× · DOI ↗ · more like this ·

Agent software technologies are currently still in an early stage of market development, where, arguably, the majority of users adopting the technology are visionaries who have recognized the long-term potential of agent systems. Some current adopters also see short-term net commercial benefits from the technology, and more potential users will need to perceive such benefits if agent technologies are to become widely used. One way to assist potential adopters to assess the costs and benefits of agent technologies is through the sharing of actual deployment histories of these technologies. Working in collaboration with several companies and organizations in Europe and North America, we have studied deployed applications of agent technologies, and we present these case studies in detail in this paper. We also review the lessons learnt, and the key issues arising from the deployments, to…

Model-Based Test Oracle Generation for Automated Unit Testing of Agent Systems

Lin Padgham, Zhiyong Zhang, John Thangarajah +1 more

Software · IEEE Transactions on Software Engineering · · cited 63× · DOI ↗ · more like this ·

Software testing remains the most widely used approach to verification in industry today, consuming between 30-50 percent of the entire development cost. Test input selection for intelligent agents presents a problem due to the very fact that the agents are intended to operate robustly under conditions which developers did not consider and would therefore be unlikely to test. Using methods to automatically generate and execute tests is one way to provide coverage of many conditions without significantly increasing cost. However, one problem using automatic generation and execution of tests is the oracle problem: How can we automatically decide if observed program behavior is correct with respect to its specification? In this paper, we present a model-based oracle generation method for unit testing belief-desire-intention agents. We develop a fault model based on the features of the core…

Using Dependency Structures for Prioritization of Functional Test Suites

Shifa-e-Zehra Haidry, Tim Miller

Software · IEEE Transactions on Software Engineering · · cited 62× · DOI ↗ · more like this ·

Test case prioritization is the process of ordering the execution of test cases to achieve a certain goal, such as increasing the rate of fault detection. Increasing the rate of fault detection can provide earlier feedback to system developers, improving fault fixing activity and, ultimately, software delivery. Many existing test case prioritization techniques consider that tests can be run in any order. However, due to functional dependencies that may exist between some test cases-that is, one test case must be executed before another-this is often not the case. In this paper, we present a family of test case prioritization techniques that use the dependency information from a test suite to prioritize that test suite. The nature of the techniques preserves the dependencies in the test ordering. The hypothesis of this work is that dependencies between tests are representative of…

Distilling Deep Reinforcement Learning Policies in Soft Decision Trees

Youri Coppens, Kyriakos Efthymiadis, Tom Lenaerts +4 more

Artificial Intelligence · Dépôt institutionnel de l'Université libre de Bruxelles (Université Libre de Bruxelles) · · cited 56× · OpenAlex ↗ · more like this ·

An important step in Reinforcement Learning (RL) research is to create mechanisms that give higher level insights into the black-box policy models used nowadays and provide explanations for these learned behaviors or motivate the choices behind certain decision steps. In this paper, we illustrate how Soft Decision Tree (SDT) distillation can be used to make policies that are learned through RL more interpretable. Soft Decision Trees create binary trees of predetermined depth, where each branching node represents a hierarchical filter that influences the classification of input data. We distill SDTs from a deep neural network RL policy for the Mario AI benchmark and inspect the learned hierarchy of filters, showing which input features lead to specific action distributions in the episode. We realize preliminary steps towards interpreting the learned behavior of the policy and discuss…

Explaining Explanation, Part 4: A Deep Dive on Deep Nets

Robert R. Hoffman, Tim Miller, Shane T. Mueller +2 more

Artificial Intelligence · IEEE Intelligent Systems · · cited 55× · DOI ↗ · more like this ·

This is the fourth in a series of essays about "explainable AI." Previous essays laid out the theoretical and empirical foundations. This essay focuses on Deep Nets, and considers methods for allowing system users to generate self-explanations. This is accomplished by exploring how the Deep Net systems perform when they are operating at their "boundary conditions." Inspired by recent research into adversarial examples that demonstrate the weaknesses of Deep Nets, we invert the purpose of these adversarial examples and argue that spoofing can be used as a tool to answer contrastive explanation questions via user-driven exploration.

Tools for participation: intergenerational technology design for the home

Sonja Pedell, Frank Vetere, Tim Miller +3 more

Human-Computer Interaction · Swinburne Research Bank (Swinburne University of Technology) · · cited 52× · OpenAlex ↗ · more like this ·

In this paper we propose an interwoven set of shared artefacts for stakeholder participation in designing domestic technologies. Our toolkit includes technology probes, associated fieldwork and conceptual goal models. Three technology probes facilitated playful communication between grandparents and their grandchildren. This communication was mediated via pictures and messages between the generations. We used high-level goal models, derived from Agent-Oriented Software Engineering (AOSE), as a template to analyse rich field data collected via the technology probes and interviews. As an integrated approach the AOSE goal models, combined with technology probes and field data, provided a uniquely inclusive toolkit for the participation of multiple stakeholders (users of technologies, field researchers and software engineers) in the design process. The integrated tools served as a lens to…

Requirements Elicitation and Specification Using the Agent Paradigm: The Case Study of an Aircraft Turnaround Simulator

Tim Miller, Bin Lu, Leon Sterling +2 more

Artificial Intelligence · IEEE Transactions on Software Engineering · · cited 51× · DOI ↗ · more like this ·

In this paper, we describe research results arising from a technology transfer exercise on agent-oriented requirements engineering with an industry partner. We introduce two improvements to the state-of-the-art in agent-oriented requirements engineering, designed to mitigate two problems experienced by ourselves and our industry partner: (1) the lack of systematic methods for agent-oriented requirements elicitation and modelling; and (2) the lack of prescribed deliverables in agent-oriented requirements engineering. We discuss the application of our new approach to an aircraft turnaround simulator built in conjunction with our industry partner, and show how agent-oriented models can be derived and used to construct a complete requirements package. We evaluate this by having three independent people design and implement prototypes of the aircraft turnaround simulator, and comparing the…

"Preaching to the Converted"

Tim Miller, David Roman

Cultural Studies · Theatre Journal · · cited 50× · DOI ↗ · more like this ·

Not long ago, I was performing My Queer Body, one of my full-evening solo pieces, in the beautiful Yale Repertory Theatre. This show explores the stories that our bodies carry and how the huge losses to AIDS challenge our deepest selves. The performance, I hope, is a journey through the most intimate pleasures and pains of being in our bodies in these difficult and juicy times. My Queer Body ends with a rousing call to claiming ecstasy and an image of a fabulous queer future replete with a black lesbian president. That's it in a nutshell. There is one point in the show when I wander naked out in the audience, exposed by the glare of the follow spot as I get close enough to see people. I look them in the eye and acknowledge them as the community occupying that theatre for that evening. I see their glasses. Feel their hair (maybe indulge in a quip about their haircare products). Notice…

Directive Explanations for Actionable Explainability in Machine Learning Applications

Ronal Singh, Paul Dourish, Piers Howe +4 more

cs.LG · · cited 49× · arXiv ↗ · more like this ·

This paper investigates the prospects of using directive explanations to assist people in achieving recourse of machine learning decisions. Directive explanations list which specific actions an individual needs to take to achieve their desired outcome. If a machine learning model makes a decision that is detrimental to an individual (e.g. denying a loan application), then it needs to both explain why it made that decision and also explain how the individual could obtain their desired outcome (if possible). At present, this is often done using counterfactual explanations, but such explanations generally do not tell individuals how to act. We assert that counterfactual explanations can be improved by explicitly providing people with actions they could use to achieve their desired goal. This paper makes two contributions. First, we present the results of an online study investigating…