arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Nicholas Mattei

112 papers · 2004–2026

2004: 12005: 02006: 02007: 02008: 02009: 12010: 02011: 22012: 02013: 32014: 72015: 62016: 102017: 42018: 152019: 92020: 112021: 52022: 122023: 52024: 52025: 82026: 8
2004peak 15 in 20182026

Frequent co-authors

Papers

showing 1–25 of 112 RSS

Improving Natural Language Inference Using External Knowledge in the Science Questions Domain

Xiaoyan Wang, Pavan Kapanipathi, Ryan Musa +8 more

cs.AI · · cited 178× · arXiv ↗ · more like this ·

Natural Language Inference (NLI) is fundamental to many Natural Language Processing (NLP) applications including semantic search and question answering. The NLI problem has gained significant attention thanks to the release of large scale, challenging datasets. Present approaches to the problem largely focus on learning-based methods that use only textual information in order to classify whether a given premise entails, contradicts, or is neutral with respect to a given hypothesis. Surprisingly, the use of methods based on structured knowledge -- a central topic in artificial intelligence -- has not received much attention vis-a-vis the NLI problem. While there are many open knowledge bases that contain various types of reasoning information, their use for NLI has not been well explored. To address this, we present a combination of techniques that harness knowledge graphs to improve…

Ethical Considerations in Artificial Intelligence Courses

Emanuelle Burton, Judy Goldsmith, Sven Koenig +3 more

cs.AI · · cited 161× · arXiv ↗ · more like this ·

The recent surge in interest in ethics in artificial intelligence may leave many educators wondering how to address moral, ethical, and philosophical issues in their AI courses. As instructors we want to develop curriculum that not only prepares students to be artificial intelligence practitioners, but also to understand the moral, ethical, and philosophical impacts that artificial intelligence will have on society. In this article we provide practical case studies and links to resources for use by AI educators. We also provide concrete suggestions on how to integrate AI ethics into a general artificial intelligence course and how to teach a stand-alone artificial intelligence ethics course.

Thinking Fast and Slow in AI

Grady Booch, Francesco Fabiano, Lior Horesh +8 more

cs.AI · · cited 140× · arXiv ↗ · more like this ·

This paper proposes a research direction to advance AI which draws inspiration from cognitive theories of human decision making. The premise is that if we gain insights about the causes of some human capabilities that are still lacking in AI (for instance, adaptability, generalizability, common sense, and causal reasoning), we may obtain similar capabilities in an AI system by embedding these causal components. We hope that the high-level description of our vision included in this paper, as well as the several research questions that we propose to consider, can stimulate the AI research community to define, try and evaluate new methodologies, frameworks, and evaluation metrics, in the spirit of achieving a better understanding of both human and machine intelligence.

A Systematic Classification of Knowledge, Reasoning, and Context within the ARC Dataset

Michael Boratko, Harshit Padigela, Divyendra Mikkilineni +10 more

cs.AI · · cited 98× · arXiv ↗ · more like this ·

The recent work of Clark et al. introduces the AI2 Reasoning Challenge (ARC) and the associated ARC dataset that partitions open domain, complex science questions into an Easy Set and a Challenge Set. That paper includes an analysis of 100 questions with respect to the types of knowledge and reasoning required to answer them; however, it does not include clear definitions of these types, nor does it offer information about the quality of the labels. We propose a comprehensive set of definitions of knowledge and reasoning types necessary for answering the questions in the ARC dataset. Using ten annotators and a sophisticated annotation interface, we analyze the distribution of labels across the Challenge Set and statistics related to them. Additionally, we demonstrate that although naive information retrieval methods return sentences that are irrelevant to answering the query, sufficient…

Building Ethically Bounded AI

Francesca Rossi, Nicholas Mattei

cs.AI · · cited 89× · arXiv ↗ · more like this ·

The more AI agents are deployed in scenarios with possibly unexpected situations, the more they need to be flexible, adaptive, and creative in achieving the goal we have given them. Thus, a certain level of freedom to choose the best path to the goal is inherent in making AI robust and flexible enough. At the same time, however, the pervasive deployment of AI in our life, whether AI is autonomous or collaborating with humans, raises several ethical challenges. AI agents should be aware and follow appropriate ethical principles and should thus exhibit properties such as fairness or other virtues. These ethical principles should define the boundaries of AI's freedom and creativity. However, it is still a challenge to understand how to specify and reason with ethical boundaries in AI agents and how to combine them appropriately with subjective preferences and goal specifications. Some…

Infusing Knowledge into the Textual Entailment Task Using Graph Convolutional Networks

Pavan Kapanipathi, Veronika Thost, Siva Sankalp Patel +10 more

cs.CL · · cited 50× · arXiv ↗ · more like this ·

Textual entailment is a fundamental task in natural language processing. Most approaches for solving the problem use only the textual content present in training data. A few approaches have shown that information from external knowledge sources like knowledge graphs (KGs) can add value, in addition to the textual content, by providing background knowledge that may be critical for a task. However, the proposed models do not fully exploit the information in the usually large and noisy KGs, and it is not clear how it can be effectively encoded to be useful for entailment. We present an approach that complements text-based entailment models with information from KGs by (1) using Personalized PageR- ank to generate contextual subgraphs with reduced noise and (2) encoding these subgraphs using graph convolutional networks to capture KG structure. Our technique extends the capability of text…

Teaching AI Agents Ethical Values Using Reinforcement Learning and Policy Orchestration

Ritesh Noothigattu, Djallel Bouneffouf, Nicholas Mattei +6 more

Artificial Intelligence · · cited 46× · DOI ↗ · more like this ·

Autonomous cyber-physical agents play an increasingly large role in our lives. To ensure that they behave in ways aligned with the values of society, we must develop techniques that allow these agents to not only maximize their reward in an environment, but also to learn and follow the implicit constraints of society. We detail a novel approach that uses inverse reinforcement learning to learn a set of unspecified constraints from demonstrations and reinforcement learning to learn to maximize environmental rewards. A contextual bandit-based orchestrator then picks between the two policies: constraint-based and environment reward-based. The contextual bandit orchestrator allows the agent to mix policies in novel ways, taking the best actions from either a reward-maximizing or constrained policy. In addition, the orchestrator is transparent on which policy is being employed at each time…

Preferences and Ethical Principles in Decision Making

Andrea Loreggia, Nicholas Mattei, Francesca Rossi +1 more

Artificial Intelligence · Institutional Research Information System (Università degli Studi di Brescia) · · cited 38× · DOI ↗ · more like this ·

If we want people to trust AI systems, we need to provide the systems we create with the ability to discriminate between what humans would consider good and bad decisions. The quality of a decision should not be based only on the preferences or optimization criteria of the decision makers, but also on other properties related to the impact of the decision, such as whether it is ethical, or if it complies to constraints and priorities given by feasibility constraints or safety regulations. The CP-net formalism [2] is a convenient and expressive way to model preferences, providing an effective compact way to qualitatively model preferences over outcomes, i.e., decisions, with a combinatorial structure [3, 7]. If we wish to incorporate ethical, moral, or norms based constraints to a decision context, it means that the subjective preferences of the decision makers are not the only source of…

A Cost-Effective Framework for Preference Elicitation and Aggregation

Zhibing Zhao, Haoming Li, Junming Wang +4 more

cs.LG · · cited 29× · arXiv ↗ · more like this ·

We propose a cost-effective framework for preference elicitation and aggregation under the Plackett-Luce model with features. Given a budget, our framework iteratively computes the most cost-effective elicitation questions in order to help the agents make a better group decision. We illustrate the viability of the framework with experiments on Amazon Mechanical Turk, which we use to estimate the cost of answering different types of elicitation questions. We compare the prediction accuracy of our framework when adopting various information criteria that evaluate the expected information gain from a question. Our experiments show carefully designed information criteria are much more efficient, i.e., they arrive at the correct answer using fewer queries, than randomly asking questions given the budget constraint.

Fiction as an Introduction to Computer Science Research

Judy Goldsmith, Nicholas Mattei

Computer Science Applications · ACM Transactions on Computing Education · · cited 27× · DOI ↗ · more like this ·

The undergraduate computer science curriculum is generally focused on skills and tools; most students are not exposed to much research in the field, and do not learn how to navigate the research literature. We describe how fiction reviews (and specifically science fiction) are used as a gateway to research reviews. Students learn a little about current or recent research on a topic that stirs their imagination, and learn how to search for, read critically, and compare technical papers on a topic related to their chosen science fiction book, movie, or TV show.

Interpretable Multi-Objective Reinforcement Learning through Policy Orchestration

Ritesh Noothigattu, Djallel Bouneffouf, Nicholas Mattei +6 more

cs.LG · · cited 25× · arXiv ↗ · more like this ·

Autonomous cyber-physical agents and systems play an increasingly large role in our lives. To ensure that agents behave in ways aligned with the values of the societies in which they operate, we must develop techniques that allow these agents to not only maximize their reward in an environment, but also to learn and follow the implicit constraints of society. These constraints and norms can come from any number of sources including regulations, business process guidelines, laws, ethical principles, social norms, and moral values. We detail a novel approach that uses inverse reinforcement learning to learn a set of unspecified constraints from demonstrations of the task, and reinforcement learning to learn to maximize the environment rewards. More precisely, we assume that an agent can observe traces of behavior of members of the society but has no access to the explicit set of…

Event-Driven Continuous Time Bayesian Networks

Debarun Bhattacharjya, Karthikeyan Shanmugam, Tian Gao +3 more

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 21× · DOI ↗ · more like this ·

We introduce a novel event-driven continuous time Bayesian network (ECTBN) representation to model situations where a system's state variables could be influenced by occurrences of events of various types. In this way, the model parameters and graphical structure capture not only potential “causal” dynamics of system evolution but also the influence of event occurrences that may be interventions. We propose a greedy search procedure for structure learning based on the BIC score for a special class of ECTBNs, showing that it is asymptotically consistent and also effective for limited data. We demonstrate the power of the representation by applying it to model paths out of poverty for clients of CityLink Center, an integrated social service provider in Cincinnati, USA. Here the ECTBN formulation captures the effect of classes/counseling sessions on an individual's life outcome areas such…

Value Alignment via Tractable Preference Distance

Andrea Loreggia, Nicholas Mattei, Francesca Rossi +1 more

Signal Processing · · cited 21× · DOI ↗ · more like this ·

To create AI systems that either make autonomous decisions or support human decision makers, we must ensure that the systems themselves are aware of the ethical principles that are involved in the decisions. Humans make decisions based on their preferences and the CP-net formalism is a convenient and expressive way to model subjective preferences over decisions with multiple features. However, in many situations, the subjective preferences of the decision makers may need to be checked against exogenous priorities such as those provided by ethical principles, feasibility constraints, or safety regulations. It is essential to have principled ways to evaluate if preferences are compatible with these exogenous priorities. This chapter proposes to model both subjective preferences and exogenous priorities via CP-nets. This allows us to use a notion of distance between the orderings induced…

Reasoning with PCP-nets in a Multi-Agent Context

Cristina Cornelio, Umberto Grandi, Judy Goldsmith +3 more

Artificial Intelligence · Adaptive Agents and Multi-Agents Systems · · cited 19× · DOI ↗ · more like this ·

PCP-nets generalize CP-nets to model conditional preferences with probabilistic uncertainty. In this paper we use PCP-nets in a multi-agent context to compactly represent a collection of CP-nets, thus using probabilistic uncertainty to reconcile possibly conflicting qualitative preferences expressed by a group of agents. We then study two key preference reasoning tasks: finding an optimal outcome which best represents the preferences of the agents, and answering dominance queries. Our theoretical and experimental analysis demonstrates that our techniques are efficient and accurate for both reasoning tasks.

Uniform Random Generation and Dominance Testing for CP-Nets

Thomas E. Allen, Judy Goldsmith, Hayden Elizabeth Justice +2 more

Artificial Intelligence · Journal of Artificial Intelligence Research · · cited 18× · DOI ↗ · more like this ·

The generation of preferences represented as CP-nets for experiments and empirical testing has typically been done in an ad hoc manner that may have introduced a large statistical bias in previous experimental work. We present novel polynomial-time algorithms for generating CP-nets with n nodes and maximum in-degree c uniformly at random. We extend this result to several statistical cultures commonly used in the social choice and preference reasoning literature. A CP-net is composed of both a graph and underlying cp-statements; our algorithm is the first to provably generate both the graph structure and cp-statements, and hence the underlying preference orders themselves, uniformly at random. We have released this code as a free and open source project. We use the uniform generation algorithm to investigate the maximum and expected flipping lengths, i.e., the maximum length over all…

The Many Faces of Fairness: Exploring the Institutional Logics of Multistakeholder Microlending Recommendation

Jessie J. Smith, Anas Buhayh, Anushka Kathait +4 more

Safety Research · · cited 16× · DOI ↗ · more like this ·

Recommender systems have a variety of stakeholders. Applying concepts of fairness in such systems requires attention to stakeholders’ complex and often-conflicting needs. Since fairness is socially constructed, there are numerous definitions, both in the social science and machine learning literatures. Still, it is rare for machine learning researchers to develop their metrics in close consideration of their social context. More often, standard definitions are adopted and assumed to be applicable across contexts and stakeholders. Our research starts with a recommendation context and then seeks to understand the breadth of the fairness considerations of associated stakeholders. In this paper, we report on the results of a semi-structured interview study with 23 employees who work for the Kiva microlending platform. We characterize the many different ways in which they enact and strive…

Answering Science Exam Questions Using Query Reformulation with Background Knowledge

Ryan Musa, Xiaoyan Wang, Achille Fokoue +6 more

Artificial Intelligence · Automated Knowledge Base Construction · · cited 16× · OpenAlex ↗ · more like this ·

Open-domain question answering (QA) is an important problem in AI and NLP that is emerging as a bellwether for progress on the generalizability of AI methods and techniques. Much of the progress in open-domain QA systems has been realized through advances in information retrieval methods and corpus construction. In this paper, we focus on the recently introduced ARC Challenge dataset, which contains 2,590 multiple choice questions authored for grade-school science exams. These questions are selected to be the most challenging for current QA systems, and current state of the art performance is only slightly better than random chance. We present a system that reformulates a given question into queries that are used to retrieve supporting text from a large corpus of science-related text. Our rewriter is able to incorporate background knowledge from ConceptNet and -- in tandem with a…

Teaching AI Ethics Using Science Fiction

Emanuelle Burton, Judy Goldsmith, Nicholas Mattei

Safety Research · National Conference on Artificial Intelligence · · cited 16× · OpenAlex ↗ · more like this ·

The cultural and political implications of modern AI re-search are not some far off concern, they are things that af-fect the world in the here and now. From advanced control systems with advanced visualizations and image processing techniques that drive the machines of the modern military to the slow creep of a mechanized workforce, ethical questions surround us. Part of dealing with these ethical questions is not just speculating on what could be but teaching our stu-dents how to engage with these ethical questions. We explore the use of science fiction as an appropriate tool to enable AI researchers to help engage students and the public on the cur-rent state and potential impacts of AI.

An English-Language Argumentation Interface for Explanation Generation with Markov Decision Processes in the Domain of Academic Advising

Thomas B. Dodson, Nicholas Mattei, Joshua T. Guerin +1 more

Artificial Intelligence · ACM Transactions on Interactive Intelligent Systems · · cited 16× · DOI ↗ · more like this ·

A Markov Decision Process (MDP) policy presents, for each state, an action, which preferably maximizes the expected utility accrual over time. In this article, we present a novel explanation system for MDP policies. The system interactively generates conversational English-language explanations of the actions suggested by an optimal policy, and does so in real time. We rely on natural language explanations in order to build trust between the user and the explanation system, leveraging existing research in psychology in order to generate salient explanations. Our explanation system is designed for portability between domains and uses a combination of domain-specific and domain-independent techniques. The system automatically extracts implicit knowledge from an MDP model and accompanying policy. This MDP-based explanation system can be ported between applications without additional effort…

Answering Science Exam Questions Using Query Rewriting with Background Knowledge

Ryan Musa, Xiaoyan Wang, Achille Fokoue +6 more

cs.AI · · cited 13× · arXiv ↗ · more like this ·

Open-domain question answering (QA) is an important problem in AI and NLP that is emerging as a bellwether for progress on the generalizability of AI methods and techniques. Much of the progress in open-domain QA systems has been realized through advances in information retrieval methods and corpus construction. In this paper, we focus on the recently introduced ARC Challenge dataset, which contains 2,590 multiple choice questions authored for grade-school science exams. These questions are selected to be the most challenging for current QA systems, and current state of the art performance is only slightly better than random chance. We present a system that rewrites a given question into queries that are used to retrieve supporting text from a large corpus of science-related text. Our rewriter is able to incorporate background knowledge from ConceptNet and -- in tandem with a generic…

Generating CP-Nets Uniformly at Random

Thomas Allen, Judy Goldsmith, Hayden Elizabeth Justice +2 more

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 12× · DOI ↗ · more like this ·

Conditional preference networks (CP-nets) are a commonly studied compact formalism for modeling preferences. To study the properties of CP-nets or the performance of CP-net algorithms on average, one needs to generate CP-nets in an equiprobable manner. We discuss common problems with naive generation, including sampling bias, which invalidates the base assumptions of many statistical tests and can undermine the results of an experimental study. We provide a novel algorithm for provably generating acyclic CP-nets uniformly at random. Our method is computationally efficient and allows for multi-valued domains and arbitrary bounds on the indegree in the dependency graph.

Multi-agent Social Choice for Dynamic Fairness-aware Recommendation

Robin Burke, Nicholas Mattei, Vladislav Grozin +2 more

Safety Research · · cited 11× · DOI ↗ · more like this ·

The pursuit of algorithmic fairness requires that we think differently about the idea of the “user” in personalized systems, such as recommender systems. The conventional definition of the user in such systems focuses on the receiver of recommendations, the individual to whom a particular personalization output is directed. Fairness, especially provider-side fairness, requires that we consider a broader array of system users and stakeholders, whose needs, interests and preferences may need to be modeled. In this paper, we describe a framework in which the interests of providers and other stakeholders are represented as agents. These agents participate in the production of recommendations through a two-stage social choice mechanism. This approach has the benefit of being able to represent a wide variety of fairness concepts and to extend to multiple fairness concerns.

On the Distance Between CP-nets

Andrea Loreggia, Nicholas Mattei, Francesca Rossi +1 more

Signal Processing · Adaptive Agents and Multi-Agents Systems · · cited 11× · DOI ↗ · more like this ·

Preferences play a key role in decision making by both single individuals and/or groups. In a multi-agent context, it is also important to know how to aggregate preferences to reach a collective decision. Moreover, being able to measure the distance between the preference of two individuals is important to identify the amount of disagreement and possibly reach consensus. In this paper we define a notion of distance between CP-nets, a formalism that can compactly encode conditional qualitative preferences. We consider the Kendall-tau distance between the partial orders induced by CP-nets, and we define two tractable approximations of that distance, which can be computed in time polynomial in the number of features of the CP-nets. We then perform experiments to demonstrate the quality of these approximations compared to the Kendall-tau distance. We also relate our two notions of distance…

Making Human-Like Moral Decisions

Andrea Loreggia, Nicholas Mattei, Taher Rahgooy +3 more

Artificial Intelligence · Institutional Research Information System (Università degli Studi di Brescia) · · cited 10× · DOI ↗ · more like this ·

Many real-life scenarios require humans to make difficult trade-offs: do we always follow all the traffic rules or do we violate the speed limit in an emergency? In general, how should we account for and balance the ethical values, safety recommendations, and societal norms, when we are trying to achieve a certain objective? To enable effective AI-human collaboration, we must equip AI agents with a model of how humans make such trade-offs in environments where there is not only a goal to be reached, but there are also ethical constraints to be considered and to possibly align with. These ethical constraints could be both deontological rules on actions that should not be performed, or also consequentialist policies that recommend avoiding reaching certain states of the world. Our purpose is to build AI agents that can mimic human behavior in these ethically constrained decision…

Closing the Loop: Bringing Humans into Empirical Computational Social Choice and Preference Reasoning

Nicholas Mattei

Computer Science Applications · · cited 10× · DOI ↗ · more like this ·

Research in both computational social choice and preference reasoning uses tools and techniques from computer science, generally algorithms and complexity analysis, to examine topics in group decision making. This has brought tremendous progress in the last decades, creating new avenues for research and results in areas including voting and resource allocation. I argue that of equal importance to the theoretical results are impacts in research and development from the empirical part of the computer scientists toolkit: data, system building, and human interaction. I highlight work by myself and others to establish data driven, application driven research in the computational social choice and preference reasoning areas. Along the way, I highlight interesting application domains and important results from the community in driving this area to make concrete, real-world impact.