arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Joshua Rule

10 papers · 2009–2025

2009: 12010: 02011: 02012: 02013: 02014: 02015: 22016: 02017: 02018: 12019: 12020: 12021: 12022: 12023: 02024: 12025: 1
2009peak 2 in 20152025

Frequent co-authors

Papers

showing 1–10 of 10 RSS

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448 more

cs.CL · · cited 2,670× · arXiv ↗ · more like this ·

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabilities are as yet poorly characterized. In order to inform future research, prepare for disruptive new model capabilities, and ameliorate socially harmful effects, it is vital that we understand the present and near-future capabilities and limitations of language models. To address this challenge, we introduce the Beyond the Imitation Game benchmark (BIG-bench). BIG-bench currently consists of 204 tasks, contributed by 450 authors across 132 institutions. Task topics are diverse, drawing problems from linguistics, childhood development, math, common-sense reasoning, biology, physics, social bias, software development, and beyond. BIG-bench focuses on tasks that are believed to be beyond the capabilities of…

Relation Alignment for Textual Entailment Recognition.

Mark Sammons, V. G. Vinod Vydiswaran, Tim Vieira +9 more

Artificial Intelligence · Theory and applications of categories · · cited 32× · OpenAlex ↗ · more like this ·

We present an approach to textual entailment recognition, in which inference is based on a shallow semantic representation of relations (predicates and their arguments) in the text and hypothesis of the entailment pair, and in which specialized knowledge is encapsulated in modular components with very simple interfaces. We propose an architecture designed to integrate different, unscaled Natural Language Processing resources, and demonstrate an alignment-based method for combining them. We clarify the purpose of alignment in the RTE task, identifying two distinct alignment models, each of which leads to a different type of entailment system. We identify desirable properties of alignment, and use this to inform our implementation of an alignment component. We evaluate the resulting system on the RTE5 data set, and use an ablation study to assess the conformance of our alignment approach…

Learning list concepts through program induction

Joshua Rule, Eric Schulz, Steven T. Piantadosi +1 more

Artificial Intelligence · bioRxiv (Cold Spring Harbor Laboratory) · · cited 20× · DOI ↗ · more like this ·

Abstract Humans master complex systems of interrelated concepts like mathematics and natural language. Previous work suggests learning these systems relies on iteratively and directly revising a language-like conceptual representation. We introduce and assess a novel concept learning paradigm called Martha’s Magical Machines that captures complex relationships between concepts. We model human concept learning in this paradigm as a search in the space of term rewriting systems, previously developed as an abstract model of computation. Our model accurately predicts that participants learn some transformations more easily than others and that they learn harder concepts more easily using a bootstrapping curriculum focused on their compositional parts. Our results suggest that term rewriting systems may be a useful model of human conceptual representations.

Representing and Learning a Large System of Number Concepts with Latent Predicate Networks.

Joshua Rule, Eyal Dechter, Joshua B. Tenenbaum

Statistics and Probability · Cognitive Science · · cited 12× · OpenAlex ↗ · more like this ·

Conventional models of exemplar or rule-based concept learning tend to focus on the acquisition of one concept at a time. They often underemphasize the fact that we learn many concepts as part of large systems rather than as isolated individuals. In such cases, the challenge of learning is not so much in providing stand-alone definitions, but in describing the richly structured relations between concepts. The natural numbers are one of the first such abstract conceptual systems children learn, serving as a serious case study in concept representation and acquisition (Carey, 2009; Fuson, 1988; Gallistel & Gelman, 2005). Even so, models of natural number learning focused on single-concept acquisition have largely ignored two challenges related to natural number’s status as a system of concepts: 1) there is an unbounded set of exact number concepts, each with distinct semantic content; and…

Leveraging Prior Concept Learning Improves Generalization From Few Examples in Computational Models of Human Object Recognition

Joshua Rule, Maximilian Riesenhuber

Artificial Intelligence · Frontiers in Computational Neuroscience · · cited 7× · DOI ↗ · more like this ·

Humans quickly and accurately learn new visual concepts from sparse data, sometimes just a single example. The impressive performance of artificial neural networks which hierarchically pool afferents across scales and positions suggests that the hierarchical organization of the human visual system is critical to its accuracy. These approaches, however, require magnitudes of order more examples than human learners. We used a benchmark deep learning model to show that the hierarchy can also be leveraged to vastly improve the speed of learning. We specifically show how previously learned but broadly tuned conceptual representations can be used to learn visual concepts from as few as two positive examples; reusing visual representations from earlier in the visual hierarchy, as in prior approaches, requires significantly more examples to perform comparably. These results suggest techniques…

Leveraging prior concept learning improves ability to generalize from few examples in computational models of human object recognition

Joshua Rule, Maximilian Riesenhuber

Artificial Intelligence · bioRxiv (Cold Spring Harbor Laboratory) · · cited 2× · DOI ↗ · more like this ·

Abstract Humans quickly learn new visual concepts from sparse data, sometimes just a single example. Decades of prior work have established the hierarchical organization of the ventral visual stream as key to this ability. Computational work has shown that networks which hierarchically pool afferents across scales and positions can achieve human-like object recognition performance and predict human neural activity. Prior computational work has also reused previously acquired features to efficiently learn novel recognition tasks. These approaches, however, require magnitudes of order more examples than human learners and only reuse intermediate features at the object level or below. None has attempted to reuse extremely high-level visual features capturing entire visual concepts. We used a benchmark deep learning model of object recognition to show that leveraging prior learning at the…

Children’s play differs from both exploring and exploiting

Joshua Rule, Junyi Chu, Mariel K. Goddu +5 more

Education · OSF Preprints (OSF Preprints) · · cited 1× · DOI ↗ · more like this ·

Although play is common in many cultures and species, existing theories of play ultimately account for only small subsets of all play behaviors. Here, we contrast play with two well-understood forms of behavior—exploration and exploitation—and investigate the hypothesis that at least some forms of play have objectives that are distinct from both information gain and reward. In both a foraging task reminiscent of classical decision-making studies and a more naturalistic setting (interacting with a commonly available playset), we analyzed US children’s behavior when given a prompt guiding them to explore, exploit, play, or do whatever they wanted to do. We found in both experiments that children’s behavior differed significantly and systematically across conditions. These results suggest that play does not merely involve seeking information or reward but is a distinct mode of behavior…

The end of radical concept nativism

Joshua S. Rule, Steven T. Piantadosi

cs.AI · · cited 0× · arXiv ↗ · more like this ·

Though humans seem to be remarkable learners, arguments in cognitive science and philosophy of mind have long maintained that learning something fundamentally new is impossible. Specifically, Jerry Fodor's arguments for radical concept nativism hold that most, if not all, concepts are innate and that what many call concept learning never actually leads to the acquisition of new concepts. These arguments have deeply affected cognitive science, and many believe that the counterarguments to radical concept nativism have been either unsuccessful or only apply to a narrow class of concepts. This paper first reviews the features and limitations of prior arguments. We then identify three critical points - related to issues of expressive power, conceptual structure, and concept possession - at which the arguments in favor of radical concept nativism diverge from describing actual human…

Learning a novel rule-based conceptual system.

Joshua Rule, Josh Tenenbaum, Steven T. Piantadosi

Artificial Intelligence · eScholarship (California Digital Library) · · cited 0× · OpenAlex ↗ · more like this ·

Humans have developed complex rule-based systems to explain and exploit the world around them. When a learner hasalready mastered a system’s core dynamicsidentifying its primitives and their interrelationsfurther learning can be effec-tively modeled as discovering useful compositions of these primitives. It nevertheless remains unclear how the dynamicsthemselves might initially be acquired. Composing primitives is no longer a viable strategy, as the primitives themselvesare what must be explained. To explore this problem, we introduce and assess a novel concept learning paradigm in whichparticipants use a two-alternative forced-choice task to learn an unfamiliar rule-based conceptual system: the MUI system(Hofstadter, 1980). We show that participants reliably learn this system given a few dozen examples of the systems rules,leaving open the mechanism by which novel conceptual systems…

TAC’09 Relation Alignment for Textual Entailment Recognition

Mark Sammons, V. G. Vinod Vydiswaran, Tim Vieira +9 more

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

We present an approach to textual entailment recog-nition, in which inference is based on a shallow se-mantic representation of relations (predicates and their arguments) in the text and hypothesis of the entailment pair, and in which specialized knowl-edge is encapsulated in modular components with very simple interfaces. We propose an architecture designed to integrate different, unscaled Natural Language Processing resources, and demonstrate an alignment-based method for combining them. We clarify the purpose of alignment in the RTE task, identifying two distinct alignment models, each of which leads to a different type of entailment system. We identify desirable properties of alignment, and use this to inform our implementation of an align-ment component. We evaluate the resulting system on the RTE5 data set, and use an ablation study to assess the conformance of our alignment…