arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Mehran Sahami

79 papers · 1993–2025

1993: 11994: 01995: 11996: 41997: 31998: 71999: 12000: 22001: 42002: 32003: 12004: 12005: 32006: 32007: 02008: 22009: 12010: 22011: 52012: 42013: 52014: 52015: 42016: 42017: 02018: 32019: 12020: 22021: 12022: 32023: 02024: 22025: 1
1993peak 7 in 19982025

Frequent co-authors

Papers

showing 1–25 of 79 RSS

Deep Knowledge Tracing

Chris Piech, Jonathan Spencer, Jonathan Huang +4 more

cs.AI · · cited 1,743× · arXiv ↗ · more like this ·

Knowledge tracing---where a machine models the knowledge of a student as they interact with coursework---is a well established problem in computer supported education. Though effectively modeling student knowledge would have high educational impact, the task has many inherent challenges. In this paper we explore the utility of using Recurrent Neural Networks (RNNs) to model student learning. The RNN family of models have important advantages over previous methods in that they do not require the explicit encoding of human domain knowledge, and can capture more complex representations of student knowledge. Using neural networks results in substantial improvements in prediction performance on a range of knowledge tracing datasets. Moreover the learned model can be used for intelligent curriculum design and allows straightforward interpretation and discovery of structure in student tasks.…

Inductive learning algorithms and representations for text categorization

Susan Dumais, John Platt, David Heckerman +1 more

Artificial Intelligence · · cited 1,470× · DOI ↗ · more like this ·

Text categorization – the assignment of natural language texts to one or more predefined categories based on their content – is an important component in many information organization and management tasks. We compare the effectiveness of five different automatic learning algorithms for text categorization in terms of learning speed, realtime classification speed, and classification accuracy. We also examine training set size, and alternative document representations. Very accurate text classifiers can be learned automatically from training examples. Linear Support Vector Machines (SVMs) are particularly promising because they are very accurate, quick to train, and quick to evaluate. 1.1 Keywords Text categorization, classification, support vector machines, machine learning, information management.

Toward optimal feature selection

Daphne Koller, Mehran Sahami

Computational Theory and Mathematics · International Conference on Machine Learning · · cited 1,445× · OpenAlex ↗ · more like this ·

In this paper, we examine a method for feature subset selection based on Information Theory. Initially, a framework for defining the theoretically optimal, but computationally intractable, method for feature subset selection is presented. We show that our goal should be to eliminate a feature if it gives us little or no additional information beyond that subsumed by the remaining features. In particular, this will be the case for both irrelevant and redundant features. We then give an efficient algorithm for feature selection which computes an approximation to the optimal feature selection criterion. The conditions under which the approximate algorithm is successful are examined. Empirical results are given on a number of data sets, showing that the algorithm effectively handles datasets with large numbers of features. 1 Introduction In the classic supervised learning task, we are given…

A Bayesian Approach to Filtering Junk E-Mail

Mehran Sahami, Susan Dumais, David Heckerman +1 more

Information Systems · National Conference on Artificial Intelligence · · cited 1,156× · OpenAlex ↗ · more like this ·

In addressing the growing problem of junk E-mail on the Internet, we examine methods for the automated construction of filters to eliminate such unwanted messages from a user's mail stream. By casting this problem in a decision theoretic framework, we are able to make use of probabilistic learning methods in conjunction with a notion of differential misclassification cost to produce filters which are especially appropriate for the nuances of this task. While this may appear, at first, to be a straight-forward text classification problem, we show that by considering domain-specific features of this problem in addition to the raw text of E-mail messages, we can produce much more accurate filters. Finally, we show the efficacy of such filters in a real world usage scenario, arguing that this technology is mature enough for deployment. Introduction As the number of users connected…

Hierarchically Classifying Documents Using Very Few Words

Daphne Koller, Mehran Sahami

Artificial Intelligence · International Conference on Machine Learning · · cited 841× · OpenAlex ↗ · more like this ·

The proliferation of topic hierarchies for text documents has resulted in a need for tools that automatically classify new documents within such hierarchies. Existing classification schemes which ignore the hierarchical structure and treat the topics as separate classes are often inadequate in text classification where the there is a large number of classes and a huge number of relevant features needed to distinguish between them. We propose an approach that utilizes the hierarchical topic structure to decompose the classification task into a set of simpler problems, one at each node in the classification tree. As we show, each of these smaller problems can be solved accurately by focusing only on a very small set of features, those relevant to the task at hand. This set of relevant features varies widely throughout the hierarchy, so that, while the overall relevant feature set may be…

A web-based kernel function for measuring the similarity of short text snippets

Mehran Sahami, Timothy D. Heilman

Artificial Intelligence · · cited 743× · DOI ↗ · more like this ·

Determining the similarity of short text snippets, such as search queries, works poorly with traditional document similarity measures (e.g., cosine), since there are often few, if any, terms in common between two short text snippets. We address this problem by introducing a novel method for measuring the similarity between short text snippets (even those without any overlapping terms) by leveraging web search results to provide greater context for the short texts. In this paper, we define such a similarity kernel function, mathematically analyze some of its properties, and provide examples of its efficacy. We also show the use of this kernel function in a large-scale system for suggesting related queries to search engine users.

Learning limited dependence Bayesian classifiers

Mehran Sahami

Artificial Intelligence · Knowledge Discovery and Data Mining · · cited 364× · OpenAlex ↗ · more like this ·

We present a framework for characterizing Bayesian classification methods. This framework can be thought of as a spectrum of allowable dependence in a given probabilistic model with the Naive Bayes algorithm at the most restrictive end and the learning of full Bayesian networks at the most general extreme. While much work has been carried out along the two ends of this spectrum, there has been surprising little done along the middle. We analyze the assumptions made as one moves along this spectrum and show the tradeoffs between model accuracy and learning speed which become critical to consider in a variety of data mining domains. We then present a general induction algorithm that allows for traversal of this spectrum depending on the available computational power for carrying out induction and show its application in a number of domains with different properties. Introduction Recently…

Evaluating similarity measures

Ellen Spertus, Mehran Sahami, Orkut Buyukkokten

Information Systems · · cited 295× · DOI ↗ · more like this ·

Online information services have grown too large for users to navigate without the help of automated tools such as collaborative filtering, which makes recommendations to users based on their collective past behavior. While many similarity measures have been proposed and individually evaluated, they have not been evaluated relative to each other in a large real-world environment. We present an extensive empirical comparison of six distinct measures of similarity for recommending online communities to members of the Orkut social network. We determine the usefulness of the different recommendations by actually measuring users' propensity to visit and join recommended communities. We also examine how the ordering of recommendations influenced user selection, as well as interesting social issues that arise in recommending communities within a real social network.

Error-based and entropy-based discretization of continuous features

Ron Kohavi, Mehran Sahami

Artificial Intelligence · Knowledge Discovery and Data Mining · · cited 267× · OpenAlex ↗ · more like this ·

We present a comparison of error-based and entropybased methods for discretization of continuous features. Our study includes both an extensive empirical comparison as well as an analysis of scenarios where error minimization may be an inappropriate discretization criterion. We present a discretization method based on the C4.5 decision tree algorithm and compare it to an existing entropy-based discretization algorithm, which employs the Minimum Description Length Principle, and a recently proposed error-based technique. We evaluate these discretization methods with respect to C4.5 and Naive-Bayesian classifiers on datasets from the UCI repository and analyze the computational complexity of each method. Our results indicate that the entropy-based MDL heuristic outperforms error minimization on average. We then analyze the shortcomings of error-based approaches in comparison to…

Programming Pluralism: Using Learning Analytics to Detect Patterns in the Learning of Computer Programming

Paulo Blikstein, Marcelo Worsley, Chris Piech +3 more

Computer Science Applications · Journal of the Learning Sciences · · cited 265× · DOI ↗ · more like this ·

New high-frequency, automated data collection and analysis algorithms could offer new insights into complex learning processes, especially for tasks in which students have opportunities to generate unique open-ended artifacts such as computer programs. These approaches should be particularly useful because the need for scalable project-based and student-centered learning is growing considerably. In this article, we present studies focused on how students learn computer programming, based on data drawn from 154,000 code snapshots of computer programs under development by approximately 370 students enrolled in an introductory undergraduate programming course. We use methods from machine learning to discover patterns in the data and try to predict final exam grades. We begin with a set of exploratory experiments that use fully automated techniques to investigate how much students change…

Learning Program Embeddings to Propagate Feedback on Student Code

Chris Piech, Jonathan Huang, Andy Nguyen +3 more

cs.LG · · cited 203× · arXiv ↗ · more like this ·

Providing feedback, both assessing final work and giving hints to stuck students, is difficult for open-ended assignments in massive online classes which can range from thousands to millions of students. We introduce a neural network method to encode programs as a linear mapping from an embedded precondition space to an embedded postcondition space and propose an algorithm for feedback at scale using these linear maps as features. We apply our algorithm to assessments from the Code.org Hour of Code and Stanford University's CS1 course, where we propagate human comments on student assignments to orders of magnitude more submissions.

Modeling how students learn to program

Chris Piech, Mehran Sahami, Daphne Koller +2 more

Artificial Intelligence · · cited 200× · DOI ↗ · more like this ·

Despite the potential wealth of educational indicators expressed in a student's approach to homework assignments, how students arrive at their final solution is largely overlooked in university courses. In this paper we present a methodology which uses machine learning techniques to autonomously create a graphical model of how students in an introductory programming course progress through a homework assignment. We subsequently show that this model is predictive of which students will struggle with material presented later in the class.

Probe, count, and classify

Panagiotis G. Ipeirotis, Luis Gravano, Mehran Sahami

Artificial Intelligence · · cited 154× · DOI ↗ · more like this ·

The contents of many valuable web-accessible databases are only accessible through search interfaces and are hence invisible to traditional web “crawlers.” Recent studies have estimated the size of this “hidden web” to be 500 billion pages, while the size of the “crawlable” web is only an estimated two billion pages. Recently, commercial web sites have started to manually organize web-accessible databases into Yahoo!-like hierarchical classification schemes. In this paper, we introduce a method for automating this classification process by using a small number of query probes. To classify a database, our algorithm does not retrieve or inspect any documents or pages from the database, but rather just exploits the number of matches that each query probe generates at the database in question. We have conducted an extensive experimental evaluation of our technique over collections of real…

Autonomously Generating Hints by Inferring Problem Solving Policies

Chris Piech, Mehran Sahami, Jonathan Huang +1 more

Computer Science Applications · · cited 144× · DOI ↗ · more like this ·

Exploring the whole sequence of steps a student takes to produce work, and the patterns that emerge from thousands of such sequences is fertile ground for a richer understanding of learning. In this paper we autonomously generate hints for the Code.org `Hour of Code,' (which is to the best of our knowledge the largest online course to date) using historical student data. We first develop a family of algorithms that can predict the way an expert teacher would encourage a student to make forward progress. Such predictions can form the basis for effective hint generation systems. The algorithms are more accurate than current state-of-the-art methods at recreating expert suggestions, are easy to implement and scale well. We then show that the same framework which motivated the hint generating algorithms suggests a sequence-based statistic that can be measured for each learner. We discover…

QProber

Luis Gravano, Panagiotis G. Ipeirotis, Mehran Sahami

Information Systems · ACM Transactions on Information Systems · · cited 135× · DOI ↗ · more like this ·

The contents of many valuable Web-accessible databases are only available through search interfaces and are hence invisible to traditional Web "crawlers." Recently, commercial Web sites have started to manually organize Web-accessible databases into Yahoo!-like hierarchical classification schemes. Here we introduce QProber, a modular system that automates this classification process by using a small number of query probes, generated by document classifiers. QProber can use a variety of types of classifiers to generate the probes. To classify a database, QProber does not retrieve or inspect any documents or pages from the database, but rather just exploits the number of matches that each query probe generates at the database in question. We have conducted an extensive experimental evaluation of QProber over collections of real documents, experimenting with different types of document…

Using machine learning to improve information access

Daphne Koller, Mehran Sahami

Information Systems · · cited 100× · OpenAlex ↗ · more like this ·

The explosion of on-line information has given rise to many query-based search engines (such as Alta Vista) and manually constructed topic hierarchies (such as Yahoo!). But with the current growth rate in the amount of information, query results grow incomprehensibly large and manual classification in topic hierarchies creates an immense information bottleneck. Therefore, these tools are rapidly becoming inadequate for addressing users' information needs. In this dissertation, we address these problems with a system for topical information space navigation that combines the query-based and taxonomic approaches. Our system, named SONIA (Service for Organizing Networked Information Autonomously), is implemented as part of the Stanford Digital Libraries testbed. It enables the creation of dynamic hierarchical document categorizations based on the full-text of articles. Using probability…

SONIA

Mehran Sahami, Salim Yusufali, Michelle Q. W. Baldonaldo

Computer Networks and Communications · · cited 66× · DOI ↗ · more like this ·

Article SONIA: a service for organizing networked information autonomously Share on Authors: Mehran Sahami Gates Building 1A, Computer Science Department, Stanford University, Stanford, CA Gates Building 1A, Computer Science Department, Stanford University, Stanford, CAView Profile , Salim Yusufali Gates Building 1A, Computer Science Department, Stanford University, Stanford, CA Gates Building 1A, Computer Science Department, Stanford University, Stanford, CAView Profile , Michelle Q. W. Baldonaldo Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile Authors Info & Claims DL '98: Proceedings of the third ACM conference on Digital librariesMay 1998 Pages 200–209https://doi.org/10.1145/276675.276697Published:11 May 1998 32citation357DownloadsMetricsTotal Citations32Total Downloads357Last 12…

A large-scale quantitative study of women in computer science at Stanford University

Katie Redmond, Sarah Evans, Mehran Sahami

Gender Studies · · cited 56× · DOI ↗ · more like this ·

In this paper, we analyze gender dynamics in the undergraduate Computer Science program at Stanford University through a quantitative analysis of 7209 academic transcripts and 536 survey responses. We examine previously studied effects as well as present new findings. We also introduce Fisher's Noncentral Hypergeometric Distribution as a model for estimating the impact of program changes on underrepresented populations and explain why it is a more robust measure than changes in the percentage of minority participants.

Efficient face orientation discrimination

Shumeet Baluja, Mehran Sahami, Henry A. Rowley

Computer Vision and Pattern Recognition · · cited 48× · DOI ↗ · more like this ·

The paper presents efficient methods to address the problem of discriminating between live facial orientations. We present the most efficient methods for this task to date, which can accurately discriminate between five facial orientations with approximately 92% accuracy using fewer than 30 pixel comparisons and greater than 99% accuracy using 150 pixel comparisons. We achieve these rates by using a boosting method to select from a large set of extremely simple features. Comparisons to other methods are given.

System Error: Where Big Tech Went Wrong and How We Can Reboot

Rob Reich, Mehran Sahami, Jeremy M. Weinstein

Information Systems · Perspectives on Science and Christian Faith · · cited 41× · DOI ↗ · more like this ·

SYSTEM ERROR: Where Big Tech Went Wrong and How We Can Reboot by Rob Reich, Mehran Sahami, and Jeremy M. Weinstein. New York: HarperCollins Publishers, 2021. 352 pages. Hardcover; $27.99. ISBN: 9780063064881. *Remember when digital technology and the internet were our favorite things? When free Facebook accounts connected us with our friends, and the internet facilitated democracy movements overseas, including the Arab Spring? So do the authors of this comprehensive book. "We shifted from a wide-eyed optimism about technology's liberating potential to a dystopian obsession with biased algorithms, surveillance capitalism, and job-displacing robots" (p. 237). *This transition has not escaped the notice of the students and faculty of Stanford University, the elite institution most associated with the rise (and sustainment) of Silicon Valley. The three authors of this book teach a popular…

Teaching Computer Ethics

Rob Reich, Mehran Sahami, Jeremy M. Weinstein +1 more

Safety Research · · cited 39× · DOI ↗ · more like this ·

We report on a curricular experiment at Stanford University focused on teaching computer ethics. After nearly a year of preparation, we launched a new course at the intersection of ethics, public policy, and technology that deeply marries the humanities, social sciences, and computer science. While the teaching of computer ethics courses dates back decades, such courses are often taught by a (single) CS faculty member without significant training in ethics, do not include a policy component, and are meant for CS students. By contrast, we take a deeply multidisciplinary approach, where three faculty instructors, from philosophy, political science, and CS, each bring their respective lens to four related course modules: algorithmic decision-making, data privacy and civil liberties, AI and autonomous systems, and the power of platform companies. Panels of guest speakers drawn from…

ACM/IEEE-CS computer science curriculum 2013

Mehran Sahami, Steve Roach, Ernesto Cuadros-Vargas +1 more

Computer Science Applications · · cited 37× · DOI ↗ · more like this ·

For over 40 years, the ACM and IEEE-Computer Society have sponsored the creation of international curricular guidelines for undergraduate programs in computing. These Computing Curricula volumes are updated approximately every 10-year cycle, with the aim of keeping curricula modern and relevant. The next volume in the series, Computer Science 2013 (CS2013), is currently in progress. This panel seeks to update and engage the SIGCSE community in providing feedback on a complete draft of the CS2013 report (called the Ironman report), which will be released shortly before SIGCSE. Since the Ironman report is the penultimate draft of the CS2013 report, this panel is an especially important venue for starting the last round of feedback that will impact the final CS2013 curricular guidelines.

Assignments that Blend Ethics and Technology

Stacy A. Doore, Casey Fiesler, Michael S. Kirkpatrick +2 more

Safety Research · · cited 31× · DOI ↗ · more like this ·

With the 2018 revision of the ACM Code of Ethics and Professional Conduct, there is a growing interest in how computer science faculty can integrate these principles into the education of future practitioners. This special session illustrates one approach by highlighting assignments that blend ethics and technology. These assignments can be used in a variety of courses, including CS1, CS2, and later courses. Presenters will provide an overview of each assignment and gather feedback from the audience. All materials, including descriptions, starter files, and guidelines for instructors, will be published at https://ethics.acm.org/SIGCSE2020.

Computer science curriculum 2013

Mehran Sahami, Steve Roach, Ernesto Cuadros-Vargas +1 more

Computer Science Applications · · cited 31× · DOI ↗ · more like this ·

Beginning over 40 years ago with the publication of Curriculum 68, the major professional societies in computing--ACM and IEEE-Computer Society--have sponsored various efforts to establish international curricular guidelines for undergraduate programs in computing. As the field has grown and diversified, so too have the recommendations for curricula. There are now guidelines for Computer Engineering, Information Systems, Information Technology, and Software Engineering in addition to Computer Science. These volumes are updated regularly with the aim of keeping computing curricula modern and relevant. In the Fall of 2010, work on the next volume in the series, Computer Science 2013 (CS2013), began. Considerable work on the new volume has already been completed and a first draft of the CS2013 report (known as the Strawman report) will be complete by the beginning of 2012. This panel seeks…

Applying the Multiple Cause Mixture Model to Text Categorization

Mehran Sahami, Marti A. Hearst, Eric Saund

Artificial Intelligence · International Conference on Machine Learning · · cited 31× · OpenAlex ↗ · more like this ·

This paper introduces the use of the Multiple Cause Mixture Model to automatic text category assignment. Although much research has been done on text categorization, this algorithm is novel in that is unsupervised, that is, does not require pre-labeled training examples, and it can assign multiple category labels to documents. In this paper we present very preliminary results of the application of this model to a standard test collection, evaluating it in supervised mode in order to facilitate comparison with other methods, and showing initial results of its use in unsupervised mode.