Author

Dan Geiger

69 papers · 1985–2021

1985peak 26 in 20132021

Frequent co-authors

Papers

showing 1–25 of 69 RSS

Identifying independence in bayesian networks

Dan Geiger, Thomas Verma, Judea Pearl

Artificial Intelligence · Networks · August 1990 · cited 526× · DOI ↗ · more like this ·

Abstract An important feature of Bayesian networks is that they facilitate explicit encoding of information about independencies in the domain, information that is indispensable for efficient inferencing. This article characterizes all independence assertions that logically follow from the topology of a network and develops a linear time algorithm that identifies these assertions. The algorithm's correctness is based on the soundness of a graphical criterion, called d ‐separation, and its optimality stems from the completeness of d ‐separation. An enhanced version of d ‐separation, called D ‐separation, is defined, extending the algorithm to networks that encode functional dependencies. Finally, the algorithm is shown to work for a broad class of nonprobabilistic independencies.

Parameter Priors for Directed Acyclic Graphical Models and the Characterization of Several Probability Distributions

Dan Geiger, David Heckerman

cs.LG · January 2013 · cited 226× · arXiv ↗ · more like this ·

We show that the only parameter prior for complete Gaussian DAG models that satisfies global parameter independence, complete model equivalence, and some weak regularity assumptions, is the normal-Wishart distribution. Our analysis is based on the following new characterization of the Wishart distribution: let W be an n x n, n >= 3, positive-definite symmetric matrix of random variables and f(W) be a pdf of W. Then, f(W) is a Wishart distribution if and only if W_{11}-W_{12}W_{22}^{-1}W_{12}' is independent of {W_{12}, W_{22}} for every block partitioning W_{11}, W_{12}, W_{12}', W_{22} of W. Similar characterizations of the normal and normal-Wishart distributions are provided as well. We also show how to construct a prior for every DAG model over X from the prior of a single regression model.

Learning Bayesian Networks: Search Methods and Experimental Results

Max Chickering, Dan Geiger, David Heckerman

Artificial Intelligence · 1995 · cited 215× · OpenAlex ↗ · more like this ·

We discuss Bayesian approaches for learning Bayesian networks from data. First, we review a metric for computing the relative posterior probability of a network structure given data developed by Heckerman et al. (1994a,b,c). We see that the metric has a property useful for inferring causation from data. Next, we describe search methods for identifying network structures with high posterior probabilities. We describe polynomial algorithms for finding the highestscoring network structures in the special case where every node has at most k = 1 parent. We show that the general case (k > 1) is NP-hard, and review heuristic search algorithms for this general case. Finally, we describe a methodology for evaluating learning algorithms, and use this methodology to evaluate various scoring metrics and search procedures.

On the toric algebra of graphical models

Dan Geiger, Christopher Meek, Bernd Sturmfels

math.ST · 2 Aug 2006 · cited 212× · arXiv ↗ · more like this ·

We formulate necessary and sufficient conditions for an arbitrary discrete probability distribution to factor according to an undirected graphical model, or a log-linear model, or other more general exponential models. For decomposable graphical models these conditions are equivalent to a set of conditional independence statements similar to the Hammersley--Clifford theorem; however, we show that for nondecomposable graphical models they are not. We also show that nondecomposable models can have nonrational maximum likelihood estimates. These results are used to give several novel characterizations of decomposable graphical models.

Learning Bayesian Networks: A Unification for Discrete and Gaussian Domains

David Heckerman, Dan Geiger

cs.AI · February 2013 · cited 185× · arXiv ↗ · more like this ·

We examine Bayesian methods for learning Bayesian networks from a combination of prior knowledge and statistical data. In particular, we unify the approaches we presented at last year's conference for discrete and Gaussian domains. We derive a general Bayesian scoring metric, appropriate for both domains. We then use this metric in combination with well-known statistical facts about the Dirichlet and normal--Wishart distributions to derive our metrics for discrete and Gaussian domains.

Approximation Algorithms for the Feedback Vertex Set Problem with Applications to Constraint Satisfaction and Bayesian Inference

Reuven Bar-Yehuda, Dan Geiger, Joseph Naor +1 more

Artificial Intelligence · SIAM Journal on Computing · August 1998 · cited 185× · DOI ↗ · more like this ·

A feedback vertex set of an undirected graph is a subset of vertices that intersects with the vertex set of each cycle in the graph. Given an undirected graph G with n vertices and weights on its vertices, polynomial-time algorithms are provided for approximating the problem of finding a feedback vertex set of G with smallest weight. When the weights of all vertices in G are equal, the performance ratio attained by these algorithms is 4-(2/n). This improves a previous algorithm which achieved an approximation factor of $O(\sqrt{\log n})$ for this case. For general vertex weights, the performance ratio becomes $\min\{2\Delta^2, 4 \log_2 n\}$ where $\Delta$ denotes the maximum degree in G. For the special case of planar graphs this ratio is reduced to 10. An interesting special case of weighted graphs where a performance ratio of 4-(2/n) is achieved is the one where a prescribed subset of…

Asymptotic Model Selection for Naive Bayesian Networks

Dmitry Rusakov, Dan Geiger

cs.AI · 12 Dec 2012 · cited 156× · arXiv ↗ · more like this ·

We develop a closed form asymptotic formula to compute the marginal likelihood of data given a naive Bayesian network model with two hidden states and binary features. This formula deviates from the standard BIC score. Our work provides a concrete example that the BIC score is generally not valid for statistical models that belong to a stratified exponential family. This stands in contrast to linear and curved exponential families, where the BIC score has been proven to provide a correct approximation for the marginal likelihood.

Logical and Algorithmic Properties of Conditional Independence and Graphical Models

Dan Geiger, Judea Pearl

Artificial Intelligence · The Annals of Statistics · December 1993 · cited 133× · DOI ↗ · more like this ·

This article develops an axiomatic basis for the relationship between conditional independence and graphical models in statistical analysis. In particular, the following relationships are established: (1) every axiom for conditional independence is an axiom for graph separation, (2) every graph represents a consistent set of independence and dependence constraints, (3) all binary factorizations of strictly positive probability models can be encoded and determined in polynomial time using their correspondence to graph separation, (4) binary factorizations of non-strictly positive probability models can also be derived in polynomial time albeit less efficiently and (5) unconditional independence relative to normal models can be axiomatized with a finite set of axioms.

Stratified exponential families: Graphical models and model selection

Dan Geiger, David Heckerman, Henry King +1 more

Artificial Intelligence · The Annals of Statistics · April 2001 · cited 115× · DOI ↗ · more like this ·

We describe a hierarchy of exponential families which is useful for distinguishing types of graphical models. Undirected graphical models with no hidden variables are linear exponential families (LEFs). Directed acyclic graphical (DAG) models and chain graphs with no hidden variables, includ ing DAG models with several families of local distributions, are curved exponential families (CEFs). Graphical models with hidden variables are what we term stratified exponential families (SEFs). A SEF is a finite union of CEFs of various dimensions satisfying some regularity conditions. We also show that this hierarchy of exponential families is noncollapsing with respect to graphical models by providing a graphical model which is a CEF but not a LEF and a graphical model that is a SEF but not a CEF. Finally, we show how to compute the dimension of a stratified exponential family. These results…

A characterization of the Dirichlet distribution through global and local parameter independence

Dan Geiger, David Heckerman

Artificial Intelligence · The Annals of Statistics · June 1997 · cited 111× · DOI ↗ · more like this ·

We provide a new characterization of the Dirichlet distribution. Let $\theta_{ij}, 1 \leq i \leq k, 1 \leq j \leq n$, be positive random variables that sum to unity. Define $\theta_{i \cdot} = \Sigma_{j=1}^n \theta_{ij}, \theta_{I \cdot} = {\theta_{i \cdot}_{i=1}^{k-1}, \theta_{j|i} = \theta_{ij}/ \Sigma_j \theta_{ij}$ and \theta_{J|i} = {\theta_{j|i}}_{j=1}^{n-1}$. We prove that if ${\theta_{I \cdot}, \theta_{J|1}, \dots, \theta_{J|k}}$ are mutually independent and ${\theta_{\cdot J}, \theta_{I|1}, \dots, \theta_{I|n}}$ are mutually independent (where $\theta_{\cdot J}$ and $\theta_{I|j}$ are defined analogously, and each parameter set has a strictly positive pdf, then the pdf of $\theta_{ij}$ is Dirichlet. This characterization implies that under assumptions made by several previous authors for selecting a Bayesian network structure out of a set of candidate structures, a Dirichlet…

Efficient computation of sum-products on GPUs through software-managed cache

Mark Silberstein, Assaf Schuster, Dan Geiger +2 more

Hardware and Architecture · eScholarship (California Digital Library) · 7 Jun 2008 · cited 100× · DOI ↗ · more like this ·

We present a technique for designing memory-bound algorithms with high data reuse on Graphics Processing Units (GPUs) equipped with close-to-ALU software-managed memory. The approach is based on the efficient use of this memory through the implementation of a software-managed cache. We also present an analytical model for performance analysis of such algorithms.

Optimizing exact genetic linkage computations

M. Fishelson, Dan Geiger

Artificial Intelligence · 10 Apr 2003 · cited 99× · DOI ↗ · more like this ·

Genetic linkage analysis is a challenging application which requires Bayesian networks consisting of thousands of vertices. Consequently, computing the likelihood of data, which is needed for learning linkage parameters, using exact inference procedures calls for an extremely efficient implementation that carefully optimizes the order of conditioning and summation operations. In this paper we present the use of stochastic greedy algorithms for optimizing this order. Our algorithm has been incorporated into the newest version of superlink, which is currently the fastest genetic linkage program for exact likelihood computations in general pedigrees. We demonstrate an order of magnitude improvement in run times of likelihood computations using our new optimization algorithm, and hence enlarge the class of problems that can be handled effectively by exact computations.

BooleDozer: Logic synthesis for ASICs

Leon Stok, David S. Kung, Daniël Brand +7 more

Hardware and Architecture · IBM Journal of Research and Development · July 1996 · cited 97× · DOI ↗ · more like this ·

Logic synthesis is the process of automatically generating optimized logic-level representation from a high-level description. With the rapid advances in integrated circuit technology and the resultant growth in design complexity, designers increasingly rely on logic synthesis to shorten the design time while achieving performance objectives. This paper describes the IBM logic synthesis system BooleDozer™, including its organization, main algorithms, and how it fits into the design process. The BooleDozer logic synthesis system has been widely used within IBM to successfully synthesize processor and ASIC designs.

Density-based indexing for approximate nearest-neighbor queries

Kristin P. Bennett, Usama M. Fayyad, Dan Geiger

Signal Processing · August 1999 · cited 96× · DOI ↗ · more like this ·

We consider the problem of performing Nearest-neighbor queries efficiently over large high-dimensional databases. To avoid a full database scan, we target constructing a multidimensional index structure. It is well-accepted that traditional database indexing algorithms fail for high-dimensional data (say d > 10 or 20 depending on the scheme). Some arguments have advocated that nearest-neighbor queries do not even make sense for high-dimensional data. We show that these arguments are based on over-restrictive assumptions, and that in the general case it is meaningful and possible to build an index for such queries. Our approach, called DBIN, scales to high-dimensional databases by exploiting statistical properties of the data. The approach is based on statistically modeling the density of the content of the data table. DBIN uses the density model to derive a single index over the data…

Asymptotic Model Selection for Directed Networks with Hidden Variables

Dan Geiger, David Heckerman, Christopher Meek

cs.LG · February 2013 · cited 92× · arXiv ↗ · more like this ·

We extend the Bayesian Information Criterion (BIC), an asymptotic approximation for the marginal likelihood, to Bayesian networks with hidden variables. This approximation can be used to select models given large samples of data. The standard BIC as well as our extension punishes the complexity of a model according to the dimension of its parameters. We argue that the dimension of a Bayesian network with hidden variables is the rank of the Jacobian matrix of the transformation between the parameters of the network and the parameters of the observable variables. We compute the dimensions of several networks including the naive Bayes model with a hidden root node.

A Sufficiently Fast Algorithm for Finding Close to Optimal Junction Trees

Ann Becker, Dan Geiger

cs.DS · 13 Feb 2013 · cited 91× · arXiv ↗ · more like this ·

An algorithm is developed for finding a close to optimal junction tree of a given graph G. The algorithm has a worst case complexity O(c^k n^a) where a and c are constants, n is the number of vertices, and k is the size of the largest clique in a junction tree of G in which this size is minimized. The algorithm guarantees that the logarithm of the size of the state space of the heaviest clique in the junction tree produced is less than a constant factor off the optimal value. When k = O(log n), our algorithm yields a polynomial inference algorithm for Bayesian networks.

A practical algorithm for finding optimal triangulations

Kirill Shoikhet, Dan Geiger

Artificial Intelligence · National Conference on Artificial Intelligence · 27 Jul 1997 · cited 69× · OpenAlex ↗ · more like this ·

An algorithm called QUICKTREE is developed for finding a triangulation T of a given undirected graph G such that the size of T’s maximal clique is minimum and such that no other triangulation of G is a subgraph of T. We have tested QUICKTREE on graphs of up to 100 nodes for which the maximum clique in an optimal triangulation is of size 11. This is the first algorithm that can optimally triangulate graphs of such size in a reasonable time frame. This algorithm is useful for constraint satisfaction problems and for Bayesian inference through the clique tree inference algorithm.

Graphical Models and Exponential Families

Dan Geiger, Christopher Meek

cs.LG · 30 Jan 2013 · cited 63× · arXiv ↗ · more like this ·

We provide a classification of graphical models according to their representation as subfamilies of exponential families. Undirected graphical models with no hidden variables are linear exponential families (LEFs), directed acyclic graphical models and chain graphs with no hidden variables, including Bayesian networks with several families of local distributions, are curved exponential families (CEFs) and graphical models with hidden variables are stratified exponential families (SEFs). An SEF is a finite union of CEFs satisfying a frontier condition. In addition, we illustrate how one can automatically generate independence and non-independence constraints on the distributions over the observable variables implied by a Bayesian network with hidden variables. The relevance of these results for model selection is examined.

Graphoids: a qualitative framework for probabilistic inference

Dan Geiger

Artificial Intelligence · 1990 · cited 59× · OpenAlex ↗ · more like this ·

This dissertation investigates properties of conditional independence in relation to the elicitation, organization and inference of probabilistic expert systems. Qualitative notions of interaction, connectedness, mediation and causation are given formal probabilistic underpinning: graph-based representations and algorithms are developed for processing these notions. A partial axiomatic characterization is established of the predicate $I(X,Z,Y)$ to read: X is conditionally independent of Y, given Z. This characterization facilitates both a graphical representation of dependence information and a solution to the implication problem, of deciding whether an arbitrary independence statement $I(X,Z,Y)$ logically follows from a given set $\Sigma$ of such statements. The solution of the implication problem is the key for identifying what information is unnecessary for performing a given…

Quantifier Elimination for Statistical Problems

Dan Geiger, Christopher Meek

cs.AI · 23 Jan 2013 · cited 55× · arXiv ↗ · more like this ·

Recent improvement on Tarski's procedure for quantifier elimination in the first order theory of real numbers makes it feasible to solve small instances of the following problems completely automatically: 1. listing all equality and inequality constraints implied by a graphical model with hidden variables. 2. Comparing graphyical models with hidden variables (i.e., model equivalence, inclusion, and overlap). 3. Answering questions about the identification of a model or portion of a model, and about bounds on quantities derived from a model. 4. Determing whether a given set of independence assertions. We discuss the foundation of quantifier elimination and demonstrate its application to these problems.

The VLSI Design Automation Assistant: From Algorithms to Silicon

Thaddeus J. Kowalski, Dan Geiger, W.H. Wolf +1 more

Artificial Intelligence · IEEE Design & Test of Computers · August 1985 · cited 51× · DOI ↗ · more like this ·

Our ability to fabricate complex VLSI chips is outrunning our ability to design them. To reduce the design time for complex chips we are creating an expert design assistant-programs that automate as many of the design tasks as possible while allowing the human designer to control the synthesis process. A series of programs translates an algorithm into a chip layout. Some programs are expert systems while others use traditional algorithms. Our early results lead us to believe that a knowledge-based expert system is an appropriate tool for bridging the gap between logical and physical design.

GridBot

Mark Silberstein, Artyom Sharov, Dan Geiger +1 more

Computer Networks and Communications · 14 Nov 2009 · cited 48× · DOI ↗ · more like this ·

We present a holistic approach for efficient execution of bags-of-tasks (BOTs) on multiple grids, clusters, and volunteer computing grids virtualized as a single computing platform. The challenge is twofold: to assemble this compound environment and to employ it for execution of a mixture of throughput- and performance-oriented BOTs, with a dozen to millions of tasks each. Our generic mechanism allows per BOT specification of dynamic arbitrary scheduling and replication policies as a function of the system state, BOT execution state, and BOT priority.

Conditional independence and its representations

J. Pearl, Dan Geiger, Tom S. Verma

Computational Theory and Mathematics · Czech Digital Mathematics Library (Institute of Mathematics CAS) · June 1990 · cited 45× · OpenAlex ↗ · more like this ·

This paper summarizes recent investigations into the nature of informational dependencies and their representations. Axiomatic and graphical representations are presented which are both sound and complete for specialized types of independence statements.

Scheduling Mixed Workloads in Multi-grids: The Grid Execution Hierarchy

Mark Silberstein, Dan Geiger, Assaf Schuster +1 more

Computer Networks and Communications · 21 Jul 2006 · cited 44× · DOI ↗ · more like this ·

Consider a workload in which massively parallel tasks that require large resource pools are interleaved with short tasks that require fast response but consume fewer resources. We aim at achieving high throughput and short response time when scheduling such a workload over a set of uncoordinated grids of varying sizes and performance characteristics. We propose the concept of a grid execution hierarchy, where available grids are sorted according to their size, and the execution overheads increase with the size of the grids. We devise a scheduling algorithm for this execution hierarchy of grids by adapting the multilevel feedback queue approach to a multi-grid environment. The algorithm finds a grid of the size, availability, and overhead that best matches a task's resource requirements and expected turnaround time. Our approach is inspired by the shortest processing time first policy…

Learning causal trees from dependence information

Dan Geiger, Azaria Paz, Judea Pearl

Artificial Intelligence · 29 Jul 1990 · cited 42× · OpenAlex ↗ · more like this ·

In constructing probabilistic networks from human judgments, we use causal relationships to convey useful patterns of dependencies. The converse task, that of inferring causal relationships from patterns of dependencies, is far less understood. This paper establishes conditions under which the directionality of some interactions can be determined from non-temporal probabilistic information -- an essential prerequisite for attributing a causal interpretation to these interactions. An efficient algorithm is developed that, given data generated by an undisclosed causal polytree, recovers the structure of the underlying polytree, as well as the directionality of all its identifiable links.