arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Tom Bylander

37 papers · 1985–2015

1985: 11986: 01987: 11988: 21989: 21990: 01991: 31992: 11993: 31994: 11995: 11996: 01997: 41998: 11999: 12000: 12001: 02002: 22003: 12004: 02005: 02006: 32007: 12008: 02009: 12010: 02011: 12012: 12013: 02014: 12015: 3
1985peak 4 in 19972015

Frequent co-authors

Papers

showing 1–25 of 37 RSS

Learning linear threshold functions in the presence of classification noise

Tom Bylander

Artificial Intelligence · · cited 77× · DOI ↗ · more like this ·

I show that the linear threshold functions are polynomially learnable in the presence of classification noise, i.e., polynomial in n, 1/ε, 1/δ, and 1/σ, where n is the number of Boolean attributes, ε and δ are the usual accuracy and confidence parameters, and σ indicates the minimum distance of any example from the target hyperplane, which is assumed to be lower than the average distance of the examples from any hyperplane. This result is achieved by modifying the Perceptron algorithm—for each update, a weighted average of a sample of misclassified examples and a correction vector is added to the current weight vector. Similar modifications are shown for the Weighted Majority algorithm. The correction vector is simply the mean of the normalized examples. In the special case of Boolean threshold functions, the modified Perceptron algorithm performs O (n2ε−2 ) iterations over O(n4ε…

Understanding behavior using consolidation

Tom Bylander, B. Chandrasekaran

Artificial Intelligence · International Joint Conference on Artificial Intelligence · · cited 58× · OpenAlex ↗ · more like this ·

In this paper, we wish to make three contributions to Naive Physics in the context of reasoning about devices. (1) We discuss some limitations of current qualitative simulation approaches with regard to a number of issues in understanding device behavior and point to the need for additional processes. (2) We introduce a new approach to deriving the behavior of devices called consolidation. In this approach, the behavior of a device is derived from the behavior of its components by inferring the behavior of selected substructures of the device. (3) We present an ontology of behavior and structure which is well-suited to the consolidation process. This ontology makes it possible to state rules of behavior composition, i.e., simple patterns of behavior and structure are used to infer additional behaviors.

A linear programming heuristic for optimal planning

Tom Bylander

Artificial Intelligence · National Conference on Artificial Intelligence · · cited 52× · OpenAlex ↗ · more like this ·

I introduce a new search heuristic for propositional STRIPS planning that is based on transforming planning instances to linear programming instances. The linear programming heuristic is admissible for finding minimum length plans and can be used by partial-order planning algorithms. This heuristic appears to be the first non-trivial admissible heuristic for partial-order planning. An empirical study compares Lplan, a partial-order planner incorporating the heuristic, to Graphplan, Satplan, and UCPOP on the tower of Hanoi domain, random blocks-world instances, and random planning instances. Graphplan is far faster in the study than the other algorithms. Lplan is often slower because the heuristic is time-consuming, but Lplan shows promise because it often performs a small search. Introduction Planning is the problem of finding a combination of actions that achieves a goal (Allen…

Computational complexity of hypothesis assembly

Dean Allemang, Michael C. Tanner, Tom Bylander +1 more

Computational Theory and Mathematics · International Joint Conference on Artificial Intelligence · · cited 41× · OpenAlex ↗ · more like this ·

T h e p rob lem of f inding a best exp lana t ion of a set of da ta has been a top ic of m u c h interest in A r t i f i c i a l I n t e l l i gence. In th is paper we present an approach to th is p r o b l e m by hypothesis assembly. We present th is approach f o rma l l y so tha t we can examine the t ime comp lex i t y and correctness of the a lgo r i t hms . We then examine a system i m p l e m e n t e d using th is approach , w h i c h per fo rms red b lood a n t i b o d y iden t i f i ca t ion . We use th is d o m a i n to examine the r a m i f icat ions of the assumpt ions of the f o r m a l model in a real wo r l d s i t ua t i on . We also br ie f ly compare th is approach to other assembly approaches in te rms o f t i m e comp lex i t y and rel iance on assumpt ions. I . I n t r o d u c t i o n T h e p rob lem of abduc t i ve reasoning (as proposed by the phi losopher C.S.…

A critique of qualitative simulation from a consolidation viewpoint

Tom Bylander

Artificial Intelligence · IEEE Transactions on Systems Man and Cybernetics · · cited 31× · DOI ↗ · more like this ·

To understand commonsense reasoning, it is necessary to discover what kinds of problems a commonsense reasoner should be able to solve, what the reasoner needs to have in order to solve those problems, and the relationships among the various kinds of problem-solving abilities. Four methods for performing qualitative reasoning about the behaviour of physical situations are examined. Three of the methods perform qualitative simulation, which determines the behavior of a situation by a qualitative version of simulation methods. The other method is called consolidation, which derives the behavior of a situation by composing the behavior of the situation's components. The work shows that qualitative simulation and consolidation work on different problems of qualitative reasoning, and that their differences and similarities lead to several implications about their role in qualitative…

Using Validation Sets to Avoid Overfitting in AdaBoost.

Tom Bylander, Lisa Tate

Artificial Intelligence · The Florida AI Research Society · · cited 29× · OpenAlex ↗ · more like this ·

AdaBoost is a well known, effective technique for increasing the accuracy of learning algorithms. However, it has the potential to overfit the training set because its objective is to minimize error on the training set. We demonstrate that overfitting in AdaBoost can be alleviated in a time-efficient manner using a combination of dagging and validation sets. Half of the training set is removed to form the validation set. The sequence of base classifiers, produced by AdaBoost from the training set, is applied to the validation set, creating a modified set of weights. The training and validation sets are switched, and a second pass is performed. The final classifier votes using both sets of weights. We show our algorithm has similar performance on standard datasets and improved performance when classification noise is added.

Predicting currency exchange rates by genetic programming with trigonometric functions and high-order statistics

Roy Schwaerzel, Tom Bylander

Artificial Intelligence · · cited 20× · DOI ↗ · more like this ·

Abstract: This paper describes an extension of the traditional application of Genetic Programming in the domain of the prediction of daily currency exchange rates. In combination with trigonometric operators, we introduce a new set of high-order statistical functions in a unique representation and analyze each system performance using daily returns of the British Pound and Japanese Yen. We will demonstrate that the introduction of high-order statistical functions in combination with trigonometric functions will outperform other traditional models such as Genetic Programming with the basic function set and ARMA models. Performance will be measured on hit percentage, average percentage change, and profit.

Complexity results for serial decomposability

Tom Bylander

Artificial Intelligence · National Conference on Artificial Intelligence · · cited 18× · OpenAlex ↗ · more like this ·

Korf (1985) presents a method for learning macro-operators and shows that the method is applicable to serially decomposable problems. In this paper I analyze the computational complexity of serial decomposability. Assuming that operators take polynomial time, it is NP-complete. to determine if an operator (or set of operators) is not serially decomposable, whether or not an ordering of state variables is given. In addition to serial decomposability of operators, a serially decomposable requires that the set of solvable states is closed under the operators. It is PSPACE-complete to determine if a given finite state-variable problem is serially decomposable. In fact, every solvable instance of a PSPACE can be converted to a serially decomposable problem. Furthermore, given a bound on the size of the input, every in PSPACE can be transformed to a that is nearly serially-decomposable, i.e.…

The binary exponentiated gradient algorithm for learning linear functions

Tom Bylander

Artificial Intelligence · · cited 16× · DOI ↗ · more like this ·

This paper develops and analyzes a new online algorithm for learning linear functions, called the Binary Exponentiated Gradient algorithm (BEG). BEG imposes an lower and upper bound for all the weights. Using Kivinen and Warmuth's methodology, the BEG algorithm is developed from a binary entropy distance function and the square loss function, and worst-case upper bounds on the square loss are demonstrated for BEG on arbitrary sequences of trials (instance-outcome pairs). BEG's behavior is unusual in that in some situations its worst-case behavior is comparable to the wellknown gradient descent algorithms, e.g. Widrow-Hoff, while in others, it is comparable to the newer exponentiated gradient algorithms. An experiment shows when it outperforms both algorithms.

An average case analysis of planning

Tom Bylander

Artificial Intelligence · National Conference on Artificial Intelligence · · cited 11× · OpenAlex ↗ · more like this ·

I present an average case analysis of propositional STRIPS planning. The analysis assumes that each possible precondition (likewise postcondition) is equally likely too appear within an operator. Under this assumption, I derive bounds for when it is highly likely that a planning instanee can be efficiently solved, either by finding a plan or proving that no plan exists. Roughly, if planning instances have no conditions (ground atoms), g goals, and O(n9√δ) operators, then a simple, efficient algorithm can prove that no plan exists for at least 1 - 8 of the instances. If instances have Ω(n(ln g)(ln g/δ)) operators, then a simple, efficient algorithm can find a plan for at least 1-δ of the instances. A similar result holds for plan modification, i.e., solving a planning instance that is close too another planning instance with a known plan. Thus it would appear that propositional STRIPS…

USING CAUSAL REASONING IN GAIT ANALYSIS

DAVID E. HIRSCH, Sheldon R. Simon, Tom Bylander +2 more

Artificial Intelligence · Applied Artificial Intelligence · · cited 11× · DOI ↗ · more like this ·

This paper describes a series of experiments in which expert diagnostic systems were constructed to analyze human pathologic gait. The difference between successive systems is the recognition of the need for both causal reasoning about the process of gait and experiential, associational knowledge that can control causal reasoning. The performance of the first system (DR. GAIT-1), which relies exclusively on associational knowledge, is quite limited. The second system (DR. GAIT-2), because it is based on a qualitative causal model of gait, overcame many of the difficulties faced by the first system, but its ability to diagnose cases is limited by the complexity of causal reasoning. The third system (QUAWDS), which we are currently developing, is an experiment in integrating causal reasoning with associational knowledge so that robust conclusions can be produced efficiently.

Computational feasibility of structured matching

Ashok K. Goel, Tom Bylander

Artificial Intelligence · IEEE Transactions on Pattern Analysis and Machine Intelligence · · cited 11× · DOI ↗ · more like this ·

Structured matching is a task-specific technique for selecting one choice out of a small number of alternatives based on a given set of parameters. In structured matching, the knowledge and control for making a decision are integrated within a hierarchical structure. Each node in the hierarchy corresponds to a different aspect of the decision and contains knowledge for directly mapping the results of its children nodes (or selected parameters) into a choice on the subdecision. The root node selects the final choice for the decision. The authors formally characterize the task and strategy of structured matching and analyze its computational complexity. They believe that structured matching captures the essence of what makes a range of decision-making problems computationally feasible to solve.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML"…

A perceptron-like online algorithm for tracking the median

Tom Bylander, Bruce E. Rosen

Artificial Intelligence · Proceedings of International Conference on Neural Networks (ICNN'97) · · cited 9× · DOI ↗ · more like this ·

We present an online algorithm for tracking the median of a series of values. The algorithm updates its current estimate of the median by incrementing or decrementing a fixed value, which is analogous to perceptron updating. The median value of a sequence minimizes the absolute loss, i.e., the sum of absolute deviations. The analysis shows that the worst-case absolute loss of our algorithm is comparable to the absolute loss of any sequence of target medians, given restrictions on how much the target can change per trial.

Estimating generalization error using out-of-bag estimates

Tom Bylander, Dennis Hanzlik

Artificial Intelligence · National Conference on Artificial Intelligence · · cited 9× · OpenAlex ↗ · more like this ·

We provide a method for estimating the generalization error of a bag using out-of-bag estimates. In bagging, each predictor (single hypothesis) is learned from a bootstrap sample of the training examples; the output of a bag (a set of predictors) on an example is determined by voting. The out-of-bag estimate is based on recording the votes of each predictor on those training examples omitted from its bootstrap sample. Because no additional predictors are generated, the out-of-bag estimate requires considerably less time than 10- fold cross-validation. We address the question of how to use the out-of-bag estimate to estimate generalization error. Our experiments on several datasets show that the out-of-bag estimate and 10-fold cross-validation have very inaccurate (much too optimistic) confidence levels. We can improve the out-of-bag estimate by incorporating a correction.

A simple model of knowledge compilation

Tom Bylander

Artificial Intelligence · IEEE Expert · · cited 8× · DOI ↗ · more like this ·

The meaning of the term 'knowledge compilation' is examined. Knowledge compilation at two levels is described. The first is the knowledge level, in the sense described by A. Newell (1982). The second is the symbolic level, where 'symbolic' encompasses anything that can be implemented on a digital computer.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Learning Linear Threshold Approximations Using Perceptrons

Tom Bylander

Artificial Intelligence · Neural Computation · · cited 7× · DOI ↗ · more like this ·

We demonstrate sufficient conditions for polynomial learnability of suboptimal linear threshold functions using perceptrons. The central result is as follows. Suppose there exists a vector w * , of n weights (including the threshold) with “accuracy” 1 − α, “average error” η, and “balancing separation” σ, i.e., with probability 1 − α, w * correctly classifies an example x; over examples incorrectly classified by w * , the expected value of |w * · x| is η (source of inaccuracy does not matter); and over a certain portion of correctly classified examples, the expected value of |w * · x| is σ. Then, with probability 1 − δ, the perceptron achieves accuracy at least 1 − [∊ + α(1 + η/σ)] after O[n∊ −2 σ −2 (ln 1/δ)] examples.

Financial time series prediction and evaluation by genetic programming with trigonometric functions and high-order statistics

Tom Bylander, Roy Schwaerzel

Artificial Intelligence · · cited 6× · OpenAlex ↗ · more like this ·

This research describes an extension of the traditional application of Genetic Programming in the domain of the prediction of daily currency exchange rates. In combination with trigonometric operators, we introduce a new set of high-order statistical functions in a unique representation and analyze their performance using daily returns of the British Pound and Japanese Yen. In addition, the same experimental design and analysis is applied to ten other financial time series from two different domains. We will demonstrate that the introduction of high-order statistical functions in combination with trigonometric functions will outperform other traditional models such as ARMA models and Genetic Programming with the basic function set. We utilize the Akaike Information Criterion for the selection of the best ARMA model for our benchmark testing. Performance will be measured on hit…

Polynomial learnability of linear threshold approximations

Tom Bylander

Artificial Intelligence · · cited 6× · DOI ↗ · more like this ·

I demonstrate sufficient conditions for polynomial learnability of suboptimal linear threshold functions. The central result is as follows. Suppose there exists a vector ~ w of n weights (including the threshold) with &amp;quot;accuracy &amp;quot; 1 \\Gamma ff, &amp;quot;average error&amp;quot; j, and &amp;quot;balancing separation&amp;quot; oe, i.e., with probability 1 \\Gamma ff, ~ w correctly classifies an example ~x; over examples incorrectly classified by ~ w , the expected value of j ~ w \\Delta ~xj is j (source of inaccuracy does not matter); and over a certain portion of correctly classified examples, the expected value of j ~ w \\Delta ~xj is oe. Then, both the perceptron and weighted majority algorithms achieve an online accuracy (i.e., accuracy over all examples) at least 1 \\Gamma (ffl + ff(1 + j=oe)) with confidence at least 1 \\Gamma ffi in time and number of examples…

Worst-case absolute loss bounds for linear learning algorithms

Tom Bylander

Artificial Intelligence · National Conference on Artificial Intelligence · · cited 4× · OpenAlex ↗ · more like this ·

The absolute loss is the absolute difference between the desired and predicted outcome. I demonstrate worst-case upper bounds on the absolute loss for the perceptron algorithm and an exponentiated update algorithm related to the Weighted Majority algorithm. The bounds characterize the behavior of the algorithms over any sequence of trials, where each trial consists of an example and a desired outcome interval (any value in the interval is an acceptable outcome). The worstcase absolute loss of both algorithms is bounded by: the absolute loss of the best linear function in the comparison class, plus a constant dependent on the initial weight vector, plus a per-trial loss. The per-trial loss can be eliminated if the learning algorithm is allowed a tolerance from the desired outcome. For concept learning, the worst-case bounds lead to mistake bounds that are comparable to previous results.…

Tractability and artificial intelligence

Tom Bylander

Artificial Intelligence · Journal of Experimental & Theoretical Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

Abstract This paper argues that tractability should be a primary concern for computational theories of intelligence. The majority of research in artificial intelligence is devoted to the study of intractable problems and formalisms, but these do not directly address tractability. This paper suggest that one methodology for discovering tractable problems is to construct and analyse ad hoc programs.

Learning probabilistically consistent linear threshold functions

Tom Bylander

Artificial Intelligence · · cited 3× · DOI ↗ · more like this ·

A linear threshold function (LTF) is probabilistically consistent (p-consistent) on a noisy distribution of labeled examples if the probability of noise decreases monotonically with the absolute difference from the LTF&amp;apos;s threshold. I show that pconsistent LTFs are PAC-learnable in polynomial time if the separation between examples and the LTF is sufficiently large, and if the vector length of each example is sufficiently small. This result generalizes previous polynomial learnability results for binary independent features (often called naive Bayes), linear least squares, and classification noise. However, the bound derived for the number of examples is not a low-order polynomial, and multiple iterations are required with one update per iteration (any incremental algorithm that PAC-learns LTFs can be utilized for updating) . Nevertheless, the algorithm performs well on…

The qualitative difference resolution rule

Tom Bylander

Artificial Intelligence · National Conference on Artificial Intelligence · · cited 3× · OpenAlex ↗ · more like this ·

Consolidation is inferring the behavioral description of a device by composing the behavioral descriptions of its components, e.g., deriving the qualitative differential equations (QDBs) of a device from those of its components. In previous work, Dormoy and Raiman described the qualitative resolution rule, which is a general rule for deriving QDEs of combinations of components. However, the qualitative resolution rule is intractable in general. As a step toward understanding tractable qualitative reasoning, I present a new QDE resolution rule, the qualitative difference resolution rule, that supports the tractable consolidation of components in which direction of flow is dependent on the signs of pressure differences. Pipes and containers are general types of components that match this rule. The pressure regulator example also matches this rule.

Numeric Query Answering on the Web

Steven O’Hara, Tom Bylander

Information Systems · International Journal on Semantic Web and Information Systems · · cited 2× · DOI ↗ · more like this ·

Query answering usually assumes that the asker is looking for a single correct answer to the question. When retrieving a textual answer this is often the case, but when searching for numeric answers, there are additional considerations. In particular, numbers often have units associated with them, and the asker may not care whether the raw answer is in feet or meters. Also, numbers usually denote a precision. In a few cases, the precision may be explicit, but normally, there is an implied precision associated with every number. Finally, an association between different reliability levels to different sources can be made. In this paper, the authors experimentally show that, in the context of conflicting answers from multiple sources, numeric query accuracy can be improved by taking advantage of units, precision, and the reliability of sources.

Predicting website correctness from consensus analysis

Steven O’Hara, Tom Bylander

Information Systems · · cited 1× · DOI ↗ · more like this ·

Websites vary in terms of reliability. One could assume that NASA's website will be very accurate for Astronomy questions. Wikipedia is less accurate but is still more accurate than a generic Google search. In this research we ask a large number of "factoid" questions to several different search engines. We collect those responses and determine the correctness of each candidate answer. The answers are grouped by website source, and are compared to other websites to infer website correctness.

Diagnosis by integrating model-based reasoning with knowledge-based reasoning

Tom Bylander

Artificial Intelligence · NASA STI Repository (National Aeronautics and Space Administration) · cited 1× · OpenAlex ↗ · more like this ·

Our research investigates how observations can be categorized by integrating a qualitative physical model with experiential knowledge. Our domain is diagnosis of pathologic gait in humans, in which the observations are the gait motions, muscle activity during gait, and physical exam data, and the diagnostic hypotheses are the potential muscle weaknesses, muscle mistimings, and joint restrictions. Patients with underlying neurological disorders typically have several malfunctions. Among the problems that need to be faced are: the ambiguity of the observations, the ambiguity of the qualitative physical model, correspondence of the observations and hypotheses to the qualitative physical model, the inherent uncertainty of experiential knowledge, and the combinatorics involved in forming composite hypotheses. Our system divides the work so that the knowledge-based reasoning suggests which…