arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Karl Mathia

12 papers · 1993–2008

1993: 21994: 11995: 21996: 01997: 11998: 01999: 12000: 02001: 02002: 32003: 12004: 02005: 02006: 02007: 02008: 1
1993peak 3 in 20022008

Frequent co-authors

Papers

showing 1–12 of 12 RSS

Linear Hopfield networks and constrained optimization

G.G. Lendaris, Karl Mathia, R. Saeks

Artificial Intelligence · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · · cited 49× · DOI ↗ · more like this ·

It is shown that a Hopfield neural network (with linear transfer functions) augmented by an additional feedforward layer can be used to compute the Moore-Penrose generalized inverse of a matrix. The resultant augmented linear Hopfield network can be used to solve an arbitrary set of linear equations or, alternatively, to solve a constrained least squares optimization problem. Applications in signal processing and robotics are considered. In the former case the augmented linear Hopfield network is used to estimate the "structured noise" component of a signal and adjust the parameters of an appropriate filter on-line, whereas in the latter case it is used to implement an on-line solution to the inverse kinematics problem.

Asymptotic dynamic programming: preliminary concepts and results

R. Saeks, C. Cox, Karl Mathia +1 more

Computational Theory and Mathematics · Proceedings of International Conference on Neural Networks (ICNN'97) · · cited 17× · DOI ↗ · more like this ·

A formal setting for the development of adaptive critic techniques is established in a nonlinear dynamical systems setting and some preliminary stability and suboptimality theorems are developed. Two alternative versions of the theory are developed, one with a known plant and one with an initial unknown plant which must be identified online.

Solving Nonlinear Equations Using Recurrent Neural Networks

Karl Mathia, R. Saeks

Artificial Intelligence · · cited 16× · OpenAlex ↗ · more like this ·

A class of recurrent neural networks is developed to solve nonlinear equations, which are approximated by a multilayer perceptron (MLP). The recurrent network includes a linear Hopfield network (LHN) and the MLP as building blocks. This network inverts the original MLP using constrained linear optimization and Newton’s method for nonlinear systems. The solution of a nonlinear equation with computer simulation illustrates the algorithm. 1 Problem Context A class of recurrent neural networks is used to solve nonlinear equations, where the motivation for using artificial neural networks is their learning capability. For this work the properties of multilayer perceptron (MLP) as universal function approximators [3] are of particular advantage: data with unknown structure, taken from a nonlinear system, are approximated by an MLP. The MLP is then inverted, i.e. the approximated equation is…

On Matching ANN Structure to Problem Domain Structure

George G. Lendaris, Martin Zwick, Karl Mathia

Artificial Intelligence · PDXScholar (Portland State University) · · cited 13× · OpenAlex ↗ · more like this ·

To achieve reduced training time and improved generalization with artificial neural networks (ANN, or NN), it is important to use a reduced complexity NN structure. A "problem" is defined by constraints among the variables describing it. If knowledge about these constraints could be obtained a priori, this could be used to reduce the complexity of the ANN before training it. Systems theory literature contains methods for determining and representing structural aspects of constrained data (these methods are herein called GSM, general systems method). The suggestion here is to use the GSM model of the given data as a pattern for modularizing a NN prior to training it. The present work assumes the GSM model for the given problem context has been determined (represented here in the form of Boolean functions of known decompositions). This means that certain information is available about…

On neural network hardware and programming paradigms

Karl Mathia, Jonathan Y. Clark

Artificial Intelligence · · cited 5× · DOI ↗ · more like this ·

Implementation guidelines and performance benchmarks for dedicated neural network hardware and software are proposed. An example of a dedicated neural network processor and the implementation of a popular neural network architecture and learning algorithm on this hardware is presented, emphasizing the specific architecture and programming paradigm. Finally, the performance of the implementation is benchmarked in a single-processor and multiple-processor environment against a supercomputer. Such implementations are aimed for neural network application requiring rapid online learning.

Linear Hopfield networks, inverse kinematics and constrained optimization

Karl Mathia, R. Saeks, G.G. Lendaris

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

Methods for the design of different types of linear Hopfield networks are presented. The resulting neural networks are guaranteed to converge to their stable equilibrium, i.e. to solutions of the linear equations implicitly represented by the network. The construction of a step size is introduced, which allows convergence of the dynamic process at or near maximum rate. This work is a continuation the authors' previous work (1994), and as an application example a neural network solution to the inverse kinematics problem is described.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Control of formations under persistent disturbances

Gerardo Lafferriere, Karl Mathia

Computer Networks and Communications · · cited 3× · DOI ↗ · more like this ·

We study the distributed control of autonomous second order agents under persistent disturbances. We show that the usual averaging rule for convergence to formation is only able to reject constant disturbances that are identical for each agent. We also prove that using a distributed dynamic compensation law the system can be made to converge to formation under constant perturbations of the control input even when the perturbations are different for each agent. We illustrate the results with numerical simulations.

&lt;title&gt;Prestructuring ANNs via a priori knowledge &amp;lt;b&amp;gt;(Abstract only)&amp;lt;/b&amp;gt;&lt;/title&gt;

George G. Lendaris, Karl Mathia

Artificial Intelligence · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 3× · DOI ↗ · more like this ·

The work to be described has as its objective development of a constructive method that uses certain a priori information about a problem domain to design the starting structure of an artificial neural network (ANN). For the prestructuring process, there is motivation to move away from homogeneous structures to ones that comprise modules of smaller ANNs. Issues of concern include physical realizability, scalability of training time with large numbers of connections, and successful generalization. The method explored is based on a general systems theory methodology (here called GSM) that calculates a kinds of structural information of the problem domain via analyzing I/O pairs from that domain. This GSM-based information is used for developing a modularized ANN starting structure. Extensive experiments on 3-input, 1-output Boolean mappings verify our predictions. In addition, the…

A digital processor for neural networks

R. Saeks, K. Pridd, David P. Donovan +2 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

A special purpose digital processor which is optimized for neural network applications is described. The design is built around a small number of native instructions, each of which correspond to a high level neural network construct, thereby facilitating a highly pipelined processor implementation while simultaneously minimizing the number of instructions required to realize a given network. The neural network processor (NNP(R)) has been implemented for use in both PC/ISA and VME systems and is supported by a full suite of development software.

&lt;title&gt;Application of highly parallel computing hardware to pattern recognition problems&lt;/title&gt;

Kevin L. Priddy, Karl Mathia, Timothy J. Robinson +1 more

Artificial Intelligence · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 0× · DOI ↗ · more like this ·

Neural networks are well known for their ability to perform pattern recognition tasks. This paper discusses the use of parallel neural network hardware for performing pattern recognition tasks. We address the need for neural network hardware and how it can dramatically improve system performance both in training and in actual applications. The use of specialized parallel processing hardware is discussed as well as alternative hardware and software approaches. Finally we give some comparisons between multi-processor computer architecture, Pentium class microcomputers and custom hardware.

Knowledge to Prestructure ANNs

George Lendaris And, George G. Lendaris, Karl Mathia

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

The objective of the present work is to develop a constructive method that uses certain a priori information about a problem domain to design the starting structure of an artificial neural network (ANN). The method explored is based on a general systems theory methodology (here called GSM) that calculates a kind of structural information of the problem domain via analyzing I/O pairs from that domain. A modularized ANN structure is developed based on the GSM information provided. The notion of performance subset (PS) of an ANN structure is described, and extensive experiments on 3-input, 1-output Boolean mappings indicate that the resulting modularized-ANN design is &amp;apos;conservative&amp;apos; in the sense that the PS of the modularized ANN contains at least all the mappings included in the GSM category used to design the ANN. Partial experiments on 5-input, 1-output Boolean…

On Matching ANN Structure to Problem Domain Structure

George Lendaris Martin, Martin Zwick, Karl Mathia

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

To achieve reduced training time and improved generalization with artificial neural networks (ANN, or NN), it is important to use a reduced complexity NN structure. A &amp;quot;problem&amp;quot; is defined by constraints among the variables describing it. If knowledge about these constraints could be obtained a priori, this could be used to reduce the complexity of the ANN before training it. Systems theory literature contains methods for determining and representing structural aspects of constrained data (these methods are herein called GSM, general systems method). The suggestion here is to use the GSM model of the given data as a pattern for modularizing a NN prior to training it. The present work assumes the GSM model for the given problem context has been determined (represented here in the form of Boolean functions of known decompositions). This means that certain information is…