arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

F. Fallside

65 papers · 1966–2005

1966: 11967: 01968: 01969: 11970: 01971: 31972: 11973: 11974: 01975: 01976: 41977: 31978: 21979: 11980: 01981: 01982: 01983: 01984: 01985: 11986: 11987: 41988: 21989: 31990: 21991: 41992: 51993: 21994: 11995: 11996: 01997: 01998: 01999: 02000: 02001: 02002: 62003: 72004: 02005: 9
1966peak 9 in 20052005

Frequent co-authors

Papers

showing 1–25 of 65 RSS

A theoretical investigation into the performance of the Hopfield model

S.V.B. Aiyer, Mahesan Niranjan, F. Fallside

Artificial Intelligence · IEEE Transactions on Neural Networks · · cited 382× · DOI ↗ · more like this ·

An analysis is made of the behavior of the Hopfield model as a content-addressable memory (CAM) and as a method of solving the traveling salesman problem (TSP). The analysis is based on the geometry of the subspace set up by the degenerate eigenvalues of the connection matrix. The dynamic equation is shown to be equivalent to a projection of the input vector onto this subspace. In the case of content-addressable memory, it is shown that spurious fixed points can occur at any corner of the hypercube that is on or near the subspace spanned by the memory vectors. Analysed is why the network can frequently converge to an invalid solution when applied to the traveling salesman problem energy function. With these expressions, the network can be made robust and can reliably solve the traveling salesman problem with tour sizes of 50 cities or more.

Script recognition using hidden Markov models

R. Nag, Kwok-Man Wong, F. Fallside

Computer Vision and Pattern Recognition · · cited 98× · DOI ↗ · more like this ·

A handwritten script recognition system is presented which uses Hidden Markov Models (HMM), a technique widely used in speech recognition. The script is encoded as templates in the form of a sequence of quantised inclination angles of short equal length vectors together with some additional features. A HMM is created for each written word from a set of training data. Incoming templates are recognised by calculating which model has the highest probability for producing that template. The task chosen to test the system is that of handwritten word recognition, where the words are digits written by one person. Results are given which show that HMMs provide a versatile pattern matching tool suitable for some image processing tasks as well as speech processing problems.

Static and Dynamic Error Propagation Networks with Application to Speech Coding

A.J. Robinson, F. Fallside

Artificial Intelligence · Neural Information Processing Systems · · cited 81× · OpenAlex ↗ · more like this ·

Error propagation nets have been shown to be able to learn a variety of tasks in which a static input pattern is mapped outo a static output pattern. This paper presents a generalisation of these nets to deal with time varying, or dynamic patterns, and three possible architectures are explored. As an example, dynamic nets are applied to tbe problem of speech coding, in which a time sequence of speech data are coded by one net and decoded by another. The use of dynamic nets gives a better signal to noise ratio than that achieved using static nets. 1.

Speech synthesis from concept: A method for speech output from information systems

S.J. Young, F. Fallside

Artificial Intelligence · The Journal of the Acoustical Society of America · · cited 78× · DOI ↗ · more like this ·

A synthesis method, called speech synthesis from concept, is described which has been designed specifically for providing speech output from information systems. It differs from conventional techniques in that data is passed from the information system to the speech synthesis system, not in the form of text or phonetic transcription, but in the form of an abstract structure called an input concept. The speech synthesis from concept system converts an input concept into speech by using a transformational grammar to generate a well-formed English sentence and a word concatenation synthesizer to generate the actual speech output. The ’’top down’’ nature of this process reduces the computation required within the information system and enables high-quality speech to be produced.

Pole-shifting procedure for multivariable systems using output feedback

F. Fallside, H. Seraji

Computer Networks and Communications · Proceedings of the Institution of Electrical Engineers · · cited 51× · DOI ↗ · more like this ·

A method is put forward for the pole allocation of linear multivariable systems using output feedback. The necessary and sufficient conditions for pole allocation are established and a method is given for calculating the output feedback matrix for attainable poles. The analysis, which is based on frequency-domain techniques, employs an equivalent single-input system to treat the multi-input system. A feature of the method is that the tightness of the feedbacks can be weighted relative to each other, although this may reduce the attainable set of closed-loop poles. The method is readily computerised, and an algorithm is established which generates a near attainable set of poles when the specified set is unattainable.

Synthesis of natural sounding pitch contours in isolated utterances using hidden Markov models

Andrej Ljolje, F. Fallside

Artificial Intelligence · IEEE Transactions on Acoustics Speech and Signal Processing · · cited 36× · DOI ↗ · more like this ·

A novel technique is introduced for characterizing prosodic structure and is used for speech synthesis. The mechanism consists of modeling a set of observations as a probabilistic function of a hidden Markov chain. It uses mixtures of Gaussian continuous probability density functions to represent the essential, perceptually relevant structure of intonation by observing movements of fundamental frequency in monosyllabic words of varying phonetic structure. High-quality speech synthesis, using multipulse excitation, is used to demonstrate the power of the HMM in preserving the naturalness of the intonational meaning, conveyed by the variation of fundamental frequency and duration. The fundamental frequency contours are synthesized using a random number generator from the models, and are imposed on a synthesized prototype word which had the intonation of a low fall. The resulting…

Direct design procedure for multivariable feedback systems

F. Fallside, H. Seraji

Computational Theory and Mathematics · Proceedings of the Institution of Electrical Engineers · · cited 36× · DOI ↗ · more like this ·

A direct design procedure is established for linear time-invariant controllable multivariable systems which permits a straightforward calculation of the feedback matrix to attain prescribed closed-loop poles. It permits the choice of the relative tightness of the feedback to each input, and hence allows design with feedback to only some inputs (i.e. incomplete input feedback). Furthermore, it permits the design of the important practical case where some states are not accessible. For these, the procedure produces the necessary and sufficient condition for pole positioning to be possible, and permits the required feedback to be calculated. The procedure is applicable to systems with any number of inputs and states. Computationally, the method is extremely fast, with computation times of the order of seconds, making it well suited to computer-aided control-system design.

A direct control method for a class of nonlinear systems using neural networks

E. Tzirkel‐Hancock, F. Fallside

Artificial Intelligence · International Conference on Artificial Neural Networks · · cited 35× · OpenAlex ↗ · more like this ·

Presents a direct control scheme for a class of continuous time nonlinear systems that are linear in the control variable. The objective of control is to track a desired reference signal. This type of system is encountered in many applications, e.g. rigid link robot manipulator control. The advantage of restricting attention to these systems is that the control theory of these systems is well developed. The control method proposed here does not assume knowledge of plant nonlinearities. >

Fully vector-quantized neural network-based code-excited nonlinear predictive speech coding

Lizhong Wu, Mahesan Niranjan, F. Fallside

Computer Vision and Pattern Recognition · IEEE Transactions on Speech and Audio Processing · · cited 30× · DOI ↗ · more like this ·

Recent studies have shown that nonlinear predictors can achieve about 2-3 dB improvement in speech prediction over conventional linear predictors. In this paper, we exploit the advantage of the nonlinear prediction capability of neural networks and apply it to the design of improved predictive speech coders. Our studies concentrate on the following three aspects: (a) the development of short-term (formant) and long-term (pitch) nonlinear predictive vector quantizers (b) the analysis of the output variance of the nonlinear predictive filter with respect to the input disturbance (c) the design of nonlinear predictive speech coders. The above studies have resulted in a fully vector-quantized, code-excited, nonlinear predictive speech coder. Performance evaluations and comparisons with linear predictive speech coding are presented. These tests have shown the applicability of nonlinear…

A neural network based, speaker independent, large vocabulary, continuous speech recognition system: the WERNICKE project

Tony Robinson, Luı́s B. Almeida, Jean-Marc Boite +9 more

Artificial Intelligence · · cited 30× · DOI ↗ · more like this ·

International Computer Science Institute (ICSI), USA(Author list is alphabetical with the exception of the typist.)ABSTRACTThis paper describes the research underway for the ESPRITWERNICKE project. The project brings together a num-ber of different groups from Europe and the US and focuseson extending the state-of-the-art for hybrid hidden Markovmodel/connectionist approaches to large vocabulary, continu-ous speech recognition. Thispaper describes the specific goalsoftheresearchandpresentstheworkperformedtodate. Resultsare reported for the resource management talker-independentrecognition task. The paper concludes with a discussion of theprojected future work.Keywords: Recognition, Neural Nets, HMM.1. BACKGROUNDW

A method for computing invariant zeros and transmission zeros of invertible systems

V. Sinswat, Rajni V. Patel, F. Fallside

Computational Theory and Mathematics · International Journal of Control · · cited 29× · DOI ↗ · more like this ·

This paper presents a method, for determining simultaneously the invariant zeros and the transmission zeros of a large class of linear, time-invariant, invertible, multi-variable systems. The zeros are defined via the concept of minimal order system inverses. These definitions are then used to develop algorithms for determining the positions of the invariant zeros and the transmission zeros. The definitions and algorithms proposed in this paper do not require the systems to be controllable or observable. The zeros are obtained as the eigenvalues of a matrix derived from the system matrices and of order not larger than that of the system. Hence the method is computationally efficient, especially for high-order systems. Three numerical examples are given to illustrate the method.

Analysis of Non-linear Differential Equations by the Volterra Series†

J. Waddington, F. Fallside

Modeling and Simulation · International Journal of Control · · cited 24× · DOI ↗ · more like this ·

ABSTRACT The Volterra series is used to investigate aperiodic solutions of certain second-order differential equations with non-linear damping and non-linear restoring force. Solutions are obtained in the phase plane for trajectories with zero initial conditions. These are obtained by approximating the Volterra series, and it is shown that the approximation involved is small over a wide range of values of linear damping.

Sequential Adaptation of Radial Basis Function Neural Networks and its Application to Time-series Prediction

Visakan Kadirkamanathan, Mahesan Niranjan, F. Fallside

Artificial Intelligence · Neural Information Processing Systems · · cited 23× · OpenAlex ↗ · more like this ·

We develop a sequential adaptation algorithm for radial basis function (RBF) neural networks of Gaussian nodes, based on the method of successive F-Projections. This method makes use of each observation efficiently in that the network mapping function so obtained is consistent with that information and is also optimal in the least L2-norm sense. The RBF network with the F-Projections adaptation algorithm was used for predicting a chaotic time-series. We compare its performance to an adaptation scheme based on the method of stochastic approximation, and show that the F-Projections algorithm converges to the underlying model much faster.

Lexical stress recognition using hidden Markov models

G.J. Freij, F. Fallside

Artificial Intelligence · · cited 19× · DOI ↗ · more like this ·

A probabilistic algorithm is described for the estimation of the lexical stress pattern of English words from the acoustic signal using hidden Markov models (HMMs) with continuous asymmetric Gaussian probability density functions. Adopting a binary stressed-unstressed syllable classification strategy two five-state HMMs of the left-to-right type were generated, one for each stress value. Training observation vectors were extracted from a corpus of bisyllabic stress-minimal word pairs and consisted of nine acoustic measurements based on fundamental frequency, syllabic energy and coarse linear prediction spectra. Evaluation of both models using a set of recordings of the same word pairs yielded an average stress recognition rate of 94%.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

The modified kanerva model: theory and results for real-time word recognition

Thomas J. Clarke, Richard W. Prager, F. Fallside

Artificial Intelligence · IEE Proceedings F Radar and Signal Processing · · cited 17× · DOI ↗ · more like this ·

The use of the modified Kanerva model to perform word recognition is continuous speech after being trained on the multi-speaker Alvey ‘Hotel’ speech corpus is described. A theoretical analysis has enabled us to increase the speed of execution of part of the model by two orders of magnitude over that previously reported by Prager and Fallside. The memory required for the operation of the model has been similarly reduced. The recognition accuracy reaches 95% without syntactic constraints when tested on different data from the seven trained speakers. Real-time simulation of a model with 9734 active units is now possible in both training and recognition modes using the Alvey Parsifal transputer array. The modified Kanerva model is a static network consisting of a fixed nonlinear mapping (location matching) followed by a single layer of conventional adaptive links. A section of preprocessed…

Continuous speech recognition for the TIMIT database using neural networks

F. Fallside, H. Lucke, T.P. Marsland +5 more

Artificial Intelligence · International Conference on Acoustics, Speech, and Signal Processing · · cited 15× · DOI ↗ · more like this ·

Four types of neural networks which have previously been established for speech recognition and tested on a small, seven-speaker, 100-sentence database are applied to the TIMIT database. The networks are a recurrent network phoneme recognizer, a modified Kanerva model morph recognizer, a compositional representation phoneme-to-word recognizer, and a modified Kanerva model morph-to-word recognizer. The major result is for the recurrent net, giving a phoneme recognition accuracy of 57% from the si and sx sentences. The Kanerva morph recognizer achieves 66.2% accuracy for a small subset of the sa and sx sentences. The results for the word recognizers are incomplete.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

A stability based neural network control method for a class of nonlinear systems

E. Tzirkel‐Hancock, F. Fallside

Artificial Intelligence · · cited 13× · DOI ↗ · more like this ·

A direct control scheme for a class of continuous-time nonlinear systems using neural networks is presented. The objective of the control is to track a desired reference signal. This objective is achieved through input/output linearization of the system with neural networks. Learning, based on a stability type algorithm, takes place simultaneously with control. As such, the method is closely related to adaptive control methods and the field of neural network training. In particular, the importance of the property of persistent excitation and its implications for learning with networks of localized receptive fields are discussed.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

A technique for using multipulse linear predictive speech synthesis in text-to-speech type systems

Attila Károly Varga, F. Fallside

Artificial Intelligence · IEEE Transactions on Acoustics Speech and Signal Processing · · cited 12× · DOI ↗ · more like this ·

A scheme for alteration of pitch and timing in multipulse linear predictive synthesized speech is presented. The method is a hybrid of waveform coding and linear prediction. It attempts to combine the high-quality sound units available in waveform techniques with the ability to alter prosody available from linear prediction.

On modelling the dynamics of speech patterns

Mahesan Niranjan, F. Fallside

Artificial Intelligence · · cited 9× · DOI ↗ · more like this ·

Short term spectral analysis or source-filter modelling gives a parameterised description of the acoustic signal in terms of a sequence of vectors. These parameter vectors change slowly with time corresponding to a slowly moving vocal tract. This paper deals with modelling the time variation by a set of target vectors and interpolation functions that overlap in time; temporal decomposition We present a simple geometric interpretation of the approach and discuss it in relation to hidden Markov modelling.

Temporal decomposition: a framework for enhanced speech recognition

Mahesan Niranjan, F. Fallside

Signal Processing · International Conference on Acoustics, Speech, and Signal Processing · · cited 8× · DOI ↗ · more like this ·

Short term spectral analysis of source-filter modeling gives a parameterized description of the acoustic signal in terms of a sequence of vectors. These parameter vectors change slowly with time corresponding to a slowly moving vocal tract. The authors consider a model (temporal decomposition) that approximates the time variation by a set of target vectors and interpolation functions that overlap in time. They present a geometric interpretation of the approach, describe an algorithm for decomposing a given utterance into parameters of such a model, and discuss how such modeling can be used in speech recognition systems.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

On minimal-order inverses of linear continuous time-invariant systems

V. Sinswat, F. Fallside

Computational Theory and Mathematics · International Journal of Control · · cited 8× · DOI ↗ · more like this ·

Minimal-order inverses of a linear continuous time-invariant system are defined and an algebraic algorithm for constructing them is presented. A necessary and sufficient condition for the applicability of the algorithm is shown to be the same as that for the invertibility of the given system. Some important properties of the minimal-order inverses relevant to the design of linear multivariable systems are derived. In particular the characteristic polynomials of all minimal-order inverses of a given system are shown to be identical and invariant under duality, coordinate transformations and proportional state feedback.

Temporal reasoning: a solution for multiple agent collision avoidance

Craig MacNish, F. Fallside

Artificial Intelligence · · cited 7× · DOI ↗ · more like this ·

A temporal reasoning system for solving practical planning problems is presented. The system is based on a nonmonotonic temporal logic which features homogeneous assertions, continuous time, and defeasible inferences. The model-theoretic semantics provide a basis for algorithms which generate inferences directly from axioms in the logic. The system's utility is demonstrated by a solution to the multiple agent collision avoidance problem. A formulation of this problem separates spatial and temporal considerations. The temporal reasoning system is used to predict collisions and generate efficient strategies for avoiding them.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Models of dynamic complexity for time-series prediction (neural networks)

Visakan Kadirkamanathan, Mahesan Niranjan, F. Fallside

Artificial Intelligence · · cited 7× · DOI ↗ · more like this ·

A model of dynamic complexity, a growing Gaussian radial basis function (GRBF) network, is developed by analyzing sequential learning in the function space. The criteria for adding a new basis function to the model are based on the angle formed between a new basis function and the existing basis functions and also on the prediction error. When a new basis function is not added the model parameters are adapted by the extended Kalman filter (EKF) algorithm. This model is similar to the resource allocating network (RAN) and hence this work provides an alternative interpretation to the RAN. An enhancement to the RAN is suggested where RAN is combined with EKF. The RAN and its variants are applied to the task of predicting the logistic map and the Mackey-Glass chaotic time-series, and the advantages of the enhanced model are demonstrated.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML"…

Pole and zero assignment for linear multivariable systems using unity-rank feedback

F. Fallside, Rajni V. Patel

Computational Theory and Mathematics · Electronics Letters · · cited 7× · DOI ↗ · more like this ·

The problem of synthetising a specified transfer function between an input-output pair by pole-zero assignment using unity-rank feedback is considered. Relationships are derived which show explicitly the effect of unity-rank feedback on the transfer function between a given input and output, and an algorithm is presented for approximating the desired transfer function in a recursive manner.

Frame compression in hidden Markov models

S. Austin, F. Fallside

Computer Vision and Pattern Recognition · · cited 6× · DOI ↗ · more like this ·

Most forms of hidden Markov models (HMMs) do not incorporate contextual information and consequently may have problems in distinguishing isolated errors in utterances from significant features of short duration. A HMM has been derived, which treats sequence observations as a whole and not as a series of independent random variables. The model is based upon a distortion measure, which compares observations against templates contained in the model. From a sequence of observations, a typical distortion is computed and this is used to match a test utterance to the model, the utterance being regarded as a string of observation sequences corresponding to state occupancies. In addition, the length of a sequence is modelled explicitly. The natures of the duration model and distortion measure are left undefined in order to accommodate alternative parameterisations of the speech. In the training…