arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Koen Tiels

31 papers · 2016–2025

2016: 42017: 22018: 52019: 32020: 22021: 22022: 22023: 62024: 12025: 4
2016peak 6 in 20232025

Frequent co-authors

Papers

showing 1–25 of 31 RSS

Identification of block-oriented nonlinear systems starting from linear approximations: A survey

Maarten Schoukens, Koen Tiels

eess.SY · · cited 237× · arXiv ↗ · more like this ·

Block-oriented nonlinear models are popular in nonlinear system identification because of their advantages of being simple to understand and easy to use. Many different identification approaches were developed over the years to estimate the parameters of a wide range of block-oriented nonlinear models. One class of these approaches uses linear approximations to initialize the identification algorithm. The best linear approximation framework and the $ε$-approximation framework, or equivalent frameworks, allow the user to extract important information about the system, guide the user in selecting good candidate model structures and orders, and prove to be a good starting point for nonlinear system identification algorithms. This paper gives an overview of the different block-oriented nonlinear models that can be identified using linear approximations, and of the identification algorithms…

Decoupling multivariate functions using a non-parametric Filtered CPD approach

Jan Decuyper, Koen Tiels, Siep Weiland +1 more

eess.SY · · cited 9× · arXiv ↗ · more like this ·

Black-box model structures are dominated by large multivariate functions. Usually a generic basis function expansion is used, e.g. a polynomial basis, and the parameters of the function are tuned given the data. This is a pragmatic and often necessary step considering the black-box nature of the problem. However, having identified a suitable function, there is no need to stick to the original basis. So-called decoupling techniques aim at translating multivariate functions into an alternative basis, thereby both reducing the number of parameters and retrieving underlying structure. In this work a filtered canonical polyadic decomposition (CPD) is introduced. It is a non-parametric method which is able to retrieve decoupled functions even when facing non-unique decompositions. Tackling this obstacle paves the way for a large number of modelling applications.

Decoupling multivariate functions using a nonparametric filtered tensor decomposition

Jan Decuyper, Koen Tiels, Siep Weiland +2 more

stat.ML · · cited 5× · arXiv ↗ · more like this ·

Multivariate functions emerge naturally in a wide variety of data-driven models. Popular choices are expressions in the form of basis expansions or neural networks. While highly effective, the resulting functions tend to be hard to interpret, in part because of the large number of required parameters. Decoupling techniques aim at providing an alternative representation of the nonlinearity. The so-called decoupled form is often a more efficient parameterisation of the relationship while being highly structured, favouring interpretability. In this work two new algorithms, based on filtered tensor decompositions of first order derivative information are introduced. The method returns nonparametric estimates of smooth decoupled functions. Direct applications are found in, i.a. the fields of nonlinear system identification and machine learning.

Frequency Response Function Identification from Incomplete Data: A Wavelet-based Approach

Nic Dirkx, Koen Tiels, Tom Oomen

Computer Vision and Pattern Recognition · IFAC-PapersOnLine · · cited 2× · DOI ↗ · more like this ·

Frequency Response Function (FRF) identification plays a crucial role in the design, the control, and the analysis of complex dynamical systems, including thermal and motion systems. Especially for applications that require long measurements, missing data samples, e.g., due to interruptions in the data transmission or sensor failure, often occur. The aim of this paper is to accurately identify nonparametric FRF models of periodically excited systems from noisy output measurements with missing samples. The presented method employs a wavelet-based transformation to address the identification problem in the time-frequency plane. A simulation example confirms that the developed techniques produce accurate estimates, even when many samples are missing.

A Wavelet-Based Approach to FRF Identification From Incomplete Data

Nic Dirkx, Koen Tiels, Tom Oomen

Computer Vision and Pattern Recognition · IEEE Transactions on Instrumentation and Measurement · · cited 1× · DOI ↗ · more like this ·

Frequency response function (FRF) estimation from measured data is an essential step in the design, control, and analysis of complex dynamical systems, including thermal and motion systems. Especially for systems that require long measurement time, missing samples in the data record, e.g., due to measurement interruptions, often occur. The aim of this article is to achieve accurate identification of nonparametric FRF models of periodically excited systems from noisy output measurements with missing samples. An identification framework is established that exploits a wavelet-based transform to separate the effect of the missing samples in the time domain from the system characteristics in tre frequency domain. The framework encompasses both a time-invariant and a time-varying wavelet-based estimator, which provides different mechanisms to address the missing samples. Experimental results…

Safety and optimality in learning-based control at low computational cost

Dominik Baumann, Krzysztof Kowalczyk, Cristian R. Rojas +2 more

eess.SY · · cited 0× · arXiv ↗ · more like this ·

Applying machine learning methods to physical systems that are supposed to act in the real world requires providing safety guarantees. However, methods that include such guarantees often come at a high computational cost, making them inapplicable to large datasets and embedded devices with low computational power. In this paper, we propose CoLSafe, a computationally lightweight safe learning algorithm whose computational complexity grows sublinearly with the number of data points. We derive both safety and optimality guarantees and showcase the effectiveness of our algorithm on a seven-degrees-of-freedom robot arm.

PNLSS Toolbox 1.0

Jan Decuyper, Koen Tiels, Johan Schoukens

eess.SY · · cited 0× · arXiv ↗ · more like this ·

This is a demonstration of the PNLSS Toolbox 1.0. The toolbox is designed to identify polynomial nonlinear state-space models from data. Nonlinear state-space models can describe a wide range of nonlinear systems. An illustration is provided on experimental data of an electrical system mimicking the forced Duffing oscillator, and on numerical data of a nonlinear fluid dynamics problem.

A nonlinear model of vortex-induced forces on an oscillating cylinder in a fluid flow

Jan Decuyper, Tim De Troyer, Koen Tiels +2 more

physics.flu-dyn · · cited 0× · arXiv ↗ · more like this ·

A nonlinear model relating the imposed motion of a circular cylinder, submerged in a fluid flow, to the transverse force coefficient is presented. The nonlinear fluid system, featuring vortex shedding patterns, limit cycle oscillations and synchronisation, is studied both for swept sine and multisine excitation. A nonparametric nonlinear distortion analysis (FAST) is used to distinguish odd from even nonlinear behaviour. The information which is obtained from the nonlinear analysis is explicitly used in constructing a nonlinear model of the polynomial nonlinear state-space (PNLSS) type. The latter results in a reduction of the number of parameters and an increased accuracy compared to the generic modelling approach where typically no such information of the nonlinearity is used. The obtained model is able to accurately simulate time series of the transverse force coefficient over a wide…

Nonlinear system identification: Finding structure in nonlinear black-box models

Philippe Dreesen, Koen Tiels, Mariya Ishteva +1 more

Computational Mathematics · VUBIR (Vrije Universiteit Brussel) · · cited 0× · DOI ↗ · more like this ·

The use of black-box models is wide-spread in signal processing and system identification applications. However, often such models possess a large number of parameters, and obfuscate their inner workings, as there are cross-connections between all inputs and all outputs (and possibly all internal states) of the model. Although black-box models have proven their success and wide applicability, there is a need to shed a light on what goes on inside the model. We have developed a tensor-based method that aims at pinpointing the nonlinearities of a given nonlinear model into a small number of univariate nonlinear mappings, with the advantageous side-effect of reducing the parametric complexity. In this contribution we will discuss how the method is conceived, and how it can be applied to the task of finding structure in blackbox models. We have found that the tensor-based decoupling method…

Wiener system identification with generalized orthonormal basis functions

Koen Tiels, Johan Schoukens

eess.SY · · cited 0× · arXiv ↗ · more like this ·

Many nonlinear systems can be described by a Wiener-Schetzen model. In this model, the linear dynamics are formulated in terms of orthonormal basis functions (OBFs). The nonlinearity is modeled by a multivariate polynomial. In general, an infinite number of OBFs is needed for an exact representation of the system. This paper considers the approximation of a Wiener system with finite-order infinite impulse response dynamics and a polynomial nonlinearity. We propose to use a limited number of generalized OBFs (GOBFs). The pole locations, needed to construct the GOBFs, are estimated via the best linear approximation of the system. The coefficients of the multivariate polynomial are determined with a linear regression. This paper provides a convergence analysis for the proposed identification scheme. It is shown that the estimated output converges in probability to the exact output. Fast…

Decoupling static nonlinearities in a parallel Wiener-Hammerstein system: A first-order approach

Maarten Schoukens, Koen Tiels, Johan Schoukens

Computational Mathematics · · cited 0× · OpenAlex ↗ · more like this ·

Abstract—We present a method to decompose a static MIMO (multiple-input-multiple-output) nonlinearity into a set of SISO (single-input-single-output) polynomials acting on internal vari-ables that are related to the inputs and outputs of the MIMO nonlinearity by linear transformations. The method is inspired on the small-signal analysis of nonlinear circuits and proceeds by collecting first-order information of the MIMO function into a set of Jacobian matrices. A simultaneous diagonalization of the set of Jacobian matrices is computed using a tensor decomposition, providing the required linear transformations, after which also the coefficients of the internal SISO polynomials can be computed. The method is validated on measurements of a parallel two-branch Wiener-Hammerstein identification setup. I.

Truncated Gaussian Noise Estimation in State-Space Models

Rodrigo A. González, Angel L. Cedeño, Koen Tiels +1 more

eess.SY · · arXiv ↗ · more like this ·

Within Bayesian state estimation, considerable effort has been devoted to incorporating constraints into state estimation for process optimization, state monitoring, fault detection and control. Nonetheless, in the domain of state-space system identification, the prevalent practice entails constructing models under Gaussian noise assumptions, which can lead to inaccuracies when the noise follows bounded distributions. With the aim of generalizing the Gaussian noise assumption to potentially truncated densities, this paper introduces a method for estimating the noise parameters in a state-space model subject to truncated Gaussian noise. Our proposed data-driven approach is rooted in maximum likelihood principles combined with the Expectation-Maximization algorithm. The efficacy of the proposed approach is supported by a simulation example.

Neuro-Symbolic Operator for Interpretable and Generalizable Characterization of Complex Piezoelectric Systems

Abhishek Chandra, Taniya Kapoor, Mitrofan Curti +2 more

cs.LG · · arXiv ↗ · more like this ·

Complex piezoelectric systems are foundational in industrial applications. Their performance, however, is challenged by the nonlinear voltage-displacement hysteretic relationships. Efficient characterization methods are, therefore, essential for reliable design, monitoring, and maintenance. Recently proposed neural operator methods serve as surrogates for system characterization but face two pressing issues: interpretability and generalizability. State-of-the-art (SOTA) neural operators are black-boxes, providing little insight into the learned operator. Additionally, generalizing them to novel voltages and predicting displacement profiles beyond the training domain is challenging, limiting their practical use. To address these limitations, this paper proposes a neuro-symbolic operator (NSO) framework that derives the analytical operators governing hysteretic relationships. NSO first…

Self-Calibrating Position Measurements: Applied to Imperfect Hall Sensors

Max van Meer, Marijn van Noije, Koen Tiels +4 more

eess.SY · · arXiv ↗ · more like this ·

Linear Hall sensors are a cost-effective alternative to optical encoders for measuring the rotor positions of actuators, with the main challenge being that they exhibit position-dependent inaccuracies resulting from manufacturing tolerances. This paper develops a data-driven calibration procedure for linear analog Hall sensors that enables accurate online estimates of the rotor angle without requiring expensive external encoders. The approach combines closed-loop data collection with nonlinear identification to obtain an accurate model of the sensor inaccuracies, which is subsequently used for online compensation. Simulation results show that when the flux density model structure is known, measurement errors are reduced to the sensor noise floor, and experiments on an industrial setup demonstrate a factor of 2.6 reduction in the root-mean-square measurement error. These results confirm…

Magnetic Hysteresis Modeling with Neural Operators

Abhishek Chandra, Bram Daniels, Mitrofan Curti +2 more

cs.LG · · arXiv ↗ · more like this ·

Hysteresis modeling is crucial to comprehend the behavior of magnetic devices, facilitating optimal designs. Hitherto, deep learning-based methods employed to model hysteresis, face challenges in generalizing to novel input magnetic fields. This paper addresses the generalization challenge by proposing neural operators for modeling constitutive laws that exhibit magnetic hysteresis by learning a mapping between magnetic fields. In particular, three neural operators-deep operator network, Fourier neural operator, and wavelet neural operator-are employed to predict novel first-order reversal curves and minor loops, where novel means they are not used to train the model. In addition, a rate-independent Fourier neural operator is proposed to predict material responses at sampling rates different from those used during training to incorporate the rate-independent characteristics of magnetic…

A computationally lightweight safe learning algorithm

Dominik Baumann, Krzysztof Kowalczyk, Koen Tiels +1 more

eess.SY · · arXiv ↗ · more like this ·

Safety is an essential asset when learning control policies for physical systems, as violating safety constraints during training can lead to expensive hardware damage. In response to this need, the field of safe learning has emerged with algorithms that can provide probabilistic safety guarantees without knowledge of the underlying system dynamics. Those algorithms often rely on Gaussian process inference. Unfortunately, Gaussian process inference scales cubically with the number of data points, limiting applicability to high-dimensional and embedded systems. In this paper, we propose a safe learning algorithm that provides probabilistic safety guarantees but leverages the Nadaraya-Watson estimator instead of Gaussian processes. For the Nadaraya-Watson estimator, we can reach logarithmic scaling with the number of data points. We provide theoretical guarantees for the estimates, embed…

Neural oscillators for magnetic hysteresis modeling

Abhishek Chandra, Taniya Kapoor, Bram Daniels +4 more

cs.LG · · arXiv ↗ · more like this ·

Hysteresis is a ubiquitous phenomenon in science and engineering; its modeling and identification are crucial for understanding and optimizing the behavior of various systems. We develop an ordinary differential equation-based recurrent neural network (RNN) approach to model and quantify the hysteresis, which manifests itself in sequentiality and history-dependence. Our neural oscillator, HystRNN, draws inspiration from coupled-oscillatory RNN and phenomenological hysteresis models to update the hidden states. The performance of HystRNN is evaluated to predict generalized scenarios, involving first-order reversal curves and minor loops. The findings show the ability of HystRNN to generalize its behavior to previously untrained regions, an essential feature that hysteresis models must have. This research highlights the advantage of neural oscillators over the traditional RNN-based…

Identifying Lebesgue-sampled Continuous-time Impulse Response Models: A Kernel-based Approach

Rodrigo A. González, Koen Tiels, Tom Oomen

eess.SY · · arXiv ↗ · more like this ·

Control applications are increasingly sampled non-equidistantly in time, including in motion control, networked control, resource-aware control, and event-triggered control. Some of these applications use measurement devices that sample equidistantly in the amplitude domain. The aim of this paper is to develop a non-parametric estimator of the impulse response of continuous-time systems based on such sampling strategy, known as Lebesgue-sampling. To this end, kernel methods are developed to formulate an algorithm that adequately takes into account the output intersample behavior, which ultimately leads to more accurate models and more efficient output sampling compared to the standard approach. The efficacy of this method is demonstrated through a mass-spring damper case study.

Kernel-based identification using Lebesgue-sampled data

Rodrigo A. González, Koen Tiels, Tom Oomen

eess.SY · · arXiv ↗ · more like this ·

Sampling in control applications is increasingly done non-equidistantly in time. This includes applications in motion control, networked control, resource-aware control, and event-based control. Some of these applications, like the ones where displacement is tracked using incremental encoders, are driven by signals that are only measured when their values cross fixed thresholds in the amplitude domain. This paper introduces a non-parametric estimator of the impulse response and transfer function of continuous-time systems based on such amplitude-equidistant sampling strategy, known as Lebesgue sampling. To this end, kernel methods are developed to formulate an algorithm that adequately takes into account the bounded output uncertainty between the event timestamps, which ultimately leads to more accurate models and more efficient output sampling compared to the equidistantly-sampled…

Discovery of sparse hysteresis models for piezoelectric materials

Abhishek Chandra, Bram Daniels, Mitrofan Curti +3 more

cs.LG · · arXiv ↗ · more like this ·

This article presents an approach for modelling hysteresis in piezoelectric materials, that leverages recent advancements in machine learning, particularly in sparse-regression techniques. While sparse regression has previously been used to model various scientific and engineering phenomena, its application to nonlinear hysteresis modelling in piezoelectric materials has yet to be explored. The study employs the least-squares algorithm with a sequential threshold to model the dynamic system responsible for hysteresis, resulting in a concise model that accurately predicts hysteresis for both simulated and experimental piezoelectric material data. Several numerical experiments are performed, including learning butterfly-shaped hysteresis and modelling real-world hysteresis data for a piezoelectric actuator. The presented approach is compared to traditional regression-based and neural…

Retrieving highly structured models starting from black-box nonlinear state-space models using polynomial decoupling

Jan Decuyper, Koen Tiels, Mark C. Runacres +1 more

eess.SY · · arXiv ↗ · more like this ·

Nonlinear state-space modelling is a very powerful black-box modelling approach. However powerful, the resulting models tend to be complex, described by a large number of parameters. In many cases interpretability is preferred over complexity, making too complex models unfit or undesired. In this work, the complexity of such models is reduced by retrieving a more structured, parsimonious model from the data, without exploiting physical knowledge. Essential to the method is a translation of all multivariate nonlinear functions, typically found in nonlinear state-space models, into sets of univariate nonlinear functions. The latter is computed from a tensor decomposition. It is shown that typically an excess of degrees of freedom are used in the description of the nonlinear system whereas reduced representations can be found. The method yields highly structured state-space models where…

Deep Convolutional Networks in System Identification

Carl Andersson, Antônio H. Ribeiro, Koen Tiels +2 more

eess.SY · · arXiv ↗ · more like this ·

Recent developments within deep learning are relevant for nonlinear system identification problems. In this paper, we establish connections between the deep learning and the system identification communities. It has recently been shown that convolutional architectures are at least as capable as recurrent architectures when it comes to sequence modeling tasks. Inspired by these results we explore the explicit relationships between the recently proposed temporal convolutional network (TCN) and two classic system identification model structures; Volterra series and block-oriented models. We end the paper with an experimental study where we provide results on two real-world problems, the well-known Silverbox dataset and a newer dataset originating from ground vibration experiments on an F-16 fighter aircraft.

Beyond exploding and vanishing gradients: analysing RNN training using attractors and smoothness

Antônio H. Ribeiro, Koen Tiels, Luis A. Aguirre +1 more

cs.LG · · arXiv ↗ · more like this ·

The exploding and vanishing gradient problem has been the major conceptual principle behind most architecture and training improvements in recurrent neural networks (RNNs) during the last decade. In this paper, we argue that this principle, while powerful, might need some refinement to explain recent developments. We refine the concept of exploding gradients by reformulating the problem in terms of the cost function smoothness, which gives insight into higher-order derivatives and the existence of regions with many close local minima. We also clarify the distinction between vanishing gradients and the need for the RNN to learn attractors to fully use its expressive power. Through the lens of these refinements, we shed new light on recent developments in the RNN field, namely stable RNN and unitary (or orthogonal) RNNs.

On the smoothness of nonlinear system identification

Antônio H. Ribeiro, Koen Tiels, Jack Umenberger +2 more

eess.SY · · arXiv ↗ · more like this ·

We shed new light on the \textit{smoothness} of optimization problems arising in prediction error parameter estimation of linear and nonlinear systems. We show that for regions of the parameter space where the model is not contractive, the Lipschitz constant and $β$-smoothness of the objective function might blow up exponentially with the simulation length, making it hard to numerically find minima within those regions or, even, to escape from them. In addition to providing theoretical understanding of this problem, this paper also proposes the use of multiple shooting as a viable solution. The proposed method minimizes the error between a prediction model and the observed values. Rather than running the prediction model over the entire dataset, multiple shooting splits the data into smaller subsets and runs the prediction model over each subset, making the simulation length a design…

A Local Polynomial Approach to Nonparametric Estimation of the Best Linear Approximation of Lithium-Ion Battery From Multiple Datasets

Rishi Relan, Koen Tiels, Jean-Marc Timmermans +1 more

eess.SY · · arXiv ↗ · more like this ·

Battery short-term electrical impedance behavior varies between linear, linear time-varying, or nonlinear at different operating conditions. Data-based electrical impedance modeling techniques often model the battery as a linear time-invariant system at all operating conditions. In addition, these techniques require extensive and time consuming experimentation. Often due to sensor failures during experiments, constraints in data acquisition hardware, varying operating conditions, and the slow dynamics of the battery, it is not always possible to acquire data in a single experiment. Hence, multiple experiments must be performed. In this letter, a local polynomial approach is proposed to estimate nonparametrically the best linear approximation of the electrical impedance affected by varying levels of nonlinear distortion, from a series of input current and output voltage data subrecords…