arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Honggui Han

107 papers · 2003–2026

2003: 12004: 02005: 02006: 02007: 12008: 22009: 12010: 32011: 12012: 12013: 42014: 22015: 12016: 52017: 52018: 32019: 12020: 22021: 82022: 122023: 162024: 212025: 122026: 5
2003peak 21 in 20242026

Frequent co-authors

Papers

showing 1–25 of 107 RSS

Growing Echo-State Network With Multiple Subreservoirs

Junfei Qiao, Fanjun Li, Honggui Han +1 more

Artificial Intelligence · IEEE Transactions on Neural Networks and Learning Systems · · cited 194× · DOI ↗ · more like this ·

An echo-state network (ESN) is an effective alternative to gradient methods for training recurrent neural network. However, it is difficult to determine the structure (mainly the reservoir) of the ESN to match with the given application. In this paper, a growing ESN (GESN) is proposed to design the size and topology of the reservoir automatically. First, the GESN makes use of the block matrix theory to add hidden units to the existing reservoir group by group, which leads to a GESN with multiple subreservoirs. Second, every subreservoir weight matrix in the GESN is created with a predefined singular value spectrum, which ensures the echo-sate property of the ESN without posterior scaling of the weights. Third, during the growth of the network, the output weights of the GESN are updated in an incremental way. Moreover, the convergence of the GESN is proved. Finally, the GESN is tested on…

A Self-Organizing Fuzzy Neural Network Based on a Growing-and-Pruning Algorithm

Honggui Han, Junfei Qiao

Artificial Intelligence · IEEE Transactions on Fuzzy Systems · · cited 173× · DOI ↗ · more like this ·

A novel growing-and-pruning (GP) approach is proposed, which optimizes the structure of a fuzzy neural network (FNN). This GP-FNN is based on radial basis function neurons, which have center and width vectors. The structure-learning phase and the parameter-training phase are performed concurrently. The structure-learning approach relies on the sensitivity analysis of the output. A set of fuzzy rules can be inserted or reduced during the learning process. The parameter-training algorithm is implemented using a supervised gradient decent method. The convergence of the GP-FNN-learning process is also discussed in this paper. The proposed method effectively generates a fuzzy neural model with a highly accurate and compact structure. Simulation results demonstrate that the proposed GP-FNN has a self-organizing ability, which can determine the structure and parameters of the FNN…

An Adaptive-PSO-Based Self-Organizing RBF Neural Network

Honggui Han, Wei Lü, Ying Hou +1 more

Artificial Intelligence · IEEE Transactions on Neural Networks and Learning Systems · · cited 146× · DOI ↗ · more like this ·

In this paper, a self-organizing radial basis function (SORBF) neural network is designed to improve both accuracy and parsimony with the aid of adaptive particle swarm optimization (APSO). In the proposed APSO algorithm, to avoid being trapped into local optimal values, a nonlinear regressive function is developed to adjust the inertia weight. Furthermore, the APSO algorithm can optimize both the network size and the parameters of an RBF neural network simultaneously. As a result, the proposed APSO-SORBF neural network can effectively generate a network model with a compact structure and high accuracy. Moreover, the analysis of convergence is given to guarantee the successful application of the APSO-SORBF neural network. Finally, multiple numerical examples are presented to illustrate the effectiveness of the proposed APSO-SORBF neural network. The results demonstrate that the proposed…

Adaptive Gradient Multiobjective Particle Swarm Optimization

Honggui Han, Wei Lü, Lu Zhang +1 more

Computational Theory and Mathematics · IEEE Transactions on Cybernetics · · cited 114× · DOI ↗ · more like this ·

An adaptive gradient multiobjective particle swarm optimization (AGMOPSO) algorithm, based on a multiobjective gradient (stocktickerMOG) method and a self-adaptive flight parameters mechanism, is developed to improve the computation performance in this paper. In this AGMOPSO algorithm, the stocktickerMOG method is devised to update the archive to improve the convergence speed and the local exploitation in the evolutionary process. Meanwhile, the self-adaptive flight parameters mechanism, according to the diversity information of the particles, is then established to balance the convergence and diversity of AGMOPSO. Attributed to the stocktickerMOG method and the self-adaptive flight parameters mechanism, this AGMOPSO algorithm not only has faster convergence speed and higher accuracy, but also its solutions have better diversity. Additionally, the convergence is discussed to confirm the…

An Adaptive Multiobjective Particle Swarm Optimization Based on Multiple Adaptive Methods

Honggui Han, Wei Lü, Junfei Qiao

Computational Theory and Mathematics · IEEE Transactions on Cybernetics · · cited 111× · DOI ↗ · more like this ·

Multiobjective particle swarm optimization (MOPSO) algorithms have attracted much attention for their promising performance in solving multiobjective optimization problems (MOPs). In this paper, an adaptive MOPSO (AMOPSO) algorithm, based on a hybrid framework of the solution distribution entropy and population spacing (SP) information, is developed to improve the search performance in terms of convergent speed and precision. First, an adaptive global best (gBest) selection mechanism, based on the solution distribution entropy, is introduced to analyze the evolutionary tendency and balance the diversity and convergence of nondominated solutions in the archive. Second, an adaptive flight parameter adjustment mechanism, using the population SP information, is proposed to obtain the distribution of particles with suitable diversity and convergence, which can balance the global exploration…

Nonlinear Systems Modeling Based on Self-Organizing Fuzzy-Neural-Network With Adaptive Computation Algorithm

Honggui Han, Xiaolong Wu, Junfei Qiao

Artificial Intelligence · IEEE Transactions on Cybernetics · · cited 97× · DOI ↗ · more like this ·

In this paper, a self-organizing fuzzy-neural-network with adaptive computation algorithm (SOFNN-ACA) is proposed for modeling a class of nonlinear systems. This SOFNN-ACA is constructed online via simultaneous structure and parameter learning processes. In structure learning, a set of fuzzy rules can be self-designed using an information-theoretic methodology. The fuzzy rules with high spiking intensities (SI) are divided into new ones. And the fuzzy rules with a small relative mutual information (RMI) value will be pruned in order to simplify the FNN structure. In parameter learning, the consequent part parameters are learned through the use of an ACA that incorporates an adaptive learning rate strategy into the learning process to accelerate the convergence speed. Then, the convergence of SOFNN-ACA is analyzed. Finally, the proposed SOFNN-ACA is used to model nonlinear systems. The…

Self-Organizing RBF Neural Network Using an Adaptive Gradient Multiobjective Particle Swarm Optimization

Honggui Han, Xiaolong Wu, Lu Zhang +2 more

Artificial Intelligence · IEEE Transactions on Cybernetics · · cited 83× · DOI ↗ · more like this ·

One of the major obstacles in using radial basis function (RBF) neural networks is the convergence toward local minima instead of the global minima. For this reason, an adaptive gradient multiobjective particle swarm optimization (AGMOPSO) algorithm is designed to optimize both the structure and parameters of RBF neural networks in this paper. First, the AGMOPSO algorithm, based on a multiobjective gradient method and a self-adaptive flight parameters mechanism, is developed to improve the computation performance. Second, the AGMOPSO-based self-organizing RBF neural network (AGMOPSO-SORBF) can optimize the parameters (centers, widths, and weights), as well as determine the network size. The goal of AGMOPSO-SORBF is to find a tradeoff between the accuracy and the complexity of RBF neural networks. Third, the convergence analysis of AGMOPSO-SORBF is detailed to ensure the prerequisite of…

Self-Adjusting Multitask Particle Swarm Optimization

Honggui Han, Xing Bai, Huayun Han +2 more

Artificial Intelligence · IEEE Transactions on Evolutionary Computation · · cited 58× · DOI ↗ · more like this ·

Particle swarm optimization algorithm has become a promising approach in solving multitask optimization (MTO) problems since it can transfer knowledge with easy implementation and high searching efficiency. However, in the process of knowledge transfer, negative transfer is common because it is difficult to evaluate whether knowledge is effective for population evolution. Therefore, how to obtain and transfer the effective knowledge to curb the negative transfer is a challenging problem in MTO. To deal with this problem, a self-adjusting multitask particle swarm optimization (SA-MTPSO) algorithm is designed to improve the convergence performance in this article. First, a knowledge estimation metric, combining the decision space knowledge and the target space knowledge for each task, is designed to describe the effectiveness of knowledge. Then, the effective knowledge is obtained to…

Data-Knowledge-Based Fuzzy Neural Network for Nonlinear System Identification

Xiaolong Wu, Honggui Han, Zheng Liu +1 more

Artificial Intelligence · IEEE Transactions on Fuzzy Systems · · cited 57× · DOI ↗ · more like this ·

Many nonlinear dynamical systems are usually lack of abundant datasets since the data acquiring process is time consuming. It is difficult to utilize the incomplete datasets to build an effective data-driven model to improve the industry productivity. To overcome this problem, a data-knowledge-based fuzzy neural network (DK-FNN) was developed in this article. Compared with the existing methods, the proposed DK-FNN consists of the following obvious advantages. First, through the multilayered connectionist structure, this proposed DK-FNN could not only make full use of the data from the current scene, but also use the existing knowledge from the source scene to improve the learning performance. Second, an integrated-form transfer learning (ITL) method was developed to improve the learning performance of DK-FNN. This first reported ITL method was able to integrate the internal information…

An Efficient Second-Order Algorithm for Self-Organizing Fuzzy Neural Networks

Honggui Han, Lu Zhang, Xiaolong Wu +1 more

Artificial Intelligence · IEEE Transactions on Cybernetics · · cited 54× · DOI ↗ · more like this ·

Intelligent computing technologies are useful and important for online data modeling, where system dynamics may be nonstationary with some uncertainties. In this paper, an efficient learning mechanism is developed for building self-organizing fuzzy neural networks (SOFNNs), where a second-order algorithm (SOA) with adaptive learning rate is employed, the network size and the parameters can be determined simultaneously in the learning process. First, all parameters of SOFNN are adjusted by using the SOA strategy to achieve fast convergence through a powerful search scheme. Second, the structure of SOFNN can be self-organized using the relative importance index of each rule. The fuzzy rules used in SOFNN with SOA (SOA-SOFNN) are generated or pruned automatically to reduce the computational complexity and potentially improve the generalization power. Finally, a theoretical analysis on the…

Type-2 Fuzzy Broad Learning System

Honggui Han, Zheng Liu, Hongxu Liu +2 more

Artificial Intelligence · IEEE Transactions on Cybernetics · · cited 51× · DOI ↗ · more like this ·

The broad learning system (BLS) has been identified as an important research topic in machine learning. However, the typical BLS suffers from poor robustness for uncertainties because of its characteristic of the deterministic representation. To overcome this problem, a type-2 fuzzy BLS (FBLS) is designed and analyzed in this article. First, a group of interval type-2 fuzzy neurons was used to replace the feature neurons of BLS. Then, the representation of BLS can be improved to obtain good robustness. Second, a fuzzy pseudoinverse learning algorithm was designed to adjust the parameter of type-2 FBLS. Then, the proposed type-2 FBLS was able to maintain the fast computational nature of BLS. Third, a theoretical analysis on the convergence of type-2 FBLS was given to show the computational efficiency. Finally, some benchmark and practical problems were used to test the merits of type-2…

Hierarchical Neural Network Modeling Approach to Predict Sludge Volume Index of Wastewater Treatment Process

Honggui Han, Junfei Qiao

Artificial Intelligence · IEEE Transactions on Control Systems Technology · · cited 47× · DOI ↗ · more like this ·

From a practical-theoretic viewpoint, there is a need to develop rigorous design and analysis tools for the control, fault diagnosis, and security of wastewater quality. However, sludge bulking remains a widespread problem in the operation of activated sludge processes, which leads to severe economic and environmental consequences. Sludge volume index (SVI) monitoring is a key challenge that will become even more crucial in the years ahead to quantify sludge bulking. This brief presents a system that consists of online sensors and an SVI predicting plant. The SVI predicting plant uses a hierarchical radial basis function (HRBF) neural network to predict SVI in a wastewater treatment process (WWTP). Then, an approach named extended extreme learning machine (EELM) is proposed for training the weights of HRBF. Unlike conventional single-hidden-layer feedforward networks, this EELM-HRBF is…

Security Control of Sampled-Data T–S Fuzzy Systems Subject to Cyberattacks and Successive Packet Losses

Haoyuan Sun, Honggui Han, Jian Sun +2 more

Computer Networks and Communications · IEEE Transactions on Fuzzy Systems · · cited 43× · DOI ↗ · more like this ·

This article investigates the security control problem of sampled-data Takagi–Sugeno (T–S) fuzzy systems subject to cyberattacks and successive packet losses. The cyberattack considered in this article is a stochastic deception attack. The packet losses under consideration occur in the sensor-to-controller and controller-to-actor channels, both of which are modeled as two independent Bernoulli processes. On this basis, a novel successive packet loss modeling method is proposed with some basic assumptions. By the exact discrete-time model approach, a discretized sampled-data T–S fuzzy model is first established by considering the probability characteristic of the deception attacks and successive packet losses in a unified framework. Based on the established mode, the sufficient conditions to guarantee the security degree are derived by the Lyapunov function approach. Furthermore, the…

Self-Organizing Interval Type-2 Fuzzy Neural Network Using Information Aggregation Method

Honggui Han, Chenxuan Sun, Xiaolong Wu +2 more

Artificial Intelligence · IEEE Transactions on Neural Networks and Learning Systems · · cited 39× · DOI ↗ · more like this ·

Interval type-2 fuzzy neural networks (IT2FNNs) usually stack adequate fuzzy rules to identify nonlinear systems with high-dimensional inputs, which may result in an explosion of fuzzy rules. To cope with this problem, a self-organizing IT2FNN, based on the information aggregation method (IA-SOIT2FNN), is developed to avoid the explosion of fuzzy rules in this article. First, a relation-aware strategy is proposed to construct rotatable type-2 fuzzy rules (RT2FRs). This strategy uses the individual RT2FR, instead of multiple standard fuzzy rules, to interpret interactive features of high-dimensional inputs. Second, a comprehensive information evaluation mechanism, associated with the interval information and rotation information of RT2FR, is developed to direct the structural adjustment of IA-SOIT2FNN. This mechanism can achieve a compact structure of IA-SOIT2FNN by growing and pruning…

A REPAIR ALGORITHM FOR RADIAL BASIS FUNCTION NEURAL NETWORK AND ITS APPLICATION TO CHEMICAL OXYGEN DEMAND MODELING

Junfei Qiao, Honggui Han

Artificial Intelligence · International Journal of Neural Systems · · cited 39× · DOI ↗ · more like this ·

This paper presents a repair algorithm for the design of a Radial Basis Function (RBF) neural network. The proposed repair RBF (RRBF) algorithm starts from a single prototype randomly initialized in the feature space. The algorithm has two main phases: an architecture learning phase and a parameter adjustment phase. The architecture learning phase uses a repair strategy based on a sensitivity analysis (SA) of the network's output to judge when and where hidden nodes should be added to the network. New nodes are added to repair the architecture when the prototype does not meet the requirements. The parameter adjustment phase uses an adjustment strategy where the capabilities of the network are improved by modifying all the weights. The algorithm is applied to two application areas: approximating a non-linear function, and modeling the key parameter, chemical oxygen demand (COD) used in…

Multistate-Constrained Multiobjective Differential Evolution Algorithm With Variable Neighborhood Strategy

Ying Hou, Yilin Wu, Honggui Han

Computational Theory and Mathematics · IEEE Transactions on Cybernetics · · cited 34× · DOI ↗ · more like this ·

Multiobjective differential evolution (DE) algorithm (MODE) has been widely used in multiobjective optimization problems. However, due to the complex feasible regions, the optimization efficiency of MODE may decrease when solving constrained multiobjective problems. It is challenging to promote the evolution of population with few feasible solutions. In this article, a multistate-constrained MODE with variable neighborhood strategy (MSCMODE-VNS) is proposed to enhance the optimization effectiveness with complex feasible regions. First, a variable neighborhood DE strategy, based on a specially designed convergence indicator, is designed to accelerate the generation of feasible solutions. Second, a multistate population updating strategy with a comprehensive solution evaluation mechanism is devised to update the population of the next generation to improve the performance of solutions.…

Training Fuzzy Neural Network via Multiobjective Optimization for Nonlinear Systems Identification

Honggui Han, Chenxuan Sun, Xiaolong Wu +2 more

Artificial Intelligence · IEEE Transactions on Fuzzy Systems · · cited 31× · DOI ↗ · more like this ·

The design of a fuzzy neural network (FNN) has long been a challenging problem since most methods rely on approximation error to train an FNN, which may easily result in overfitting phenomenon to degrade the generalization performance. To improve the generalization performance, an FNN with a multiobjective optimization algorithm (MOO-FNN) is proposed in this article. First, the multilevel learning objectives are designed around the generalization performance to guide the training process of an FNN. Then, the method utilizes the approximation error, the structure complexity, and the output smoothness indicators instead of a single indicator to improve the evaluation accuracy of generalization performance. Second, an MOO algorithm with continuous–discrete variables is developed to optimize the FNN. Then, MOO is able to use a novel particle update method to adjust both the structure and…

Fuzzy-Approximation Adaptive Fault Tolerant Control for Nonlinear Constraint Systems With Actuator and Sensor Faults

Dapeng Li, Honggui Han, Jun-Fei Qiao

Artificial Intelligence · IEEE Transactions on Fuzzy Systems · · cited 30× · DOI ↗ · more like this ·

The key focus in this paper is to develop an adaptive fuzzy function constraint control method for nonlinear systems with actuator and sensor faults. The effectiveness indicators of actuator and sensor are considered as the unknown functions with the bounded time-varying bias fault existing in actuator. Because system states are not applied to design controller, how to achieve constraints on the system states is a significant challenge. In order to cope with this challenge, the constraint target transformation is introduced to convert the constraints on real states to measurement variables. Then, the nonlinear statedependence mapping is used to ensure tracking error and system states remain within the given function constrain ranges. In contrast to the existing time-dependence constraint methods, this paper consider that the constraint boundaries are related not only time but also state…

Multitask Particle Swarm Optimization With Heterogeneous Domain Adaptation

Honggui Han, Xing Bai, Ying Hou +1 more

Artificial Intelligence · IEEE Transactions on Evolutionary Computation · · cited 29× · DOI ↗ · more like this ·

The main goal of multitask optimization (MTO) is the parallel optimization of multiple different tasks. However, since different tasks in the MTO problem usually have heterogeneous characteristics, it is difficult to realize the positive knowledge transfer among tasks, resulting in poor convergence. To cope with this problem, a multi-task particle swarm optimization with a heterogeneous domain adaptation strategy (MTPSO-HDA) is proposed to transfer positive knowledge among heterogeneous tasks. First, a nonlinear mapping between the source task and the target task is constructed based on the adaptive kernel function. Then, source tasks are mapped to the target task space to reduce the differences among heterogeneous tasks. Second, a multi-source domain adaptive strategy based on fitness landscape similarity is designed to implement domain adaptation. Then, the importance of each source…

Diversified Knowledge Transfer Strategy for Multitasking Particle Swarm Optimization

Xiaolong Wu, Wei Wang, Hongyan Yang +2 more

Artificial Intelligence · IEEE Transactions on Cybernetics · · cited 28× · DOI ↗ · more like this ·

Evolutionary multitasking optimization (EMTO) has capability of performing a population of individuals together by sharing their intrinsic knowledge. However, the existed methods of EMTO mainly focus on improving its convergence using parallelism knowledge belonging to different tasks. This fact may lead to the problem of local optimization in EMTO due to unexploited knowledge on behalf of the diversity. To address this problem, in this article, a diversified knowledge transfer strategy is proposed for multitasking particle swarm optimization algorithm (DKT-MTPSO). First, according to the state of population evolution, an adaptive task selection mechanism is introduced to manage the source tasks that contribute to the target tasks. Second, a diversified knowledge reasoning strategy is designed to capture the knowledge of convergence, as well as the knowledge associated with diversity.…

Self-organizing fuzzy control for dissolved oxygen concentration using fuzzy neural network1

Junfei Qiao, Wei Zhang, Honggui Han

Artificial Intelligence · Journal of Intelligent & Fuzzy Systems · · cited 28× · DOI ↗ · more like this ·

In order to improve the accuracy and adaptive ability of dissolved oxygen concentration control in the wastewater treatment process (WWTP), a self-organizing fuzzy control (SOFC) method is developed in this paper. The main feature of this control system is that the fuzzy controller can extract fuzz y rules automatically using a self-organizing fuzzy neural network (FNN), which can adjust the network structure during the process based on the growing-pruning-combining algorithm. Furthermore, to ensure the convergence of the system, a compensation controller is designed to dispel the FNN approximation error, and the parameter compensation is also considered while adjusting the network structure. Finally, simulation results, based on the international benchmark simulation model No.1 (BSM1), demonstrate that the proposed method can achieve better control performance and superior adaptive…

Consensus of MASs With Input and Communication Delays by Predictor-Based Protocol

Haoyuan Sun, Hongyan Yang, Honggui Han +2 more

Computer Networks and Communications · IEEE Transactions on Cybernetics · · cited 27× · DOI ↗ · more like this ·

In this article, the consensus problem of multiagent systems (MASs) affected by input and communication delays is investigated. A predictor-based state feedback protocol is used to reach the consensus of linear MASs by delay compensation. In order to analyze the maximum delay under the predictor-based protocol, the overall MASs are equivalent to the feedback interconnection system, including a linear time-invariant system and a time-delay operator, in view of the characteristic of the Laplacian matrix. Then, the maximum delay corresponding to the predictor-based protocol is evaluated by using the small gain theorem (SGT). Finally, two numerical examples are given to verify the effectiveness of the obtained consensus condition.

Robust Multiobjective Particle Swarm Optimization With Feedback Compensation Strategy

Honggui Han, Hao Zhou, Yanting Huang +1 more

Computational Theory and Mathematics · IEEE Transactions on Cybernetics · · cited 26× · DOI ↗ · more like this ·

Multiobjective particle swarm optimization (MOPSO) has been proven effective in solving multiobjective problems (MOPs), in which the evolutionary parameters and leaders are selected randomly to develop the diversity. However, the randomness would cause the evolutionary process uncertainty, which deteriorates the optimization performance. To address this issue, a robust MOPSO with feedback compensation (RMOPSO-FC) is proposed. RMOPSO-FC provides a novel closed-loop optimization framework to reduce the negative influence of uncertainty. First, Gaussian process (GP) models are established by dynamically updated archives to obtain the posterior distribution of particles. Then, the feedback information of particle evolution can be collected. Second, an intergenerational binary metric is designed based on the feedback information to evaluate the evolutionary potential of particles. Then, the…

Optimal Structure Design for RBFNN Structure

Junfei Qiao, Honggui Han

Computational Theory and Mathematics · ACTA AUTOMATICA SINICA · · cited 26× · DOI ↗ · more like this ·

摘要: 针对径向基函数(Radial basis function, RBF)神经网络的结构设计问题, 提出一种结构动态优化设计方法. 利用敏感度法(Sensitivity analysis, SA)分析隐含层神经元的输出加权值对神经网络输出的影响, 以此判断增加或删除RBF神经网络隐含层中的神经元, 解决了RBF神经网络结构过大或过小的问题, 并给出了神经网络结构动态变化过程中收敛性证明; 利用梯度下降的参数修正算法保证了最终RBF网络的精度, 实现了神经网络的结构和参数自校正. 通过对非线性函数的逼近与污水处理过程中关键参数的建模结果, 证明了该动态RBF具有良好的自适应能力和逼近能力, 尤其是在泛化能力、最终网络结构等方面较之最小资源神经网络(Minimal resource allocation networks, MRAN)与增长和修剪RBF 神经网络(Generalized growing and pruning radial basis function, GGAP-RBF) 有较大提高. 关键词: 径向基函数神经网络 / 动态设计 / 动态结构RBF / 化学需氧量建模

An Efficient Optimization Method for Improving Generalization Performance of Fuzzy Neural Networks

Honggui Han, Xiaolong Wu, Hongxu Liu +1 more

Artificial Intelligence · IEEE Transactions on Fuzzy Systems · · cited 25× · DOI ↗ · more like this ·

Fuzzy neural networks (FNNs), with suitable structures, have been demonstrated to be an effective tool in approximating nonlinearity between input and output variables. However, it is time-consuming to construct an FNN with appropriate number of fuzzy rules to ensure its generalization ability. To solve this problem, an efficient optimization technique is introduced in this paper. First, a self-adaptive structural optimal algorithm (SASOA) is developed to minimize the structural risk of an FNN, leading to an improved generalization performance. Second, with the proposed SASOA, the fuzzy rules of SASOA-based FNN (SASOA-FNN) are generated or pruned systematically. This SASOA-FNN is able to organize the structure and adjust the parameters simultaneously in the learning process. Third, the convergence of SASOA-FNN is proved in the cases with fixed and updated structures, and the guidelines…