Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems With Time Delays Based on Heuristic Dynamic Programming
In this paper, a novel heuristic dynamic programming (HDP) iteration algorithm is proposed to solve the optimal tracking control problem for a class of nonlinear discrete-time systems with time delays. The novel algorithm contains state updating, ...
Hierarchical Approximate Policy Iteration With Binary-Tree State Space Decomposition
In recent years, approximate policy iteration (API) has attracted increasing attention in reinforcement learning (RL), e.g., least-squares policy iteration (LSPI) and its kernelized version, the kernel-based LSPI algorithm. However, it remains difficult ...
Unified Development of Multiplicative Algorithms for Linear and Quadratic Nonnegative Matrix Factorization
Multiplicative updates have been widely used in approximative nonnegative matrix factorization (NMF) optimization because they are convenient to deploy. Their convergence proof is usually based on the minimization of an auxiliary upper-bounding function,...
A One-Layer Recurrent Neural Network for Pseudoconvex Optimization Subject to Linear Equality Constraints
In this paper, a one-layer recurrent neural network is presented for solving pseudoconvex optimization problems subject to linear equality constraints. The global convergence of the neural network can be guaranteed even though the objective function is ...
Incremental Learning From Stream Data
Recent years have witnessed an incredibly increasing interest in the topic of incremental learning. Unlike conventional machine learning situations, data flow targeted by incremental learning becomes available continuously over time. Accordingly, it is ...
Silicon Modeling of the Mihalaş–Niebur Neuron
There are a number of spiking and bursting neuron models with varying levels of complexity, ranging from the simple integrate-and-fire model to the more complex Hodgkin–Huxley model. The simpler models tend to be easily implemented in silicon but yet ...
SaFIN: A Self-Adaptive Fuzzy Inference Network
There are generally two approaches to the design of a neural fuzzy system: 1) design by human experts, and 2) design through a self-organization of the numerical training data. While the former approach is highly subjective, the latter is commonly ...
Nonlinear System Identification by Gustafson–Kessel Fuzzy Clustering and Supervised Local Model Network Learning for the Drug Absorption Spectra Process
This paper deals with the problem of fuzzy nonlinear model identification in the framework of a local model network (LMN). A new iterative identification approach is proposed, where supervised and unsupervised learning are combined to optimize the ...
Modeling Activity-Dependent Plasticity in BCM Spiking Neural Networks With Application to Human Behavior Recognition
Spiking neural networks (SNNs) are considered to be computationally more powerful than conventional NNs. However, the capability of SNNs in solving complex real-world problems remains to be demonstrated. In this paper, we propose a substantial extension ...
Fast Independent Component Analysis Algorithm for Quaternion Valued Signals
An extension of the fast independent component analysis algorithm is proposed for the blind separation of both ${\BBQ}$-proper and ${\BBQ}$-improper quaternion-valued signals. This is achieved by maximizing a negentropy-based cost function, and is ...
Synchronization of Continuous Dynamical Networks With Discrete-Time Communications
In this paper, synchronization of continuous dynamical networks with discrete-time communications is studied. Though the dynamical behavior of each node is continuous-time, the communications between every two different nodes are discrete-time, i.e., ...
Quantitative Analysis of Nonlinear Embedding
A lot of nonlinear embedding techniques have been developed to recover the intrinsic low-dimensional manifolds embedded in the high-dimensional space. However, the quantitative evaluation criteria are less studied in literature. The embedding quality is ...
Exponential Synchronization of Complex Networks With Finite Distributed Delays Coupling
In this paper, the exponential synchronization for a class of complex networks with finite distributed delays coupling is studied via periodically intermittent control. Some novel and useful criteria are derived by utilizing a different technique ...
Bayesian Multitask Classification With Gaussian Process Priors
We present a novel approach to multitask learning in classification problems based on Gaussian process (GP) classification. The method extends previous work on multitask GP regression, constraining the overall covariance (across tasks and data points) ...
Data Mining Based Full Ceramic Bearing Fault Diagnostic System Using AE Sensors
Full ceramic bearings are considered the first step toward full ceramic, oil-free engines in the future. No research on full ceramic bearing fault diagnostics using acoustic emission (AE) sensors has been reported. Unlike their steel counterparts, ...
Mobility Timing for Agent Communities, a Cue for Advanced Connectionist Systems
We introduce a wait-and-chase scheme that models the contact times between moving agents within a connectionist construct. The idea that elementary processors move within a network to get a proper position is borne out both by biological neurons in the ...
Classifiability-Based Discriminatory Projection Pursuit
Fisher's linear discriminant (FLD) is one of the most widely used linear feature extraction method, especially in many visual computation tasks. Based on the analysis on several limitations of the traditional FLD, this paper attempts to propose a new ...
Bioinspired Neural Network for Real-Time Cooperative Hunting by Multirobots in Unknown Environments
Multiple robot cooperation is a challenging and critical issue in robotics. To conduct the cooperative hunting by multirobots in unknown and dynamic environments, the robots not only need to take into account basic problems (such as searching, path ...
Auto-Regressive Processes Explained by Self-Organized Maps. Application to the Detection of Abnormal Behavior in Industrial Processes
This paper analyzes the expected time evolution of an auto-regressive (AR) process using self-organized maps (SOM). It investigates how a SOM captures the time information given by the AR input process and how the transitions from one neuron to another ...
Parallel Programmable Asynchronous Neighborhood Mechanism for Kohonen SOM Implemented in CMOS Technology
We present a new programmable neighborhood mechanism for hardware implemented Kohonen self-organizing maps (SOMs) with three different map topologies realized on a single chip. The proposed circuit comes as a fully parallel and asynchronous ...
Passivity and Stability Analysis of Reaction-Diffusion Neural Networks With Dirichlet Boundary Conditions
This paper is concerned with the passivity and stability problems of reaction-diffusion neural networks (RDNNs) in which the input and output variables are varied with the time and space variables. By utilizing the Lyapunov functional method combined ...
Symmetric Nonnegative Matrix Factorization: Algorithms and Applications to Probabilistic Clustering
Nonnegative matrix factorization (NMF) is an unsupervised learning method useful in various applications including image processing and semantic analysis of documents. This paper focuses on symmetric NMF (SNMF), which is a special case of NMF ...
Riemannian-Gradient-Based Learning on the Complex Matrix-Hypersphere
This brief tackles the problem of learning over the complex-valued matrix-hypersphere ${\BBS}_{n,p}^{\alpha}({\BBC})$. The developed learning theory is formulated in terms of Riemannian-gradient-based optimization of a regular criterion function and is ...
Delay-Slope-Dependent Stability Results of Recurrent Neural Networks
By using the fact that the neuron activation functions are sector bounded and nondecreasing, this brief presents a new method, named the delay-slope-dependent method, for stability analysis of a class of recurrent neural networks with time-varying ...
Real-Time Vector Quantization and Clustering Based on Ordinary Differential Equations
This brief presents a dynamical system approach to vector quantization or clustering based on ordinary differential equations with the potential for real-time implementation. Two examples of different pattern clusters demonstrate that the model can ...