Intelligent systems II. Complete approximation by neural network operators

DOI10.1007/978-3-319-20505-2MaRDI QIDQ2352904zbMATH OpenOpenAlexFDO

Authors George A. Anastassiou

Publication date 6 July 2015

Published in Studies in Computational Intelligence (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/978-3-319-20505-2

zbMATH Keywords

approximation of functionsartificial neural networksCaputo fractional derivativesconvergencefuzzy neural network operatorsJackson-type inequalitiesneural network operatorsrates of convergence

Mathematics Subject Classification ID

Rate of convergence, degree of approximation (41A25) Asymptotic approximations, asymptotic expansions (steepest descent, etc.) (41A60) Research exposition (monographs, survey articles) pertaining to computer science (68-02) Learning and adaptive systems in artificial intelligence (68T05) Neural networks for/in biological studies, artificial life and related topics (92B20)

Review text

Approximation by means of artificial neural networks has been a central topic in the research work of the author. His earlier results have been gathered in the monograph [Intelligent systems. Approximation by artificial neural networks. Berlin: Springer (2011; Zbl 1243.68002)]. The present book is intended as a continuation of this monograph and contains mainly the research results of the author in recent years. To approximate functions, the author uses almost the same strategy. Inspired by the way Cardaliaguet-Euvrard operators have been defined (see the paper [\textit{P. Cardaliaguet} and \textit{G. Euvrard}, ``Approximation of a function and its derivative with a neural network, Neural Netw. 5, No. 2, 207--220 (1992; \url{doi:10.1016/S0893-6080(05)80020-6})]), the author introduces the ``normalized neural network operators. They are constructed by normalizing some special finite expansions of the involved function \(f(x)\) in terms of a specific basis function. The normalized network operator generates an output from the neural network that is interpreted as an approximation for the involved function \(f(x)\) and one evaluates the difference to \(f(x)\). Further, the aim is to investigate the convergence and prove additional inequalities in order to find convergence rates. If for instance bell-shaped or squashing functions are chosen as basis functions, then the ``normalized bell or ``normalized squashing neural network operators are generated. In the first two chapters of the book, results on convergence and rates of convergence in the univariate as well as in the multivariate case for approximations with normalized bell and normalized squashing-type neural network operators are shown. In the third chapter, new basis functions are constructed from the sigmoid respectively hyperbolic tangent functions. The corresponding operators are the quasi-interpolation sigmoidal and quasi-interpolation hyperbolic tangent neural network operators. Some Jackson-type inequalities involving the moduli of continuity of the right and left Caputo fractional derivatives of the function to be approximated are proved. In Chapter 4 the network operators are constructed directly from the Cardaliaguet-Euvrard operators with bell-shaped functions as well as squashing functions as basis. The error evaluation involves the right and left Caputo fractional derivatives. In Chapter 5 the network operators are again the quasi-interpolation sigmoidal and quasi-interpolation hyperbolic tangent neural network operators. For the univariate case, fractional Voronovskaya-type asymptotic expansions for the error of approximation are proved. Multivariate Voronovskaya-type asymptotic expansions are discussed in Chapter 6. In Chapter 7 one focuses again on normalized bell and squashing-type operators. While evaluating the approximation error, bounds involving the moduli of continuity of the right and left Caputo fractional derivatives of the function to be approximated are obtained. In Chapter 8, for normalized bell and squashing-type neural network operators, Voronovskaya-type asymptotic expansions for the error of approximation of these operators to the unit operator are proved. The multivariate case is the subject of Chapter 9. Chapters 10 to 15 are devoted to the investigation of approximations by means of fuzzy-random normalized neural network operators. In Chapter 10 multivariate fuzzy-random normalized neural network operators of Cardaliaguet-Euvrard and squashing type are considered. The convergence rates are given from the multivariate probabilistic Jackson-type inequalities and involve multivariate fuzzy-random modulus of continuity of the function to be approximated and its fuzzy partial derivatives. In Chapter 11, univariate fuzzy normalized bell and squashing-type operators are considered. The associate fuzzy Jackson-type inequalities involve the fuzzy moduli of continuity of the right and left fuzzy Caputo fractional derivatives of the function to be approximated. In Chapter 12 rates of convergence for approximations with univariate quasi-interpolation sigmoidal and hyperbolic tangent fuzzy neural network operators are investigated. In Chapter 13 multivariate fuzzy approximations by means of fuzzy normalized bell and squashing-type neural network operators are studied. Chapter 14 is devoted to higher-order multivariate fuzzy approximation using quasi-interpolation neural network operators, and Chapter 15 is devoted to the study of multivariate pointwise and uniform convergence in the q-mean of the multivariate fuzzy-random quasi-interpolation neural network operators to the fuzzy-random unit operator. In Chapter 16 multivariate approximations with the Kantorovich-type neural network operators are considered. In Chapter 17 the basis function is constructed from the error function erf. Real and complex-valued functions are then approximated by means of quasi-interpolation, Baskakov-type and quadrature-type neural network operators. Fractional neural network approximations are considered as well. The extension of these results to the multivariate case is done in Chapter 18. Voronovskaya-type asymptotic expansions for the approximation with error-function-based quasi-interpolation neural networks are presented in Chapter 19. Chapters 20 and 21 contain extensions of the results presented in Chapters 17 and 18 to approximations by quasi-interpolation error-function-based fuzzy neural network operators, in the univariate as well as the multivariate case. In Chapter 22 multivariate fuzzy-random error-function-relied neural network approximations are presented. Finally, Chapters 23 to 28 are dedicated to approximations with perturbed neural networks. In a perturbed neural network, the usual sample coefficients \(f(k/n)\) are replaced by perturbed and weighted coefficients. This way, all types of neural network operators that have been presented before, generate new types of network operators, the so-called perturbed normalized neural network operators, fuzzy perturbed normalized neural network operators or perturbed normalized fuzzy-random neural network operators. Convergence, rates of convergence, Jackson-type inequalities, Voronovskaya-type asymptotic expansions are topics of the investigation of approximations with perturbed neural network operators, in this part of the book. To each chapter references are added. Mostly, the author's published papers are referred to, and the paper by Cardaliaguet and Euvrard [loc. cit.] which seems to have priority in defining the special types of neural network operators that have been so extensively studied in this monograph. The formal presentation by Springer is excellent.

Recommendations

• Intelligent systems. Approximation by artificial neural networks
• Frontiers in approximation theory
• Approximation by neural networks with sigmoidal functions
• scientific article; zbMATH DE number 2010598
• Neural networks for optimal approximation of continuous functions in \(\mathbb R^d\)

Cited in

(35)

• Quantitative estimates for neural network operators implied by the asymptotic behaviour of the sigmoidal activation functions
• Richards's curve induced Banach space valued ordinary and fractional neural network approximation
• Richards's curve induced Banach space valued multivariate neural network approximation
• Fuzzy fractional neural network approximation by fuzzy quasi-interpolation operators
• A kind of neural network operator and the estimates of approximation order
• Quantitative self adjoint operator direct approximations
• DENSITY RESULTS BY DEEP NEURAL NETWORK OPERATORS WITH INTEGER WEIGHTS
• Error estimation for approximate solutions of delay Volterra integral equations
• scientific article; zbMATH DE number 7104379 (Why is no real title available?)
• Frontiers in approximation theory
• Intelligent systems. Approximation by artificial neural networks
• Fuzzy fractional approximations by fuzzy normalized bell and squashing type neural network operators
• \(q\)-deformed hyperbolic tangent based Banach space valued ordinary and fractional neural network approximations
• MULTIVARIATE FUZZY APPROXIMATION BY NEURAL NETWORK OPERATORS ACTIVATED BY A GENERAL SIGMOID FUNCTION
• Quantitative approximation by multiple sigmoids Kantorovich-Shilkret quasi-interpolation neural network operators
• Brownian motion approximation by parametrized and deformed neural networks
• Hyperbolic tangent like relied Banach space valued neural network multivariate approximations
• Fuzzy fractional more sigmoid function activated neural network approximations revisited
• Parametrized, Deformed and General Neural Networks
• Abstract Voronovskaya type asymptotic expansions for general sigmoid functions based quasi-interpolation neural network operators
• Multiple general sigmoids based Banach space valued neural network multivariate approximation
• Fractional type multivariate neural network operators
• Banach Space Valued Neural Network
• Fuzzy neural network interpolation operators on fuzzy number valued functions endowed with weak types of continuity
• Multivariate symmetrized and perturbed A-generalized logistic complex valued trigonometric and hyperbolic neural network accelerated approximation
• Generalized logistic neural network approximation over finite dimension Banach spaces
• Neural network approximation over finite dimensional Banach spaces
• q-deformed and -parametrized A-generalized logistic function induced Banach space valued multivariate multi layer neural network approximations
• q-deformed and -parametrized A-generalized logistic function based Banach space valued ordinary and fractional neural network approximation
• Brownian motion approximation by neural networks
• Implementation of neural network operators with applications to remote sensing data
• Multivariate symmetrized, q-deformed and -parametrized hyperbolic tangent induced complex valued trigonometric and hyperbolic neural network enhanced approximation
• Fractional approximation of time separating stochastic processes by neural networks of compact support
• Multivariate case of composition of activation functions and the reduction to finite domain
• Symmetrized perturbed hyperbolic tangent ordinary and generalized fractional neural network

This page was built for publication: Intelligent systems II. Complete approximation by neural network operators

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2352904)