A learnable activation function based on orthogonal Legendre wavelets (Q6962152)

From MaRDI portal

!

This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:

scientific article; zbMATH DE number 8061215
Language Label Description Also known as
default for all languages
No label defined
    English
    A learnable activation function based on orthogonal Legendre wavelets
    scientific article; zbMATH DE number 8061215

      Statements

      A learnable activation function based on orthogonal Legendre wavelets (English)
      0 references
      0 references
      0 references
      9 July 2025
      0 references
      The paper proposes to use wavelet-like functions based on Legendre orthogonal polynomials as activation functions in neural networks for image classification. It is claimed that, using such an activation function with minor adjustments in the hidden layers, ResNet50 achieved an increase of \(+5.17\%\) in accuracy for CIFAR10 classification. Similarly, in CIFAR100 classification, the authors found that the use of such an activation function in Swin Transformers led to a \(+3.51\%\) boost in accuracy compared to some standard activation functions.
      0 references
      image classification
      0 references
      convolutional neural network
      0 references
      activation function
      0 references
      Legendre wavelets
      0 references

      Identifiers

      0 references
      0 references
      0 references
      0 references
      0 references