Summary: There is a considerable evidence that our perception of sound uses important features which are related to underlying signal modulations. This topic has been studied extensively via perceptual experiments, yet there are few, if any, well-developed signal processing methods which capitalize on or model these effects. We begin by summarizing evidence of the importance of modulation representations from psychophysical, physiological, and other sources. The concept of a two-dimensional joint acoustic and modulation frequency representation is proposed. A simple single sinusoidal amplitude modulator of a sinusoidal carrier is then used to illustrate properties of an unconstrained and ideal joint representation. Added constraints are required to remove or reduce undesired interference terms and to provide invertibility. It is then noted that the constraints would be also applied to more general and complex cases of broader modulation and carriers. Applications in single-channel speaker separation and in audio coding are used to illustrate the applicability of this joint representation. Other applications in signal analysis and filtering are suggested.
- Probabilistic Amplitude Demodulation
- Neuromimetic sound representation for percept detection and manipulation
- An overcomplete signal basis approach to nonlinear time-tone analysis with application to audio and speech processing
- Graphic representation method and neural network recognition of time-frequency vectors of speech information
- Sparse Sinusoidal Signal Representation for Speech and Music Signals
- Stimulus-invariant processing and spectrotemporal reverse correlation in primary auditory cortex
- Neuromimetic sound representation for percept detection and manipulation
- Probabilistic Amplitude Demodulation
- An overcomplete signal basis approach to nonlinear time-tone analysis with application to audio and speech processing
This page was built for publication: Joint acoustic and modulation frequency
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1885121)
