A new perspective on the two-dimensional fractional Fourier transform and its relationship with the Wigner distribution (Q666647)

The main result, Theorem 1, states that the two-dimensional Wigner distribution of a bi-angular version of the fractional Fourier transform of a bivariate function corresponds to a suitably related rotation of the Wigner distribution of the function. Let \(F_{\alpha,\beta}\) denote the bivariate fractional Fourier transform and let \(A_{\gamma\delta} \) denote the tensor product \(R_\gamma \otimes R_\delta\) of rotations \(R_\theta =\left[\begin{array}{cc} \cos\theta & -\sin\theta \\ \sin\theta& \cos\theta\end{array}\right] \). Then Theorem 1 states that \[ W_{F_{\alpha,\beta}}= A_{\gamma\delta} W_F, \] where \(\gamma=(\alpha+\beta)/2\) and \(\delta=(\alpha-\beta)/2\). Here \(W\) denotes the Wigner distribution of two-variable function \(f(x,y)\in L^2(\mathbb{R}^2)\), \[ W_f(u_1,u_2;v_1,v_2)=\int_{\mathbb{R}^2} f(u_1+\frac{x}{2},u_2+\frac{y}{2})\, \overline{f}(u_1-\frac{x}{2},u_2-\frac{y}{2}) e^{i(x,y)\cdot (v_1,v_2)}\, dx\, dy\, . \] The standard fractional Fourier transform \(\mathcal{F}_\theta\) of a function of a single variable can be defined via the relation \(\mathcal{F}_\theta h_n=e^{i n\theta} h_n\) on the Hermite basis function \(h_n\). This recovers the Fourier transform when \(\theta=\pi/2\). The bi-angular fractional Fourier transform (on \(L^2(\mathbb{R}^2)\)) is defined by the integral formula \[F_{\alpha,\beta}(u,v)=\int_{\mathbb{R}^2} k_{\alpha,\beta}(u,v,x,y)\, dx\, dy;\quad k_{\alpha,\beta}(u,v,x,y)=\] \[\frac{ e^{-i\gamma}}{2\pi \sin\gamma} \exp\left(-\frac{i\cot\gamma}{2}(x^2+y^2+u^2+v^2)+\frac{i\cos\delta}{\sin\gamma}(ux+vy)+i\frac{\sin\delta}{\sin\gamma}(vx-uy)\right)\, . \] It is shown to reduce to the usual fractional Fourier transform, when \(\alpha=\beta\). The integral kernel is derived from a generating relationship for values \(H_{m,n}(z,\overline{z})\) of complex Hermite polynomials \(H_{m,n}(z,w)=\sum_{k=0}^{\min(m,n)} (-1)^k k!\binom{n}{k}\binom{m}{k} z^{m-k}w^{n-k}\) of two variables, studied recently by \textit{M. E. H. Ismail} [Trans. Am. Math. Soc. 368, No. 2, 1189--1210 (2016; Zbl 1339.33015)], taking the angles \(s=e^{i\alpha}\) and \(t=e^{i\beta}\) as values of the complex parameters \(s,t\) that arise in the generating relation. An inversion formula is derived for the bi-angular fractional Fourier transform. A reproducing kernel formula for the subspace of \(L^2(\mathbb{R}^2)\) of functions whose fractional Fourier transforms are supported in a rectangle is also derived.