Inversion formula for the hypergeometric Fourier transform associated with a root system of type \(BC\) (Q6199849)

The article continues a series of studies on harmonic analysis associated with root systems conducted by Harish-Chandra, Gindikin-Karpelevich, Helgason, Gangolli, Rosenberg, Flensted-Jensen, Koornwinder, Heckman, Opdam and others. The authors study the case of the root system of type \(BC\) and arbitrary rank when the multiplicity function is not necessarily non-negative. For the root system of type \(BC_r\) with \(r\geq 2\), there are three multiplicity parameters \({k}_s\), \({k}_m\) and \({k}_l\) corresponding to the short, medium, and long roots, respectively. The authors prove the inversion formula, the Paley-Wiener theorem, and the Plancherel theorem for the hypergeometric Fourier transform under the conditions \({k}_s, {k}_m, {k}_l\in \mathbb{R}\), \({k}_s+{k}_l>-1/2\) and \({k}_m\geq 0\). These conditions on \({k}\) make the spectral problem well-posed and cover the known group cases. An explicit expression of the Plancherel measure is obtained by calculus of residues of \({c}(\lambda,{k})^{-1}{c}(-\lambda,{k})^{-1}\), where \({c}(\lambda,{k})\) is Harish-Chandra's \({c}\)-function. In particular, the square integrable hypergeometric functions are classified and their \(L^2\)-norms are calculated explicitly.