A hypergeometric function transform and matrix-valued orthogonal polynomials (Q378146)

The authors study an unbounded second-order differential operator \(T\) on a weighted Hilbert space \(H\). It is shown that the operator \(T\) is closely related to the second-order differential operator whose eigenfunctions are Jacobi polynomials. The authors describe some properties of the operator \(T\). In particular, they:{\parindent=7mm \begin{itemize} \item[(1)] prove that \(T\) satisfies a five-term recurrence relation with respect to the orthonormal Jacobi polynomials basis;\item [(2)] show that \(T\) has a unique self-adjoint extension on \(H\);\item [(3)] describe the spectrum of \(T\). \end{itemize}} The spectrum of \(T\) helps the authors to define an integral transform \(F\) which satisfies conditions of a theorem proved in [\textit{W. Groenevelt} et al., Adv. Math. 244, 91--105 (2013; Zbl 1286.42035)] and thus allows to determine the orthogonality relation for matrix-valued polynomials.