On the degenerate principal series of complex symplectic groups (Q418719)

Among the representations of reductive Lie groups, the so-called small representations have received a lot of attention for several years. More recently, new techniques were introduced in this area by J.-L.~Clerc, T.~Kobayashi, B.~Ørsted and M.~Pevzner in relation to various problems in classical analysis and representation theory. It is observed that some Knapp-Stein operators can be realized as Fourier transforms once normalized. Another feature of their work is the construction of what is called the non-standard model for degenerate principal series. The present article aims at adapting those techniques to the case of the complex symplectic group. Among the parabolically induced representations of Sp\((n,\mathbb C)\), those coming from maximal parabolic subgroups may be considered as the most degenerated ones, since functions on the corresponding flag manifold depend on the smal\-lest possible set of parameters. The author provides a self-contained and detailed presentation of these techniques while adapting them to the complex case. Moreover, the isotypic decomposition of the quaternionic orthogonal group action on square-integrable functions over the unit sphere turns out to be slightly more delicate than the real and complex ones. The author introduces certain Fourier transforms, establishes some of their elementary properties and uses them to normalise Knapp-Stein operators. The branching law of the degenerate principal series representations of Sp\((n,\mathbb C)\) with respect to the maximal compact subgroup \(K=\)Sp\((n)\) is studied, \(K\)-types are described, and the eigenvalues of Knapp-Stein operators are computed. As a result, the author ana\-ly\-ses the reducible elements in the degenerate principal series in terms of \(K\)-types and of eigenspaces of the Knapp-Stein intertwiners. Finally, the proof that the normalized Knapp-Stein operators take an algebraic form once expressed in the non-standard model is given. Geometric transforms and the computation of their \(K\)-spectrum are a current object of interest.