Dimension of the space of intertwining operators from degenerate principal series representations (Q1783986): Difference between revisions

If \(G\) is a real reductive algebraic Lie group, and \(H\) is an algebraic subgroup of \(G\), then a homogeneous space \(G/H\) is said to be real spherical if a minimal parabolic subgroup \(P\) of \(G\) has an open orbit in \(G/H\). If \(\widehat G_{\text{smooth}}\) and \(\widehat H_f\) denote the sets of equivalence classes of irreducible smooth admissible Fréchet representations of \(G\) with moderate growth, and of algebraic irreducible finite-dimensional representations of \(H\), respectively, then \(C^\infty(G/H,\tau)\) is the Fréchet space of smooth sections of the \(G\)-homogeneous vector bundle over \(G/H\) associated to \(\tau\in\widehat H_f\). If \(Q\) is a general parabolic subgroup of \(G\), then \(\pi\in\widehat G_{\text{smooth}}\) is said to belong to \(Q\)-series if \(\pi\) occurs as a subquotient of the degenerate principal series representation \(C^\infty(G/Q,\tau)\) for some \(\tau\in\widehat Q_f\). In [Adv. Math. 248, 921--944 (2013; Zbl 1317.22010)], \textit{T. Kobayashi} and \textit{T. Oshima} established the criterion of finite multiplicity for regular representations on \(G/H\) and they showed that the following two conditions on the pair \((G,H)\) are equivalent: (i)\, \(\dim\text{Hom}_G(\pi,C^\infty(G/H,\tau))<\infty\) for all \((\pi,\tau)\in\widehat G_{\text{smooth}}\times\widehat H_f\), (ii)\, \(G/H\) is real spherical. It is known that \(G/H\) is real spherical if and only if the number of \(H\)-orbits on \(G/P\) is finite. In this paper, the author proves that if \(Q\) is a maximal parabolic subgroup of \(G=SL(2n,\mathbb R)\) such that \(G/Q\) is isomorphic to the real projective space \(\mathbb{RP}^{2n-1}\), then if \(n\geq 2\), there exists an algebraic subgroup \(H\) of \(G\) satisfying the following two conditions: (i)\, \(\#(H\backslash G/Q)<\infty\), (ii)\, \(\dim\text{Hom}_G(C^\infty(G/Q,\chi),C^\infty(G/H))=\infty\) for some class-one character \(\chi\) of \(Q\). Furthermore, if \(n\geq 3\), \(H\) satisfies \(\dim\text{Hom}_G(C^\infty(G/Q,\chi),C^\infty(G/H))=\infty\).