Holomorphically induced representations of some solvable Lie groups (Q5955069)

The celebrated orbit method created by \textit{A. A. Kirillov} [Russ. Math. Surv. 17, 53-104 (1962; Zbl 0106.25001)] gave a unified treatment of monomial representations for connected nilpotent Lie groups and caused many subsequent works. In particular, \textit{L. Auslander} and \textit{B. Kostant} [Invent. Math. 14, 255-354 (1971; Zbl 0233.22005)] made an innovation by their theory of holomorphically induced representations. This theory permitted them to realize the unitary dual of connected, simply connected type I solvable Lie groups in terms of coadjoint orbits and characters of the stabilizer. A holomorphically induced representation is, so to speak, a complex version of a monomial representation and much more difficult to treat with. Even its representation space may be trivial and one can propose many variants of its definition. The first attempt to modify the definition of holomorphically induced representations was made by \textit{R. Penney} [J. Funct. Anal. 64, 1-18 (1985; Zbl 0581.22011)] for exponential solvable Lie groups, and very recently \textit{B. Magneron} [Astérisque 253 (Paris 1999; Zbl 0921.22005)] studied in detail a generalized situation for special nilpotent cases. In this paper, the author studies holomorphically induced representations for a completely solvable Lie group \(G=\exp{\mathfrak g}\) whose Lie algebra \({\mathfrak g}\) is a normal \(j\)-algebra [cf. \textit{I. I. Pyatetskii-Shapiro}, Automorphic functions and the geometry of classical domains, New York (1969; Zbl 0196.09901)]. Let \(f\in{\mathfrak g}^*\) and assume that its coadjoint orbit \(G\cdot f\) is open in \({\mathfrak g}^*\). The author starts from a weak polarization \({\mathfrak h}\) at \(f\), namely \({\mathfrak h}\) is a complex subalgebra of \({\mathfrak g}_\mathbb{C}\) such that \(f([X,{\mathfrak h}])= \{0\}\) if and only if \(X\in {\mathfrak h}\), to define a modified holomorphically induced representation. Then, she examines, making use of the algebraic structure of the normal \(j\)-algebra, the non-vanishing of its space, its decomposition into irreducibles and the reciprocity of Frobenius in the distribution sense.