A smooth family of intertwining operators (Q632989)

Let \(N\) be a connected, simply connected nilpotent Lie group with Lie algebra \(\mathfrak n\). This means that for any \(X\in \mathfrak n\), the adjoint endomorphism \(ad_{X}\) defined on \(\mathfrak n\) by \(ad_{X}(Y)=[X, Y]\) is nilpotent. In this setting the exponential map is a \(C^{\infty}\)-diffeomorphism and the unitary dual \(\widehat{N}\) of \(N\) is homeomorphic to the space of coadjoint orbits \(\mathfrak n^{*}/Ad^{*}\) through the Kirillov theory. For fixed two equivalent representations \(\pi\) and \(\pi'\) of \(\widehat{N}\), we know how to describe an intertwining operator. This operator is based on an integral over a homogeneous space involved by the corresponding polarization associated to these representations (cf. [\textit{G. Lion}, Lect. Notes Math. 587, 160--176 (1977; Zbl 0391.22008)]). In the paper under review, the authors consider a submanifold \(W\) of \(\mathfrak n^{*}\) and two smooth families of polarizations \(\{P(w), w\in W\}\) and \(\{P'(w), w\in W\}\) of common dimension. Let \(\pi_{w}\) and \(\pi_{w}'\) be the associated representations to \(P(w)\) (and to \(P'(w)\) respectively). Making use of the result of [loc. cit.] and special choices of bases, the upshot of this paper is to show the existence of a smooth family of explicit intertwining operators for \(w\) in a certain non-empty open set of \(W\). The construction of such a family of intertwining operators appears to be useful for several problems such as the existence of local retract results in the setup of a semi-client product of a compact Lie group and a nilpotent Lie group.