Commutativity of differential operators on the space of restricted representations of a nilpotent Lie group (Q1429975)

Let \(G=\exp \mathfrak g\) be a simply connected, connected nilpotent Lie group, \(K=\mathfrak k\) an analytic subgroup of \(G\) and \(\pi\) a unitary irreducible representation of \(G\). Let \(U(\mathfrak g)\) be the complex universal algebra of \(G\). The authors show that the algebra \(D_\pi^K(G)=U(\mathfrak g)/\ker \pi\) is commutative, if and only if the restriction \(\pi_{| K}\simeq \int_{\widehat K} \sigma d\mu_\pi(\sigma)\) of \(\pi\) to \(K\) is of finite multiplicities. The proof of this result is based on refined induction arguments, which use the following two crucial facts. Let \((\mathfrak g_j)_{j=1}^n\) be a Jordan Hölder sequence of \(G\), which allows us to construct a Jordan-Hölder sequence \((\mathfrak k_j)_{j=1}^d\) of \(\mathfrak k\), a Jordan-Hölder basis \((Y_j)_{j=1}^d\) of \(\mathfrak k\) and a Malcev-sequence \((\mathfrak k_j)_{j=1}^n\) of \(\mathfrak g\), which passes through \(\mathfrak k\). For \(\ell\in\mathfrak g^*\) denote by \(\mathfrak g(\ell)\) the stabilizer of \(\ell\) in \(\mathfrak g\). The authors show that if \(\mu_\pi\)-almost everywhere \(\mathfrak g(\ell)\cap \mathfrak k_k\neq \mathfrak g(\ell)\cap \mathfrak k_{k-1}\) on the \(G\)-orbit \(\Omega \) of \(\pi\), then there exists an element \(W\in U(\mathfrak k_k)\cap \ker \pi\) of the form \(W=\sum_{j=0}^m P_j Y_k^j\) with \(P_j\in U(\mathfrak k_{j-1})(0\leq j\leq m)\) satisfying \(\pi(P_m)\neq 0\). The second important result says that if \(j\in\{1,\cdots,n\}\) is a saturation index for \(K\), then in the passage from \(\mathfrak k_{j-1}\) to \(\mathfrak k_{j}\) the algebra \(U_\pi(\mathfrak g)^K:=\{A\in U(\mathfrak g); [\pi(k),\pi(A)]=0\}\) is not increasing, but it does if \(j\) is not a saturation index.