Harmonic analysis of some induced representations of a nilpotent Lie group (Q1127894)

Let \(G\) be a connected and simply connected nilpotent Lie group, \(H\) an analytic subgroup of \(G\) and let \(\chi\) be a unitary character of \(H\). Assume that the induced representation \(\tau= \text{ind}_H^G\chi\) has finite multiplicities in its irreducible decomposition. We apply \textit{R. Penney}'s Plancherel formula for \(\tau\) [J. Funct. Anal. 18, 177-190 (1975; Zbl 0305.22016), cf. also \textit{H. Fujiwara}, Pac. J. Math. 127, 329-351 (1987; Zbl 0588.22008)] to study the Corwin-Greenleaf commutativity result [\textit{L. Corwin} and \textit{F. P. Greenleaf}, Commun. Pure Appl. Math. 45, 681-748 (1992; Zbl 0812.43004)] on a certain algebra \(D_\tau(G/H)\) of \(G\)-invariant differential operators. Here we get the commutativity in question by showing that Penney's distributions appearing in the Plancherel formula for \(\tau\) are eigendistributions for all elements of \(D_\tau(G/H)\). In the second part of the paper, a kind of weak Frobenius reciprocity is established for nilpotent symmetric spaces, which also leads us to the commutativity of \(D_\tau(G/H)\) in this situation.