A Paley-Wiener theorem for selected nilpotent Lie groups (Q2367259)

The classical Paley-Wiener theorem for \(\mathbb{R}^ n\) leads us to the following conjecture. Let \(N\) be a connected, simply connected nilpotent Lie group with unitary dual \(\widehat N\), and let \(\varphi\) be a compactly supported, measurable, essentially bounded function on \(N\). Suppose that there exists a subset \(E \subset \widehat N\) of positive Plancherel measure such that \(\widehat\varphi (\pi)=0\) for all \(\pi \in E\), where \(\widehat\varphi(\pi)\) is the operator-valued Fourier transform of \(\varphi\). Then \(\varphi=0\) almost everywhere. The author proves this conjecture for a class of \(N\). More precisely, let \({\mathfrak n}\) denote the Lie algebra of \(N\) and let \({\mathcal W} \subset{\mathfrak n}^*\) be the set of linear functionals which parametrize generic coadjoint orbits (with respect to a strong Malcev basis for \(\mathfrak n)\). If \({\mathcal W}\) is polarized by a single real polarization of M. Vergne, then the conjecture holds for \(N\). For the second part of the paper, the author picks up an example not satisfying the above condition, and explains how to show the conjecture for this 7-dimensional, 5-step nilpotent Lie group.