Admissible vectors for mock metaplectic representations (Q1940122)

Let \(H\) be a locally compact group acting on \({\mathbb R}^n\) and \({\mathbb R}^d\) as \(h[x]\) and \(h.x\) respectively, and suppose that there is a \(C^1\)-map \(\Phi : {\mathbb R}^d \to {\mathbb R}^n\) intertwining the two actions as \(\Phi(h.x)=h[\Phi(x)]\). Let \(G\) be the semidirect product \({\mathbb R}^n\rtimes H\). As an analogue of the mock metaplectic representation of \(Sp(d,{\mathbb R}^d)\), the authors introduce the representation \(U\) of \(G\) on \(L^2({\mathbb R}^d)\) defined by \[ U_gf(x)=\beta(h)^{-\frac{1}{2}}e^{-2\pi i(\Phi(x),a)}f(h^{-1}.x), \] where \(g=(a,h)\in G\) and \(\beta(h)\) is the Jacobian of the action of \(x\to h.x\). They investigate some conditions for admissible vectors \(\eta\in L^2({\mathbb R}^d)\) such that \[ \|f\|^2=\int_G|\langle f,U_gf\rangle|^2dg \] and obtain that, if such a vector exists, then \(n\leq d\) and the set of critical points of \(\Phi\) has Lebesgue measure zero. Finally, by using a direct integral decomposition of \(U\), the authors obtain necessary and sufficient conditions for the admissible vectors under the technical assumption that the \(H\)-orbits are locally closed in \(\Phi({\mathbb R}^d)\) and almost all \(H\)-stabilizers are compact.