Translation-invariant operators in reproducing kernel Hilbert spaces (Q2675215)

Let \(G\) be a locally compact abelian group which is metrizable and \(\sigma\)-compact. Let \(\nu\) be a Haar measure on \(G\). Let \((Y,\lambda)\) be a \(\sigma\)-finite measure space. Consider the natural action of \(G\) on \(L^2(G\times Y,\nu\times\lambda)\) by translation: \[ (a\cdot f)(u,v) = f(u-a,v) \] for \(a,u\in G\), \(v\in Y\) and \(f\in L^2(G\times Y)\). Let \(H\) be a closed subspace of \(L^2(G\times Y)\) that is invariant under the above action of \(G\). The authors are concerned with the \(W^{*}\)-algebra \(\mathcal{V}\) of bounded linear operators on \(H\) that are translation invariant. The main results in the paper are as follows. Via the Fourier transform on the first variable, the authors prove that \(\mathcal{V}\) can be decomposed as a direct integral of \(\mathcal{B}(\widehat{H}_{\xi})\) for \(\xi\in\widehat{G}\). As a consequence, \(\mathcal{V}\) is commutative if and only if \(\dim(\widehat{H}_{\xi})=1\) for \(\hat{\nu}\)-almost all \(\xi\). Under the assumption that \(H\) is a reproducing kernel Hilbert space whose kernel satisfies an extra technical condition, a constructive criterion for the commutativity of \(\mathcal{V}\) is obtained. In the commutative case, the authors construct an explicit unitary operator that simultaneously diagonalizes all operators on \(\mathcal{V}\). The non-commutative case with finite-dimensional fibers is also discussed. Finally, by applying their scheme, the authors recover several previously studied examples as well as exhibit a new one.