Harmonic analysis on the infinite-dimensional unitary-symplectic group (Q357299)

\(SP(\infty)\) is the group of unitary-symplectic matrices \(S=\left[S_{ij}\right]\), \(i,j=1,2,\dots\), whose entries \(S_{ij}=\delta_{ij}\) for sufficiently large \(i+j\). The article is devoted to the decomposition of unitary representations of this group into irreducible representations. Let \(G=Sp(\infty)\times Sp(\infty)\), and let \(K\) be the diagonal subgroup of \(G\) isomorphic to \(Sp(\infty)\). Then \((G,K)\) is a Gelfand pair. The author investigates representations \(T_z\) obtained in [\textit{Y. A. Neretin}, Duke Math. J. 114, No. 2, 239--266 (2002; Zbl 1019.43008)]. These representations depend on the parameter \(z\) with \(\operatorname{Re} z>-1/4\). For every such \(z\), the representation \(T_z\) can be expressed as a direct integral without multiplicities of irreducible spherical (i.e., having a distinguished cyclic \(K\)-invariant vector) representations of the group \(G\). The equivalence class of \(T_z\) is uniquely determined by an equivalence class of some measures that is called the spectral type of \(T_z\). The spectral type of \(T_z\) is heavily dependent of whether or not \(z\) is an integer. The paper is devoted to the case of \(z\in{\mathbb Z}\). In this case, \(T_z\) can be decomposed into the direct sum of subrepresentations \(T_{pq}\) which are called its blocks. The article starts with some already published results on characters of \(Sp(\infty)\), corresponding measures, and graphs. Then, the author describes the representations \(T_z\), and the block decomposition. In Section~3, the author uses an isomorphism that agrees with the block decomposition of \(T_z\) from the previous section to construct a \(K\)-invariant vector \(v_{pq}\) in each of the blocks \(T_{pq}\). In Section~4, it turns out that the vector \(v_{pq}\) is a cyclic vector of the representation \(T_{pq}\). The article is essentially a continuation of the research done in [\textit{S. Kerov} et al., Invent. Math. 158, No. 3, 551--642 (2004; Zbl 1057.43005; the author, J. Math. Sci., New York 181, No. 6, 886--913 (2012); translation from Zap. Nauchn. Semin. POMI 390, 237--285 (2011; Zbl 1255.43006)]. The article should be interesting for specialists in abstract harmonic analysis and representation theory.