A multi-variable Rankin-Selberg integral for a product of \(\mathrm{GL}_2\)-twisted spinor \(L\)-functions (Q328591)

Due to the deep relations between periods, special values of automorphic \(L\)-functions and functorial liftings, a challenging and interesting problem is the computation of periods. One of the classical examples goes back to the paper [in: Automorphic forms, Shimura varieties, and \(L\)-functions. Vol. II, Proc. Conf., Ann Arbor/MI (USA) 1988, Perspect. Math. 11, 143--226 (1990; Zbl 0695.10025)] of \textit{H. Jacquet} and \textit{J. Shalika}, where certain connections between special values of symmetric and exterior square \(L\)-functions and functorial lifts of \(\text{GL}_n\) were established. One usual approach is to try to develop a tool, like integral representations, that allows us to understand better the analytical properties of a family of \(L\)-functions. In this way, if one of these \(L\)-functions occurs as the \(L\)-function of an automorphic representation and its analytical properties are well understood, then we will obtain an identity between periods. Such period identities are less understood and they can provide new insights into functorial liftings. In this paper, the authors consider integral representations for the automorphic \(L\)-functions \(L(\Pi\times \tau_1, s_1) L(\Pi\times \tau_2, s_2)\), where \(\Pi\) is a generic cuspidal automorphic representations \(\text{GL}_n\) \(\tau_1\) and \(\tau_2\) are two cuspidal automorphic representations of \(\text{GL}_2\) with the same central character. Let \(G= \text{GSO}_n\) be the identity component of the orthogonal group \(\text{GO}_n := \{ g \in \text{GL}_n \mid gJ_n ^tg \in \text{GL}_1\cdot J_n\}\), where \(^tg\) denotes the transpose of \(g\) and \(J_n\) denotes the `1' in the antidiagonal \[ J_n = \begin{pmatrix} & & 1\\ &\mathinner{\mskip1mu\raise1pt\vbox{\kern7pt\hbox{.}} \mskip2mu\raise4pt\hbox{.}\mskip2mu\raise7pt\hbox{.}\mskip1mu} & \\ 1 & & \end{pmatrix}. \] The group \(G\) possesses a rational character \(\lambda\) called the similitude factor, that satisfies the identity \(gJ_n ^tg = \lambda (g) J_n\). The authors define now the application \(m_P: \text{GL}_3\times \text{GL}_{3(n-1)} \times \text{GL}_1 \to \text{GSO}_{6n}\) given by \[ m_P(g_1, g_2, \lambda) \to \text{diag}(\lambda g_1, \lambda g_2, g_2^*, g_1^*), \] where \(g^* = gJ_n ^tg\). Let \(M_P\) be the image of this application, which is a standard Levi subgroup and denote by \(P\) the corresponding parabolic subgroup of \(G\). Then \(P = M_P U_P\), where \(U_P\) is the unipotent radical of \(P\). The image, denoted by \(M_P\), is a standard Levi subgroup in \(\text{GSO}_{6n}\). Using the morphism \(m_P\), it is possible to identify \(M_P\) with \(\text{GL}_3\times \text{GL}_{3(n-1)} \times \text{GL}_1\). As usual with these constructions, the authors build an induced representation from this Levi subgroup. Therefore, they consider the following Hecke character \((\chi, \mathbf s):M_P(\mathbb A) \to \mathbb C\) given by: \[ (\chi, \mathbf s)(g_1, g_2, \lambda):= \chi_1(g_1) |\det (g_1)|^{s_1} \chi_2(g_2) |\det (g_2)|^{s_2} \chi_3(\lambda)|\lambda|^{s_3}, \] where \(M_P(\mathbb A)\) denotes as usual the adelic points of the group \(M_P\). Next they consider the family of induced representations \(\text{Ind}_{P(\mathbb A)}^{G(\mathbb A)}(\chi, \mathbf s)\). With this family, the authors produce Eisenstein series that are used in certain Rankin-Selberg integrals. The group \(\text{GSO}_{6n}\) has a standard parabolic subgroup \(Q\) with Levi subgroup \(M_Q\) isomorphic to \(\text{GL}_{2n} \times \text{GSO}_{2n}\). There is a natural representation from the Lie algebra of the unipotent radical \(U_Q\) which can be realized as the exterior square of \(\text{GL}_{2n}\) twisted by the similitude factor. For such characters in this representation the stabilizer is isomorphic to the group \[ C = \{(g_1, g_2) \in \text{GSp}_{2n} \times \text{GSO}_{2n} \mid \lambda(g_1) = \lambda(g^{-2})\}. \] The choice of a character in this representation determines a projection from \(U_Q\) onto a Heisenberg group in \(4n^2+1\) variables and also an embedding of \(C\) into \(\text{Sp}_{4n^2}\). The integral to calculate the Fourier-Jacobi coefficients defines a mapping from automorphic functions on \(\text{GSO}_{6n}(\mathbb A)\) to automorphic functions on the group \(C(\mathbb A)\). Next, the authors apply this coefficient in the case \(n=2\) and \(3\) to a degenerate Eisenstein series on \(\text{GSO}_{6n}(\mathbb A)\), induced from a character of the parabolic subgroup \(P\) with Levi subgroup \(M_P\), as mentioned above. The next step is to pair the result with cusp forms on the groups \(\text{GSp}_{2n}(\mathbb A)\) and \(\text{GSO}_{2n}(\mathbb A)\), respectively. This comparison shows a connection with the theta correspondence for similitude groups. In the case \(n=2\) the integral can be written as a Eulerian product of \(L\) functions of two generic cuspidal representations. The results obtained in the case \(n=3\) show also a connection with the theta correspondence. Here, the global integral unfolds to a period of \(\text{GSp}_{6}\), which is known to be non-vanishing on the image of the theta lift from \(\text{GSO}_{6}\) after a result of \textit{D. Ginzburg} et al. [J. Reine Angew. Math. 487, 85--114 (1997; Zbl 0928.11025)].