Functorial transfer between relative trace formulas in rank \(1\) (Q2657474)

Let \(X,Y\) be spherical varieties and assume \({^LX},{^LY}\) are their dual groups as in [the author and \textit{A. Venkatesh}, Periods and harmonic analysis on spherical varieties. Paris: Société Mathématique de France (SMF) (2017; Zbl 1479.22016)]. The Langlands functoriality conjecture, generalized for spherical varieties, predicts that any morphism \(^LY\rightarrow {^LX}\) of the dual groups should lead to a functorial transfer of automorphic spectra or a comparison of relative trace formulas of these spherical varieties. In the paper under review, the author considers the situation when \(X\) is a spherical \(G\)-variety of the form \(H\setminus G\) and of rank \(1\) such that the dual group is \(\mathrm{SL}_2\) or \(\mathrm{PGL}_2\) (see Table 1 of the paper for a detailed list of all the \(X\)'s that are covered in this paper) and \(Y\) is the Whittaker model \(N_{\psi}\setminus G^{*}\), where \(G^*=\mathrm{PGL}_2\) or \(\mathrm{SL}_2\), \(N\) is the upper triangular unipotent subgroup and \(\psi\) is a non-trivial character of \(N\). \par With a potential application for global comparisons, the main result of this paper is a local transfer operator \(\mathcal{T}\) which induces a linear isomorphism \[ \mathcal{T}:\mathcal{S}_{L_X}^{-}(N_{\psi}\setminus G^*/N_{\psi})\stackrel{\sim}{\rightarrow} \mathcal{S}(X\times X/G) \] between some suitably defined spaces of test measures that are needed for the trace formulas of \(Y\) and \(X\). Let \(F\) be a local field (Archimedean or non-Archimedean). Then the space \(\mathcal{S}(X\times X/G)\) is the pushforward of the Schwartz measures on the \(F\)-points of \(X\times X\) along the invariant-theoretic quotient map \(X\times X\rightarrow (X\times X)/\!\!/G\) and \(\mathcal{S}_{L_X}^{-}(N_{\psi}\setminus G^*/N_{\psi})\) is an enlarged space containing \(\mathcal{S}(N_{\psi}\setminus G^*/N_{\psi})\) associated to some \(L\)-value \(L_X\) associated to \(X\). The transfer operator \(\mathcal{T}\) is defined with the help of certain Fourier transforms. Such local matching of the ``beyond endoscopy'' style, even with some global applications, was already established in special cases, see for example the author's papers [in: Automorphic representations and \(L\)-functions. Proceedings of the international colloquium, Mumbai, India, January 3--11, 2012. New Delhi: Hindustan Book Agency; Mumbai: Tata Institute of Fundamental Research. 521--590 (2013; Zbl 1315.11038)] and [J. Inst. Math. Jussieu 18, No. 2, 347--447 (2019; Zbl 1460.11075)]. One highlight of this paper is that it can treat these rank \(1\) spherical varieties uniformly.\par The proof of the main result relies on the study of the geometry of the map \(X\times X\rightarrow (X\times X)/\!\!/G\). Using results of Knop, the author gets a resolution of \(X\times X\) which is closely related to the space \(T^*X\times_{\mathfrak{g}^*}T^*X\) where \(T^*X\rightarrow \mathfrak{g}^*\) is the moment map. Then there is an isomorphism \((X\times X)/\!\!/G\simeq \mathbb{A}^1\) and the author can give some explicit description of the space \(\mathcal{S}(X\times X/G)\) (Theorem 1.4.1).