A spectral expansion for the symmetric space \(\mathrm{GL}_n(E)/\mathrm{GL}_n(F)\) (Q6948968)

Let \(n\in\mathbb N\) be a natural integer, \(E/F\) a quadratic extension of number fields, \(\mathbb A_E\) and \(\mathbb A=\mathbb A_F\) their rings of adèles, \(G\) the algebraic group \(G_n=\mathrm{GL}(n)\) over \(\mathbb Z\). Fix a Haar measure \(dh\) and a Schwartz test function \(f\) on \(G(\mathbb A_E)\). This paper considers the automorphic kernel \(K_f(g,h) = \sum_{\gamma\in G(E)}f(g^{-1}\gamma h)dh\) for \(g,\) \(h\in G(\mathbb A_E)\), the ``Flicker-Rallis period'' of this automorphic kernel, defined by the convergent integral \(J^G(g,f)=\int_{G(F)\backslash G(\mathbb A)}K_f(g,h)dh\), and its twisted form \(J^{G,\eta}(g,f)=\int_{G(F)\backslash G(\mathbb A)}K_f(g,h)\eta(\mathrm{det} h)^{n+1}dh\), where \(\eta:\mathbb A^\times/F^\times\to\{\pm1\}\) is the character whose kernel is the norm subgroup \(F^\times N_{E/F}\mathbb A_E^\times/F^\times\). To any cuspidal datum \(\chi\) of \(G(\mathbb A_E)\) one can isolate the \(\chi\)-component \(K_\chi\) of the kernel. Integration over \(G(F)\backslash G(\mathbb A)\) defines a distribution \(f\mapsto J_\chi^{G,\eta}(g,f)\).\N\NApplications use the ``Jacquet-Rallis trace formula'' -- a regularized version of the divergent integral \(\int_{G(F)\backslash G(\mathbb A)} J^{G_n,\eta}(g,f_n)J^{G_{n+1},\eta}(g,f_{n+1})dg\) for Schwartz functions \(f_n\), \(f_{n+1}\) on \(G_n(\mathbb A)\), \(G_{n+1}(\mathbb A)\), where \(G_n\) is placed in the first \(n\) rows and columns in \(G_{n+1}\). Recent applications for a proof of Gan-Gross-Prasad and Ichino-Ikeda conjectures for unitary groups are based on a spectral decomposition of \(J_\chi^{G,\eta}(g,f)\) for some specific cuspidal data \(\chi\) called \(\ast\)-regular. This article provides ``an extension of this decomposition to any cuspidal datum. Thus the article solves an important step towards the fine spectral decomposition of the Jacquet-Rallis trace formula from which we expect new applications''. ``More generally, the results presented here should be useful for the spectral expansion of any trace formula based on the symmetric space \(G(\mathbb A_E)/G(\mathbb A_F)\)'', in particular a new proof of the fine spectral expansion of Jacquet's relative trace formula and a new explicit computation of the constants that appear there.\N\NAs the work is very long and technical -- Arthur style -- an interested reader could be helped by the reviewer's work in the case \(n=2\): [\textit{Y. Z. Flicker}, J. Reine Angew. Math. 418, 139--172 (1991; Zbl 0725.11026)], that initiated this ``relative'' industry.