A Casselman-Shalika formula for the generalized Shalika model of \(\operatorname{SO}_{4n}\) (Q1703660)

Let \(F\) be a finite extension of the \(p\)-adic field \(\mathbb Q_p\) for a certain prime \(p\). Shalika models were first introduced in [\textit{H. Jacquet} and \textit{J. Shalika}, Perspect. Math. 11, 143--226 (1990; Zbl 0695.10025)] for \(\mathrm{GL}_{2n}(F)\). The main motivation was to identify the relations between Shalika periods and the pole at \(s=1\) of the exterior square partial \(L\)-function \(L^S(s, \pi, \Lambda^2)\), where \(\pi\) is an irreducible cuspidal representation of \(\mathrm{GL}_{2n}(F)\). These models are multiplicity-free induced representations. In this paper, the author studies the generalized Shalika model for unramified principal series of the \(F\)-split special orthogonal group \(\mathrm{SO}_{4n}(F)\), which is identified with the subgroup of \(\mathrm{SL}_{4n}(F)\) that is the isotropy group of the quadratic form given by the matrix \[ \xi = \begin{pmatrix} & 1\!\!1_{2n} \\ 1\!\!1_{2n} & \end{pmatrix}. \] A generalized Shalika model for this group was already defined by \textit{D. Jiang} and \textit{Y. Qin} in [J. Ramanujan Math. Soc. 22, No. 2, 101--133 (2007; Zbl 1175.11025)]. The author follows their construction: Let \(P\) be die parabolic Siegel subgroup of \(\mathrm{SO}_{4n}(F)\) with Levi decomposition \(P=MN\). For a nontrivial additive character \(\varphi\) of \(F\), the authors defines a character \(\varPhi^b\) of the unipotent radical \(N\) (this character depends on the choice of a skew-symmetric matrix \(b\)). The stabilizer of this character in the Levi subgroup \(M\) is the symplectic group \(\mathrm{Sp}^b_{2n}(F)\) associated with the matrix \(b\). With this ingredients, the author defines a generalized Shalika model for an irreducible admissible representation \(\pi\) of \(\mathrm{SO}_{4n}(F)\). The uniqueness of this model (whenever exists) was proved by \textit{C. Nien} [J. Algebra 323, No. 2, 437--457 (2010; Zbl 1186.22013)]. Let \(B\) be the Borel subgroup of \(\mathrm{SO}_{4n}(F)\) consisting of upper right triangular matrices. The author consider the smooth unramified principal series \(I(\chi)\) of \(\mathrm{SO}_{4n}(F)\) associated with an unramified character \(\chi\) of \(B\). For a nontrivial element \(\Lambda \in \mathrm{Hom}(I(\chi), \varPhi^b) \), he defines a generalized Shalika function \(\Omega(g)\). In his main result, the author finds a very explicit form for \(\Omega(g)\): Theorem. Let \(\lambda = (\lambda_1, \ldots, \lambda_n) \in \mathbb Z^n\) satisfying \(\lambda_1 \geq \lambda_2 \geq \ldots \geq \lambda_n \geq 0 \). Then \[ \Omega(g_\lambda) = \prod_{\alpha > 0}c_\alpha(\chi) \sum_{w \in \Gamma} (-1)^{l_\Gamma(w)}(w \chi)^{-1}\delta^{1/2}(h_\lambda) \prod_{\beta > 0, \, w\beta < 0}d_\beta(\chi), \] where \(\Gamma\) is a subgroup of the Weyl group of \(\mathrm{SO}_{4n}(F)\) corresponding to a root system of type \(B_n\). This system is formed by the combination of roots \(\{E_i - E_j, \pm E_k\, 1 \geq i, j, k \geq n, \, i \neq j \}\), where \(E_i = e_{2i-1} + e_{2n}\) and the \(e_i\) are the roots corresponding to the root system of \(\mathrm{SO}_{4n}\). The coefficient \(c_\alpha\) is a constant defined by \textit{W. Casselman} in [Compos. Math. 40, 387--406 (1980; Zbl 0472.22004)], \(\delta\) is the modular character of the subgroup \(B\). The element \(g_\lambda = \mathrm{diag}(\omega^{\lambda_1}, \cdots, \omega^{\lambda_n}, 1\ldots, 1)\), \(h_\lambda = (\omega^{\lambda_1},1, \omega^{\lambda_2}, 1, \ldots, \omega^{\lambda_n}, 1)\in M\), with \(\omega\) a uniformizer of \(F\) and \(d_\beta(\chi)\) is a certain quotient. The proof follows the methods of [\textit{Y. Sakellaridis}, Can. J. Math. 58, No. 5, 1095--1120 (2006; Zbl 1114.22011)] and [\textit{W. Casselman} and \textit{J. Shalika}, Compos. Math. 41, 207--231 (1980; Zbl 0472.22005)]. Shalika models and their generalizations have a great deal with the Langlands functorial transfer property. See for instance the paper [\textit{D. Jiang} et al., Manuscr. Math. 127, No. 2, 187--217 (2008; Zbl 1167.11021)] for results in this topic.