Equivariant holomorphic Morse inequalities. III: Non-isolated fixed points (Q1380483)

This is the third article in a series of papers on equivariant holomorphic Morse inequalities. In the first one [\textit{V. Mathai} and \textit{S. Wu}, J. Differ. Geom. 46, No. 1, 78-98 (1997; Zbl 0910.58006)], an analytic proof of Witten's holomorphic Morse inequalities [\textit{E. Witten}, Teubner Texte Math. 70, 318-333 (1984; Zbl 0588.32009)] was given in the case of a Hamiltonian \(S^1\)-action on a compact Kähler manifold \(M\) with isolated fixed points. In the second part [\textit{S. Wu}, Equivariant holomorphic Morse inequalities. II: Torus and non-abelian group actions, Math. Sci. Res. Inst., preprint No. 1996-013, dg-ga/9602008 (1996)], the corresponding inequalities for actions of larger groups were established. It was also shown that the Kähler condition is necessary for the strong inequalities. The present article deals with the general case of non-isolated fixed points. Moreover, some interesting applications of these inequalities are given. Assume that a torus \(T\) acts holomorphically and isometrically on a compact Kähler manifold \((M,\omega)\) of complex dimension \(n\). Let the fixed point set \(F\) be non-empty and consist of connected components \(F_1\), \dots, \(F_m\) of dimensions \(n_1\), \dots, \(n_m\), and let \(N_r^{\mathbb C}=N_r^{1,0}\oplus N_r^{0,1}\to F_r\) be the complexified normal bundle of \(F_r\). Let \(\lambda_{r,k}\) be the weights of the isotropy representation of \(T\) on \(N_r^{1,0}\), and fix a positive action chamber \(C\), that is, a connected component \(C\) of \(\mathfrak t\setminus\bigcup(\lambda_{r,k})^\perp\). The polarizing weights \(\lambda_{r,k}^C=\pm\lambda_{r,k}\) are chosen such that \(\lambda_{r,k}^C\in C^*\), i.e., such that \(\langle\lambda_{r,k}^C,C\rangle>0\), and the polarizing index \(\nu_r^C\) of \(F_r\) is the number of weights \(\lambda_{r,k}\in -C^*\). Let \(N_r^C\) be the direct sum of the sub-bundles corresponding to the weights \(\lambda_{r,k}\in C^*\), and consider the polarized symmetric tensor product (with respect to \(C\)) of \(N_r^{1,0}\): \[ K^C(N_r):=S((N_r^{C,(1,0)})^*) \otimes S(N_r^{-C,(1,0)}) \otimes\Lambda^{\nu_r^C}(N_r^{-C,(1,0)}) . \] Let \(E\to M\) be a holomorphic vector bundle on which \(T\) acts. The infinite dimensional bundle \(K^C(N_r)\otimes E| _{F_r}\) splits into finite-dimensional sub-bundles \(E_{r,\xi}^C\) on which \(T\) acts by a given weight \(\xi\). The main result of this article are the following strong Morse-Bott inequalities in terms of formal power series on \(\mathfrak t\): \[ \sum_{r,k}t^{\nu_r^C+k} \roman{char} H^k \left(F_r,\mathcal O(K^C(N_r)\otimes E| _{F_r})\right) =\sum_k t^k \roman{char} H^k(M,\mathcal O(E)) +(1+t) Q^C(t) , \] where \(Q^C(t)\) has positive coefficients. As in the first paper, the proof uses Witten's deformation of the Dolbeault operator, including the techniques of [\textit{J.-M. Bismut} and \textit{G. Lebeau}, Publ. Math., Inst. Hautes Étud. Sci. 74, 1-297 (1991; Zbl 0784.32010)]. The authors give the following consequences of their theorem. Let \[ P(M;s,t)=\sum_{k,l}s^kt^l \dim_{\mathbb C}H^{k,l}(M) \] be the Poincaré-Hodge polynomial of \(M\). Then for any choice of action chamber \(C\), \[ \sum_r(st)^{\nu_r^C} P(F_r;s,t)=P(M;s,t) , \] which generalizes a result in [\textit{J. B. Carrell} and \textit{A. J. Sommese}, Comment. Math. Helv. 54, 567-582 (1979; Zbl 0466.32015)]. As an example, the classification of 4-dimensional symplectic manifolds with Hamiltonian \(S^1\) actions by M. Audin and Y. Karshon is restated. A second application concerns symplectic cutting and geometric quantisation. Let \(S^1\) act on a compact Kähler manifold \(M\) with Hamiltonian \(h\), and suppose that \(S^1\) acts freely on \(h^{-1}(0)\). Let \(M_0\) be the corresponding symplectic reduction, and let \(M_\pm\) be the corresponding two symplectic cuts. Then the following gluing formula holds: \[ P(M_+;s,t)+P(M_-;s,t)=P(M;s,t)+(1+st) P(M_0;s,t) . \] Suppose that there exists a prequantum line bundle \(L\to M\), then \(L\) induces natural prequantum line bundles \(L_0\to M_0\) and \(L_\pm\to M_\pm\). One obtains the following strong Morse-type inequalities for the \(S^1\)-invariant part of \(H^*(M_\pm,\mathcal O(L_\pm))\): \[ \sum_k t^k\dim_{\mathbb C}H^k(M_0,\mathcal O(L_0)) =\sum_k t^k\dim_{\mathbb C}H^k(M_\pm,\mathcal O(L_\pm))^{S^1} +(1+t) Q^\pm_0(t), \] where \(Q^\pm_0\) has positive coefficients. More general inequalities in terms of characters of the \(S^1\)-action are conjectured.