Sobolev mapping of some holomorphic projections (Q1985311)

Let \(\mathbb{H}_{\gamma} \) be the power-generalized Hartogs triangle of exponent \(\gamma\) defined by \[ \mathbb{H}_{\gamma} := \left\{(z_1,z_2) \in \mathbb{C}^2 : |z_1|^{\gamma} < |z_2| < 1\right\}. \] This definition generalizes the Hartogs triangle, which corresponds to the case \(\gamma=1\). The authors earlier studied the \(L^p\) boundedness of the Bergman projection, \(\mathbf{B}\), as a map \(\mathbf{B}: L^p (\mathbb{H}_{\gamma} )\rightarrow L^p (\mathbb{H}_{\gamma} )\) in [J. Geo. Anal. 27, 2658--2683 (2017; Zbl 1398.32039)]. In this article, Sobolev regularity (involving derivatives) is studied. \(L^p_k(\mathbb{H}_{\gamma} )\) is used to denote the \(L^p\) Sobolev space of order \(k\). The main results of the paper regarding irregularity are that 1) for \(\gamma = \frac{m}{n} \in \mathbb{Q}^+\), \(\mathbf{B}\) fails to map \(L^2_k (\mathbb{H}_{\gamma} )\rightarrow L^2_k (\mathbb{H}_{\gamma} )\) boundedly for \(k\) an integer, \(k\ge 1\), and 2) for \(j,l \in \mathbb{Z}^+\), \(\frac{\partial^{j+l}}{\partial_{z_1}^j \partial_{z_2}^l } \circ\mathbf{B} \) fails to map \(C^{\infty} (\overline{\mathbb{H}_{\gamma} })\rightarrow L^p(\mathbb{H}_{\gamma})\) boundedly for \[ p \ge \frac{2m+2n}{m(l+1) + n(j+1) -1}. \] On the other hand, for the classical Hartogs triangle, \(\mathbb{H}_1\), it is shown that the Bergman projection is bounded as a map \(\mathbf{B}: L^p_1 (\mathbb{H}_{1} )\rightarrow L^p_1 (\mathbb{H}_{1} )\) for \(\frac{4}{3} < p < 2\). Whereas the Bergman projection is irregular on the power-generalized Hartogs triangle, an oblique projection operator, \(\widetilde{\mathbf{B}^{\infty}}\), termed the ``\(L^{\infty}\) sub-Bergman projection'', is shown to exhibit some regularity, mapping \(L^p_k (\mathbb{H}_{1} )\rightarrow L^p_k (\mathbb{H}_{1})\) boundedly, with ranges for \(p\) depending on \(k\), for \(k=1,2,3\). The \(L^{\infty}\) sub-Bergman projection operator, \(\widetilde{\mathbf{B}^{\infty}}\), is obtained by subtracting certain terms from the Bergman kernel, and was studied in [Adv. Math. 341, 616-656 (2019; Zbl 1420.32003)], where in particular, it was shown that it is a projection operator. The authors remark that the process of obtaining an oblique projection operator which exhibits greater regularity than the Bergman projection can be applied in an analogous manner to other Reinhardt domains.