Hypoellipticity in spaces of ultradistributions -- study of a model case (Q375816)

This paper deals with \(C^\infty\)-hypoellipticity results in spaces of ultradistributions for linear PDEs with real analytic coefficients. To do this the authors prove a new a priori inequality which is stated in terms of the behaviour of holomorphic functions on appropriate wedges. At first they recall the standard definitions of ultradistribution spaces \(D^{\{s\}'}(\Omega)\subset D^{(s)'}(\Omega)\), \(s> 1\), and show that the above-mentioned a priori inequality holds also for the analytic hypoellipticity of a large class of differential operators. By applying their new method they study the perturbed operator of Baouendi-Goulaouic which is \(C^\infty\)-hypoelliptic according to Hörmander bracket condition. In the ultradistribution case the situation is quite different. In fact, for each open set \(U\ni 0\) and each \(1< s< 2\) there is \(u\in D^{(s)'}(U)\setminus D'(U)\) such that \(Pu\in C^\infty(U)\). Moreover, \(P\) is not analytic hypoelliptic for distributions. That result is shaper as \textit{M. Derridj} and \textit{C. Zuily} [Astérisque 2/3, 371--381 (1973; Zbl 0303.35027)] proved in 1973 that the same operator is \(G^s\) hypoelliptic for distributions if \(s\geq 2\).