Analytic hypoellipticity for sums of squares and the Treves conjecture (Q1707934)

The paper is addressed to the problem of the analytic hypoellipticity for sum-of-squares operators \[ P= \sum^N_{j=1} X^2_j, \] where \(X_j\) are vector fields with real analytic coefficients. In the introduction, addressed to non-experts, the authors review preceding results on the subjec. Starting from the well-known condition for \(C^\infty\) hypoellipticity of Hörmander on the Lie algebra generated by the \(X_j\)'s, they survey several results relating analytic hypoellipticity to geometric properties of the characteristic manifold of \(P\). Finally a conjecture of Treves is recalled, stating that \(P\) is analytic hypoelliptic if and only if all the strata generated by the \(X_j\)'s are symplectic. The main aim of the present paper is to give a counterexample to the sufficient part of the conjecture. Namely, the authors consider in dimension 4 the operator \[ P= D^2_1+ D^2_2+ x^{2(r-1)}_1(D^2_3+ D^2_4)+ x^{2(p-1)}_2 D^2_3+ x^{2(q-1)}_2 D^2_4 \] with \(1<r<p<q\), which satisfies the condition of Treves, and is not analytic hypoelliptic. A similar model is also considered from the microlocal point of view. Non-analyticity is proved by solving a semiclassical spectral problem for a stationary Schrödinger equation with double well potential. Results of sharp Gevrey hypoellipticity are also obtained by combining sub-elliptic estimates with induction proceedings.