Smoothness and analyticity for solutions of first order systems of partial differential equations on nilpotent Lie groups (Q1073273)

Let \({\mathfrak g}={\mathfrak g}_ 1\oplus...\oplus {\mathfrak g}_ r\) be a nilpotent Lie algebra over \({\mathbb{R}}\) satisfying [\({\mathfrak g}_ i,{\mathfrak g}_ j]\subseteq {\mathfrak g}_{i+j}\). Let \(G=\exp {\mathfrak g}\). Further assume that \({\mathfrak g}_ 1\) generates \({\mathfrak g}\) as a Lie algebra and let \({\mathfrak g}^ j=\sum_{k\geq j}{\mathfrak g}_ k\). (Note: these conditions are slightly weaker than supposing that \({\mathfrak g}\) is stratified.) Let \({\mathbb{L}}\) be a complex subspace of \({\mathfrak g}_ 1\otimes {\mathbb{C}}\). Call \({\mathbb{L}}\) hypoelliptic (resp. analytic hypoelliptic) if the following holds: For each open \(\Omega\) \(\subseteq G\) and each \(u\in {\mathcal D}'(\Omega)\), \(Lu\in C^{\infty}(\Omega)\) (resp. A(\(\Omega)\)) for all \(L\in {\mathbb{L}}\) implies \(u\in C^{\infty}(\Omega)\) (resp. A(\(\Omega)\)). Define the conditions: H1 \({\mathbb{L}}+{\bar {\mathbb{L}}}={\mathfrak g}_ 1+{\mathbb{C}}\) H2 for all \(\lambda\in {\mathfrak g}^*_ 2\setminus \{0\}\) which vanish on \(Re[{\mathbb{L}},{\mathbb{L}}]+Im[{\mathbb{L}},{\mathbb{L}}]\), the Hermitian form on \({\mathbb{L}}\times {\mathbb{L}}\) defined by \(<L,L'>_{\lambda}=(1/i)\lambda \quad ([L,\bar L'])\) has at least one negative eigenvalue. Theorem: \({\mathbb{L}}\) is hypoelliptic iff H1 and H2 hold for \({\mathbb{L}}.\) Theorem: Assume [\({\mathfrak g}^ 2,{\mathfrak g}^ 2]=0\). Then \({\mathbb{L}}\) is analytic hypoelliptic iff H1 and H2 are satisfied for \({\mathbb{L}}\).