Symmetric solutions of the Neumann problem involving a critical Sobolev exponent (Q701305)

This work investigates the nonlinear Newmann problem \(-\Delta u+\lambda u=Qu^{2^*-1},\) \(u>0\) in \(\Omega\), \(\frac{\partial u}{\partial\nu}=0\) on \(\partial\Omega\), where \(\Omega\) is a bounded smooth domain in \(\mathbb{R}^N\), \(N\geq 3\), \(2^*=2N/(N-2)\), \(\lambda>0\). For \(Q=1\) such a problem has an extensive literature. The present paper is devoted to the study of the effect of \(Q\) on existence or nonexistence of symmetric least energy solutions whenever \(\Omega\) and \(Q\) are symmetric. More precisely, let \(G\) be a finite subgroup of \(O(N)\), and let \(\Omega\) as well as \(Q\) be \(G\)-invariant. Define \(E_\lambda(u)=\int_\Omega(|\nabla u|^2+\lambda u^2)\), \(H^1_G(\Omega)=\{u\in H^1(\Omega)|u {\text{ G-invariant}}\}\) and \(m_\lambda=\inf\{E_\lambda(u)|u\in H^1_G(\Omega),\int_\Omega|u|^{2^*}=1\}\). One objective of the paper is the investigation of the minimum of \(m_\lambda\) depending on the behaviour of \(Q\). First it is proved that the function \(\lambda\to m_\lambda\) is increasing, continuous and bounded by a number \(\widetilde S\) depending on \(Q\). Set \(\Lambda=\inf\{\lambda:m_\lambda=\widetilde S\}\). It follows that there exists a least energy solution for \(\lambda<\Lambda\), and there does not exist a least energy solution for \(\lambda>\Lambda\). For a class of symmetric functions \(Q\) it is proved that \(\Lambda=\infty\), whereas, for another class of functions \(Q\) it is proved that \(\Lambda<\infty\). Using the previous results, two Sobolev inequalities involving the coefficient \(Q\) are obtained for \(N\geq 5\). Finally, a proof of the Struwe compactness theorem adapted to the Newmann problem is given.