On spectral properties of regular quasidefinite pencils F-\(\lambda\) G (Q756090)

This paper deals with the eigenvalue problem \(Fy=\lambda Gy\) for the quasi-definite case. The latter means that the two forms \({\mathbb{F}}\) and \({\mathbb{G}}\) associated with F and G are Hermitian, not necessarily positive definite, but at least one of them has a finite number of negative squares. The results generalize those of the positive definite case and include expansion theorems and completeness of root subspaces. The proofs are based on the analysis of selfadjoint operators in \(\Pi_{\kappa}\)- spaces. The paper also contains applications to eigenvalue problems of formally selfadjoint differential expressions with boundary conditions. In particular, the eigenvalue problem for a regular Sturm-Liouville operator with general \(\lambda\)-linear boundary conditions studied in a special case by \textit{R. Ibrahim} and \textit{B. D. Sleeman} [Lect. Notes Math. 846, 158-167 (1981; Zbl 0463.34019)] is analysed in general without restrictions on the signs of the coefficients. The latter problem is quasi-left definite (i.e., the form \({\mathbb{F}}\) associated with F has a finite number of negative squares) and the abstract results apply to this case.