Functional calculus for definitizable self-adjoint linear relations on Krein spaces (Q902270)

In this article, a version of the spectral theorem for self-adjoint definitizable linear relations on Krein spaces is derived. A \textit{definitizable} linear relation \(A\) on a Krein space \(\mathcal{K}\) is a linear relation with non-empty resolvent \(\rho(A)\) such that \([q(A)x,x]\geq 0\) for some nonzero rational function \(q\) on \(\mathbb C\) with poles in \(\rho(A)\), and all \(x\in \mathcal{K}\). Here, \(q(A)\) is defined by the rational functional calculus for linear relations on Banach spaces. The spectral theorem in this article extends the rational calculus to all bounded measurable functions on the spectrum \(\sigma(A)\) of \(A\) that satisfy a certain regularity condition, which is used to deal with the zeros of \(q\). This allows one to study the spectral projections associated with Borel subsets \(\Delta\subseteq\sigma(A)\) such that \(q^{-1}(\{0\})\cap \partial_{\sigma(A)}\Delta=\emptyset\), using the functional calculus.