Spectral analysis in Krein spaces (Q1812541)

Let \({\mathfrak K}\) be a Krein space with symmetry \(J\). A Tomita triangular representation of a bounded unitary operator \(U\) in \({\mathfrak K}\) is a matrix representation \[ U=\begin{pmatrix} U_{11} & U_{12} & U_{13} \\ 0 & U_{22} & U_{23} \\ 0 & 0 & U_{33} \end{pmatrix}, \] where \(U_{11}\), \(U_{33}\) act in neutral subspaces, and \(U_{22}\) is unitary with respect to some pre-Hilbert inner product (quasi-\(J\)-spectral). The main result of the paper is the following statement: A bounded \(J\)- unitary \(U\) has a Tomita triangular matrix representation if and only if \(U\) has an invariant maximal nonnegative subspace. This generalizes a result obtained previously by the author [same journal 22, No. 4, 637-658 (1986; Zbl 0618.46027)]. The problem of the existence of an invariant maximal nonnegative subspace for a commutative Lorentz algebra is also considered. Two open problems concerning quasi-\(J\)-spectrality of a bounded \(J\)-unitary operator are formulated.