Unitary boundary pairs for isometric operators in Pontryagin spaces and generalized coresolvents (Q2657315)

Let \(V\) be a closed isometric operator (or relation) in a Pontryagin space \(\mathcal{H}\).An operator-valued function \(\mathbb{K}_{\lambda}\), holomorphic in a domain \(\mathrm{O} \subseteq \{\lambda \in \mathbb{C} : |\lambda|< 1\}\) with values in \(B(\mathcal{H})\), is called a \textit{generalized coresolvent} of an isometric operator \(V\) if there exist a Pontryagin space \(\widetilde{\mathcal{H}}\supseteq \mathcal{H}\) and a unitary operator \(\widetilde{V}\) in \(\widetilde{\mathcal{H}}\), an extension of \(V\) , such that \(\mathrm{O} \subseteq \rho (\widetilde{V}^{-1})\) and \[ \mathbb{K}_{\lambda} = P_{\mathcal{H}}(I_{\widetilde{\mathcal{H}}} - \lambda \widetilde{V})^{-1} \mid\mathcal{H} , \lambda \in \mathrm{O} \] where \(P_{\mathcal{H}}\) is the orthogonal projection from \(\widetilde{\mathcal{H}}\) onto \(\mathcal{H}\). The extension theory and the theory of generalized coresolvents of different classes of isometric operators in Krein spaces was built earlier and there was used a notion of a boundary triple. The methods used in the paper under review rely on a new general notion of boundary pairs introduced for isometric operators in a Pontryagin space setting. Namely, given \(V\) on \(\mathcal{H}\) and Hilbert spaces \(\mathcal{L}_{1}\) , \(\mathcal{L}_{2}\) , the authors equip the Hilbert spaces \(\mathcal{H}^{2}\) and \(\mathcal{L} = \mathcal{L}_{1} \times \mathcal{L}_{2}\) with the indefinite inner products by the formulas \[ [ \widehat{f}, \widehat{g}]_{\mathcal{H}^{2}} =(J_{\mathcal{H}^{2}}\widehat{f},\widehat{g})_{\mathcal{H}^{2}} ,\qquad [\widehat{u},\widehat{v}]_{\mathcal{L}} = (J_{\mathcal{L}} \widehat{u}, \widehat{v})_{\mathcal{L}} \] where \quad \(\widehat{f},\widehat{g}\in \mathcal{H}^{2}\),\qquad \(\widehat{u}, \widehat{v}\in\mathcal{L} \) \qquad and \[ J_{\mathcal{H}^{2}}=\left(\begin{array}{cc}J_{\mathcal{H} }&0\\ 0&-J_{\mathcal{H} }\end{array}\right),\qquad J_{\mathcal{L} }=\left(\begin{array}{cc}J_{\mathcal{L}_{1} } &0\\ 0 &-J_{\mathcal{L}_{2} } \end{array}\right) \] Then the pair \(( \mathcal{L} , \Gamma) \) is called a unitary boundary pair for \(V\) if a linear relation \(\Gamma :\mathcal{H}^{2} \longrightarrow \mathcal{L}\) is unitary and \(\ker \Gamma = V\) (a Green identity is satisfied and \(\Gamma\) is maximal in an appropriate sense ). It is shown, how a certain subclass of unitary boundary pairs is connected to unitary colligations and that the Weyl functions associated with that subclass actually coincide with characteristic functions of the corresponding unitary colligations. Using some skillful transformations it is also shown that every operator valued generalized Schur function (not necessarily holomorphic at the origin) can still be realized as the Weyl function of some unitary boundary pair for an isometric operator \(V\) in a Pontryagin space.These characteristic results on unitary boundary pairs and their Weyl function for isometric operators allow to authors study spectral properties of proper extensions of \(V\) and find a formula for their canonical coresolvents, to prove an analog of Krein formula for the generalized coresolvents of the isometric operator.