The group inverse of the transformation \(\mathcal{S}(X)=AX-XB\) (Q1355223)

The Sylvester transformation \({\mathcal S}(X)=AX-XB\) is considered, where \(A\in \mathbb{C}^{M\times M}\) and \(B\in \mathbb{C}^{N\times N}\) are given matrices. The existence of the group inverse \({\mathcal S}^\#\) is assumed and studied. At first the invertible case is dealt with. Some known results are given to motivate the approach for the noninvertible case. A Bézoutian-like representation of the coefficient matrix \(C\) and Hankel matrices are presented for the projection onto the kernel of \(\mathcal S\) along its range. The group inverse for the special case of the commutator, i.e. for \(A=B\), and the derived Hankel matrices are discussed. Open questions concerning this class are formulated. The formulas for the coefficient matrix \(C\) of the group inverse of the Sylvester transformation are presented. The Lyapunov transformation \({\mathcal L}(x)=AX-XA^*\) is specified.