Branching laws of unitary representations associated to minimal elliptic orbits for indefinite orthogonal group \(O(p,q)\) (Q2042020)

Let \(\Pi\) be certain irreducible unitary representation of \(O(p, q)\) which is attached to the minimal elliptic coadjoint orbit. Let \(G'=O(p', q')\times O(p'', q'')\) with \(p'+p''=p\) and \(q'+q''=q\). The main result of the paper, namely Theorem 1.1, proves that \[ \dim_{\mathbb{C}} \Hom_{G'}(\pi, \Pi|_{G'})\leq 1, \] where \(\Hom_{G'}( , )\) stands for the space continuous \(G'\)-homomorphisms, and \(\pi\) runs over all the irreducible unitary representations of \(G'\). Moreover, the theorem further determines which \(\pi\) does occur in the restriction \(\Pi|_{G'}\).