Groups of triangular automorphisms of a free associative algebra and a polynomial algebra. (Q1938552)

Let \(C_n\) be either the polynomial algebra \(K[x_1,\dots,x_n]\) or the free associative algebra \(K\langle x_1,\dots,x_n\rangle\) over a field \(K\) of characteristic 0. In the paper under review the authors study the structure of the group \(T_n\) of triangular automorphisms of \(C_n\). Clearly \(T_n\) is isomorphic to the semidirect product \(U_n\leftthreetimes D_n\), where \(U_n\) is the group of unitriangular automorphisms (defined by \(x_i\to x_i+f_i(x_{i+1},\dots,x_n)\), \(i=1,\dots,n\)) and \(D_n\) is the diagonal group (\(x_i\to\alpha_ix_i\), \(\alpha_i\in K^*\)). Hence for the understanding of \(T_n\) it is sufficient to describe \(U_n\). The authors show that \(U_n=(\cdots(G_1\leftthreetimes G_2)\cdots)\leftthreetimes G_n\), where \(G_i\) is the Abelian group of the automorphisms of the form \(x_i\to x_i+f_i(x_{i+1},\dots,x_n)\), \(x_j\to x_j\), \(j\neq i\). Then they describe the lower central series of \(U_n\) (and show that \(\gamma_2(U_n)=\gamma_3(U_n)=\cdots\)) and the derived series: \(U_n=(\cdots(G_1\leftthreetimes G_2)\cdots)\leftthreetimes G_n\), \(U_n'=(\cdots(G_1\leftthreetimes G_2)\cdots)\leftthreetimes G_{n-1}\), \(\dots\), \(U_n^{(n-1)}=G_1\), \(U_n^{(n)}=1\). (The solvability of \(U_n\) was established by \textit{V. A. Roman'kov, I. V. Chirkov} and \textit{M. A. Shevelin} [Sib. Mat. Zh. 45, No. 5, 1184-1188 (2004); translation in Sib. Math. J. 45, No. 5, 974-977 (2004; Zbl 1059.17004)].) Then the authors show that every element of the commutator subgroup \(U_n'\) is a commutator. The group \(U_n\), \(n\geq 2\), does not contain proper subgroups of finite index (and hence is not residually finite). The authors combine this with the classical result of \textit{A. I. Mal'tsev} [Mat. Sb., N. Ser. 28(70), 567-588 (1951; Zbl 0043.02301)] that a solvable linear group has a subgroup of finite index whose commutator group is nilpotent. In this way they derive that \(U_n\) is not linear for \(n\geq 3\). The authors go further and give an example of a countable nonlinear subgroup of \(U_3\). \textit{U. U. Umirbaev} [J. Reine Angew. Math. 600, 203-235 (2006; Zbl 1132.14051); J. Algebra 314, No. 1, 209-225 (2007; Zbl 1132.17002)] found a system of generators and defining relations for the automorphism groups of free algebras in Nielsen-Schreier varieties and of the tame automorphism group of \(K[x_1,x_2,x_3]\) (and a system of generators for the tame automorphisms of \(K[x_1,\dots,x_n]\)). In the present paper the authors give a system of generators for the tame automorphism group of \(K[x_1,\dots,x_n]\) which is simpler than the generating system of Umirbaev. Further the authors study the subgroups of \(U_n\) generated by two elementary automorphisms and show that they are either free of rank 2 or metabelian, or Abelian. Finally, the paper deals with elements of finite order in \(U_n\). In particular, it contains a new proof of the fact that if every involution (i.e., an automorphism of multiplicative order 2) in the automorphism group of the polynomial algebra in \(n\) variables is conjugated to a linear automorphism, then this implies the cancellation conjecture: If \(R\) is a finitely generated commutative \(K\)-algebra and \(R[z]\cong K[x_1,\dots,x_{n-1},y]\), then \(R\cong K[x_1,\dots,x_{n-1}]\). A list of interesting open problems is scattered in the paper.