Qualitative theory of a third-order nonlinear system with examples in population dynamics and chemical kinetics (Q1068022)

The author studies the system \(\dot x=f(x,y,z)\), \(\dot y=g(x,y,z)\), \(\dot z=h(y,z)\). It is assumed that f,g,h are twice continuously differentiable, B is a positively invariant set, \(f_ x\leq 0\), \(f_ y\geq 0\), \(f_ z<0\), \(g_ x>0\), \(g_ y\leq 0\), \(g_ z\geq 0\), \(h_ y>0\), \(h_ z\leq 0\) on B; there is a unique equilibrium \((x_ 0,y_ 0,z_ 0)\) in the interior of B such that if (x,y,z) is a limit point of a trajectory in B and \(f(x,y,z)=g(x,y,z)=h(y,z)=0\) then \((x,y,z)=(x_ 0,y_ 0,z_ 0)\), \((x_ 0,y_ 0,z_ 0)\) is unstable with a two- dimensional unstable manifold U on which solution trajectories near the equilibrium spiral outward, and \[ \lim_{x\to - \infty}g(x,y,z)<0<\lim_{x\to \infty}g(x,y,z),\lim_{y\to - \infty}h\quad (y,z)<0<\lim_{y\to \infty}h(y,z). \] It is proved that all nontrivial solutions on U approach the same periodic orbit as \(t\to \infty\). In another result it is proved that all solutions are unbounded. A number of illustrations are discussed from models in genetic feedback, enzyme kinetics, predator-prey interactions, and species competition.