Radial symmetry and monotonicity of solutions to a system involving fractional \(p\)-Laplacian in a ball (Q1629148)

Summary: In this paper, we study a nonlinear system involving the fractional \(p\)-Laplacian in a unit ball and establish the radial symmetry and monotonicity of its positive solutions. By using the direct method of moving planes, we prove the following result. For \(0 < s, t < 1, p > 0\), if \(u\) and \(v\) satisfy the following nonlinear system \(\left\{\left(-\Delta\right)_p^s u \left(x\right) = f \left(v \left(x\right)\right); \left(-\Delta\right)_p^t v \left(x\right) = g \left(u \left(x\right)\right), x \in B_1 \left(0\right); u \left(x\right), v \left(x\right) = 0, x \notin B_1 \left(0\right) .\right\}\) and \(f, g\) are nonnegative continuous functions satisfying the following: (i) \(f(r)\) and \(g(r)\) are increasing for \(r > 0\); (ii) \(f^{\prime}(r) / r^{p - 2}\), \(g^{\prime}(r) / r^{p - 2}\) are bounded near \(r = 0\). Then the positive solutions \((u, v)\) must be radially symmetric and monotone decreasing about the origin.