An analytic solution to the Busemann-Petty problem on sections of convex bodies (Q1293373)

Let \(K\) be an origin-symmetric star body in \(\mathbb R^n\) with \(C^\infty\) boundary, and let \(k\in\mathbb N \cup\{0\}, k\neq n - 1.\) Suppose that \(\xi\in S^{n-1},\) and let \(A_\xi\) be the corresponding parallel section function of \(K.\) The function \(A_\xi\) (or \((n - 1)\)-dimensional \(X\)-ray) gives the (\((n - 1)\)-dimensional) volumes of all hyperplane sections of the body orthogonal to a given direction. The authors derive a formula connecting the derivatives of \(A_\xi\) with the Fourier transform (in the sense of distributions) of powers \((\rho_K^{n-k-1})^\wedge\) of the radial function \(\rho_K\) of the body: \[ (\rho_K^{n-k-1})^\wedge(\xi) =\begin{cases} (-1)^{k/2}\pi(n - k - 1)A_\xi^{(k)}(0),&\text{if \(k\) is even,}\\ c_k\int_0^\infty\frac{A_\xi(z)-A_\xi(0)- A_\xi''(0)\frac{z^2}{2}-\dots-A_\xi^{(k-1)}(0)\frac{z^{k-1}}{(k-1)! }} {z^{k+1}} dz,& \text{if \(k\) is odd,} \end{cases} \] where \(c_k=(-1)^{(k+1)/2}2(n-1-k)k!.\) This formula provides a new characterization of intersection bodies in \(\mathbb R^n\) and leads to a unified analytic solution to the Busemann-Petty problem: If the section function of a centered convex body in \(\mathbb R^n\), \(n\geq 3,\) is smaller than that of another such body, is its volume also smaller? In conjunction with earlier established connections between the Busemann-Petty problem, intersection bodies, and positive definite distributions, this formula shows that the answer to the problem depends on the behavior of the \((n - 2)\)-nd derivative of the parallel section functions. The affirmative answer to the Busemann-Petty problem for \(n \leq 4\) and the negative answer for \(n\geq 5\) now follow from the fact that convexity controls the second derivatives, but does not control the derivatives of higher orders.