Optimal weighted least-squares methods

Nonparametric estimation (62G05) Approximations to statistical distributions (nonasymptotic) (62E17) Multidimensional problems (41A63) Approximation by polynomials (41A10) Algorithms for approximation of functions (65D15) Least squares and related methods for stochastic control systems (93E24) Rate of convergence, degree of approximation (41A25)

Abstract: We consider the problem of reconstructing an unknown bounded function

u

defined on a domain

X s u b s e t m a t h b b R^{d}

from noiseless or noisy samples of

u

at

n

points

(x^{i})_{i = 1, d o t s, n}

. We measure the reconstruction error in a norm

L^{2} (X, d h o)

for some given probability measure

d h o

. Given a linear space

V_{m}

with

m d i m (V_{m}) = m l e q n

, we study in general terms the weighted least-squares approximations from the spaces

V_{m}

based on independent random samples. The contribution of the present paper is twofold. From the theoretical perspective, we establish results in expectation and in probability for weighted least squares in general approximation spaces

V_{m}

. These results show that for an optimal choice of sampling measure

d m u

and weight

w

, which depends on the space

V_{m}

and on the measure

d h o

, stability and optimal accuracy are achieved under the mild condition that

n

scales linearly with

m

up to an additional logarithmic factor. The present analysis covers also cases where the function

u

and its approximants from

V_{m}

are unbounded, which might occur for instance in the relevant case where

X = m a t h b b R^{d}

and

d h o

is the Gaussian measure. From the numerical perspective, we propose a sampling method which allows one to generate independent and identically distributed samples from the optimal measure

d m u

. This method becomes of interest in the multivariate setting where

d m u

is generally not of tensor product type. We illustrate this for particular examples of approximation spaces

V_{m}

of polynomial type, where the domain

X

is allowed to be unbounded and high or even infinite dimensional, motivated by certain applications to parametric and stochastic PDEs.

Recommendations

Cites work

Cited in

(93)

This page was built for publication: Optimal weighted least-squares methods

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4967355)