Learning Linear Dynamical Systems with Semi-Parametric Least Squares

arXiv1902.00768MaRDI QIDQ6313489FDOQ6313489

Authors: Max Simchowitz, Ross Boczar, Benjamin Recht 

Publication date: 2 February 2019

Abstract: We analyze a simple prefiltered variation of the least squares estimator for the problem of estimation with biased, semi-parametric noise, an error model studied more broadly in causal statistics and active learning. We prove an oracle inequality which demonstrates that this procedure provably mitigates the variance introduced by long-term dependencies. We then demonstrate that prefiltered least squares yields, to our knowledge, the first algorithm that provably estimates the parameters of partially-observed linear systems that attains rates which do not not incur a worst-case dependence on the rate at which these dependencies decay. The algorithm is provably consistent even for systems which satisfy the weaker marginal stability condition obeyed by many classical models based on Newtonian mechanics. In this context, our semi-parametric framework yields guarantees for both stochastic and worst-case noise.

Has companion code repository: https://github.com/zhengy09/SysId

This page was built for publication: Learning Linear Dynamical Systems with Semi-Parametric Least Squares

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6313489)