Geometrizing rates of convergence under local differential privacy constraints

DOI10.1214/19-AOS1901zbMATH Open1457.62396arXiv1805.01422MaRDI QIDQ2215754FDOQ2215754

Authors: Angelika Rohde, Lukas Steinberger 

Publication date: 14 December 2020

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: We study the problem of estimating a functional $heta(mathbbP)$ of an unknown probability distribution $mathbbPinmathcalP$ in which the original iid sample $X_1,dots,X_n$ is kept private even from the statistician via an $alpha$-local differential privacy constraint. Let $omeg{a}_{TV}$ denote the modulus of continuity of the functional $heta$ over $mathcalP$, with respect to total variation distance. For a large class of loss functions $l$ and a fixed privacy level $alpha$, we prove that the privatized minimax risk is equivalent to $l(omeg{a}_{TV}(n^{-1/2}))$ to within constants, under regularity conditions that are satisfied, in particular, if $heta$ is linear and $mathcalP$ is convex. Our results complement the theory developed by Donoho and Liu (1991) with the nowadays highly relevant case of privatized data. Somewhat surprisingly, the difficulty of the estimation problem in the private case is characterized by $omeg{a}_{TV}$, whereas, it is characterized by the Hellinger modulus of continuity if the original data $X_1,dots,X_n$ are available. We also find that for locally private estimation of linear functionals over a convex model a simple sample mean estimator, based on independently and binary privatized observations, always achieves the minimax rate. We further provide a general recipe for choosing the functional parameter in the optimal binary privatization mechanisms and illustrate the general theory in numerous examples. Our theory allows to quantify the price to be paid for local differential privacy in a large class of estimation problems. This price appears to be highly problem specific.

Full work available at URL: https://arxiv.org/abs/1805.01422

Recommendations

• Privacy aware learning
• Optimal locally private estimation under \(\ell_p\) loss for \(1\le p\le 2\)
• Local differential privacy: elbow effect in optimal density estimation and adaptation over Besov ellipsoids
• Minimax Optimal Procedures for Locally Private Estimation
• Asymptotically Optimal and Private Statistical Estimation
• On density estimation at a fixed point under local differential privacy
• The cost of privacy: optimal rates of convergence for parameter estimation with differential privacy
• Differentially private inference via noisy optimization
• Interactive versus noninteractive locally differentially private estimation: two elbows for the quadratic functional
• Privacy-preserving statistical estimation with optimal convergence rates

zbMATH Keywords

data privacy protectionconstructing rate optimal privatization mechanisms and estimatorsprivate minimax risk

Mathematics Subject Classification ID

Nonparametric estimation (62G05) Density estimation (62G07) Minimax procedures in statistical decision theory (62C20) Functional data analysis (62R10)

Cites Work

• Testing Statistical Hypotheses
• Introduction to nonparametric estimation
• Convergence of estimates under dimensionality restrictions
• Title not available (Why is that?)
• Geometrizing rates of convergence. II
• Randomized response: a survey technique for eliminating evasive answer bias
• Differential Privacy: A Survey of Results
• Theory of Cryptography
• On general minimax theorems
• Optimale Tests und ungünstigste Verteilungen
• Advances in Cryptology – CRYPTO 2004
• Minimax Optimal Procedures for Locally Private Estimation
• A statistical framework for differential privacy
• The Optimal Noise-Adding Mechanism in Differential Privacy
• Privacy-preserving statistical estimation with optimal convergence rates

Cited In (21)

• Optimal locally private estimation under \(\ell_p\) loss for \(1\le p\le 2\)
• On lower bounds for the bias-variance trade-off
• The right complexity measure in locally private estimation: it is not the Fisher information
• On robustness and local differential privacy
• Constrained forms of statistical minimax: computation, communication, and privacy
• Distribution-invariant differential privacy
• Gaussian differentially private robust mean estimation and inference
• Exponential Separations in Local Privacy
• Multivariate density estimation from privatised data: universal consistency and minimax rates
• Phase transitions for support recovery under local differential privacy
• Wasserstein convergence in Bayesian and frequentist deconvolution models
• On density estimation at a fixed point under local differential privacy
• Strongly universally consistent nonparametric regression and classification with privatised data
• Local differential privacy: elbow effect in optimal density estimation and adaptation over Besov ellipsoids
• Nonparametric spectral density estimation under local differential privacy
• The cost of privacy: optimal rates of convergence for parameter estimation with differential privacy
• Efficiency in local differential privacy
• Density estimation under local differential privacy and Hellinger loss
• Interactive versus noninteractive locally differentially private estimation: two elbows for the quadratic functional
• Goodness-of-fit testing for Hölder continuous densities under local differential privacy
• Privacy aware learning

This page was built for publication: Geometrizing rates of convergence under local differential privacy constraints

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2215754)