Fast moment-based estimation for hierarchical models

DOI10.1111/RSSB.12165zbMATH Open1414.62186arXiv1504.04941OpenAlexW1878934793MaRDI QIDQ5378164FDOQ5378164

Authors: Patrick O. Perry 

Publication date: 12 June 2019

Published in: Journal of the Royal Statistical Society Series B: Statistical Methodology (Search for Journal in Brave)

Abstract: Hierarchical models allow for heterogeneous behaviours in a population while simultaneously borrowing estimation strength across all subpopulations. Unfortunately, existing likelihood-based methods for fitting hierarchical models have high computational demands, and these demands have limited their adoption in large-scale prediction and inference problems. This paper proposes a moment-based procedure for estimating the parameters of a hierarchical model which has its roots in a method originally introduced by Cochran in 1937. The method trades statistical efficiency for computational efficiency. It gives consistent parameter estimates, competitive prediction error performance, and substantial computational improvements. When applied to a large-scale recommender system application and compared to a standard maximum likelihood procedure, the method delivers competitive prediction performance while reducing the sequential computation time from hours to minutes.

Full work available at URL: https://arxiv.org/abs/1504.04941

Recommendations

• Fitting a deeply nested hierarchical model to a large book review dataset using a moment-based estimator
• Fast moment estimation for generalized latent Dirichlet models
• Estimation and inference for very large linear mixed effects models
• Calculating the accuracy of hierarchical estimation
• scientific article; zbMATH DE number 1843511

zbMATH Keywords

hierarchical modelrecommender systemsgeneralized inner mixed modelstatistical-computational trade-off

Mathematics Subject Classification ID

Estimation in multivariate analysis (62H12) Generalized linear models (logistic models) (62J12) Empirical decision procedures; empirical Bayes procedures (62C12)

Cited In (13)

• Structured Shrinkage Priors
• A regression tree method for longitudinal and clustered data with multivariate responses
• Additive and multiplicative effects network models
• Asynchronous and Distributed Data Augmentation for Massive Data Settings
• Sufficiency Revisited: Rethinking Statistical Algorithms in the Big Data Era
• Properties of h‐Likelihood Estimators in Clustered Data
• Fitting a deeply nested hierarchical model to a large book review dataset using a moment-based estimator
• An Asynchronous Distributed Expectation Maximization Algorithm for Massive Data: The DEM Algorithm
• A distributed and integrated method of moments for high-dimensional correlated data analysis
• Enhanced Laplace approximation
• An algorithm for distributed Bayesian inference
• Scalable Bayes via barycenter in Wasserstein space
• Distributed Bayesian Inference in Linear Mixed-Effects Models

This page was built for publication: Fast moment-based estimation for hierarchical models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5378164)