Distributed multinomial regression

DOI10.48550/ARXIV.1311.6139MaRDI QIDQ112152zbMATH OpenFDO

Authors Matt Taddy, Matthew A. Taddy

Publication date 24 November 2013

Published in The Annals of Applied Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1311.6139, https://projecteuclid.org/euclid.aoas/1446488744

zbMATH Keywords

Lassologistic regressioncomputational social sciencedistributed computingmultinomial inverse regressiontext analysis

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Generalized linear models (logistic models) (62J12)

Abstract: This article introduces a model-based approach to distributed computing for multinomial logistic (softmax) regression. We treat counts for each response category as independent Poisson regressions via plug-in estimates for fixed effects shared across categories. The work is driven by the high-dimensional-response multinomial models that are used in analysis of a large number of random counts. Our motivating applications are in text analysis, where documents are tokenized and the token counts are modeled as arising from a multinomial dependent upon document attributes. We estimate such models for a publicly available data set of reviews from Yelp, with text regressed onto a large set of explanatory variables (user, business, and rating information). The fitted models serve as a basis for exploring the connection between words and variables of interest, for reducing dimension into supervised factor scores, and for prediction. We argue that the approach herein provides an attractive option for social scientists and other text analysts who wish to bring familiar regression tools to bear on text data.

Recommendations

• Variable selection in general multinomial logit models
• The negative multinomial logit model
• Distributed Bayesian machine learning procedures
• Optimal subsampling for softmax regression
• scientific article; zbMATH DE number 795293

Cites work

• scientific article; zbMATH DE number 3750093 (Why is no real title available?)
• scientific article; zbMATH DE number 845714 (Why is no real title available?)
• scientific article; zbMATH DE number 3195802 (Why is no real title available?)
• Fisher lecture: Dimension reduction in regression
• Multinomial Inverse Regression for Text Analysis
• On the poisson approximation to the multinomial distribution
• Regression and time series model selection in small samples
• Statistical Analysis of Financial Data in S-Plus
• The Poisson Approximation to the Poisson Binomial Distribution

Cited in

(17)

• scientific article; zbMATH DE number 7370577 (Why is no real title available?)
• Graph-Assisted Inverse Regression for Count Data and Its Application to Sequencing Data
• scientific article; zbMATH DE number 7448088 (Why is no real title available?)
• Distributed prediction from vertically partitioned data
• Topic-adjusted visibility metric for scientific articles
• ADMM-softmax: an ADMM approach for multinomial logistic regression
• A Discussion of “Text Selection”
• Discussion of “Text Selection” by Bryan Kelly, Asaf Manela, and Alan Moreira
• Discussion on “Text Selection”
• Text Selection
• Distributional anchor regression
• textir
• distrom
• Distributed adaptive Huber regression
• Multiclass-penalized logistic regression
• Time-dependent Poisson reduced rank models for political text data analysis
• Distributed Censored Regression Over Networks

This page was built for publication: Distributed multinomial regression

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q112152)