Network cross-validation by edge sampling

DOI10.48550/ARXIV.1612.04717MaRDI QIDQ159623zbMATH OpenOpenAlexWikidataFDO

Authors Tianxi Li, Elizaveta Levina, Tianxi Li, Ji Zhu

Publication date 14 December 2016

Published in Biometrika (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1612.04717

zbMATH Keywords

cross-validationedge samplingmodel selectionnetwork cross-validationparameter tuningrandom network

Mathematics Subject Classification ID

Sampling theory, sample surveys (62D05)

Abstract: While many statistical models and methods are now available for network analysis, resampling network data remains a challenging problem. Cross-validation is a useful general tool for model selection and parameter tuning, but is not directly applicable to networks since splitting network nodes into groups requires deleting edges and destroys some of the network structure. Here we propose a new network resampling strategy based on splitting node pairs rather than nodes applicable to cross-validation for a wide range of network model selection tasks. We provide a theoretical justification for our method in a general setting and examples of how our method can be used in specific network model selection and parameter tuning tasks. Numerical results on simulated networks and on a citation network of statisticians show that this cross-validation approach works well for model selection.

Recommendations

• Cross-validation with confidence
• Network cross-validation for determining the number of communities in network data
• A survey of cross-validation procedures for model selection
• Cross-validation for selecting a model selection procedure
• Using the bootstrap for statistical inference on random graphs

Cited in

(80)

• randnet
• A statistical framework for modern network science
• Extended stochastic block models with application to criminal networks
• Overlapping community detection in networks via sparse spectral decomposition
• Identifiability and parameter estimation of the overlapped stochastic co-block model
• Unfolding-model-based visualization: theory, method and applications
• Determining the number of communities in degree-corrected stochastic block models
• Edge sampling using local network information
• Exponential-Family Embedding With Application to Cell Developmental Trajectories for Single-Cell RNA-Seq Data
• Detecting overlapping communities in networks using spectral methods
• Randomized Spectral Clustering in Large-Scale Stochastic Block Models
• Hierarchical Community Detection by Recursive Partitioning
• Asymptotic Theory of Eigenvectors for Random Matrices With Diverging Spikes
• Subsampling spectral clustering for stochastic block models in large-scale networks
• On the efficacy of higher-order spectral clustering under weighted stochastic block models
• Community Detection in General Hypergraph Via Graph Embedding
• Optimal Estimation of the Number of Network Communities
• Consistent Estimation of the Number of Communities via Regularized Network Embedding
• Fast Network Community Detection With Profile-Pseudo Likelihood Methods
• Directed Community Detection With Network Embedding
• Universal rank inference via residual subsampling with application to large networks
• Compressed spectral screening for large-scale differential correlation analysis with application in selecting glioblastoma gene modules
• Bias-Adjusted Spectral Clustering in Multi-Layer Stochastic Block Models
• Stock co-jump networks
• Entrywise limit theorems for eigenvectors of signal-plus-noise matrix models with weak signals
• Link Prediction for Egocentrically Sampled Networks
• Consistent estimation of the number of communities in stochastic block models using cross-validation
• Fallacy of data-selective inference in modelling networks
• Community detection in attributed collaboration network for statisticians
• Special invited paper: the SCORE normalization, especially for heterogeneous network and text data
• Two-sample test of stochastic block models
• GBTM: community detection and network reconstruction for noisy and time-evolving data
• Community detection in complex networks: from statistical foundations to data science applications
• Spectral co-clustering in multi-layer directed networks
• On the Estimation of the Number of Communities for Sparse Networks
• PCABM: Pairwise Covariates-Adjusted Block Model for Community Detection
• Network Estimation by Mixing: Adaptivity and More
• Hypothesis testing for equality of latent positions in random graphs
• Two-sample test of stochastic block models via the maximum sampling entry-wise deviation
• Applications of dual regularized Laplacian matrix for community detection
• Regularized joint maximum likelihood estimation of latent space item response models
• Moran's I Lasso for models with spatially correlated data
• Network Varying Coefficient Model
• Entrywise splitting cross-validation in generalized factor models: from sample splitting to entrywise splitting
• Bootstrap-based statistical inference on the eigenvalues of weighted networks
• Consistent community detection approach in the nonparametric weighted stochastic blockmodel with unspecified number of communities
• Network Embedding-based Directed Community Detection with Unknown Community Number
• A Latent Space Model for Weighted Keyword Co-Occurrence Networks with Applications in Knowledge Discovery in Statistics
• Network embedding for bipartite networks with applications in interlocking directorates in Chinese companies
• Perfect spectral clustering with discrete covariates
• Community extraction of network data under stochastic block models
• Network Goodness-of-Fit for the Block-Model Family
• Joint Spectral Clustering in Multilayer Degree-Corrected Stochastic Blockmodels
• Local bootstrap for network data
• Randomized spectral clustering for large-scale multi-layer networks
• Semiparametric modeling and analysis for longitudinal network data
• A spike-and-slab prior for dimension selection in generalized linear network eigenmodels
• Model-Based Co-Clustering in Customer Targeting Utilizing Large-Scale Online Product Rating Networks
• Lost in the shuffle: testing power in the presence of errorful network vertex labels
• Variational inference for the latent shrinkage position model
• Identifying peer influence in therapeutic communities adjusting for latent homophily
• Community detection in stochastic block models via penalized variational estimation
• Co-Factor Analysis of Citation Networks
• Stochastic Block Smooth Graphon Model
• On Inference for Modularity Statistics in Structured Networks
• Estimating network-mediated causal effects via principal components network regression
• Exploratory analysis of dynamic networks using latent functions
• Bootstrapping networks with latent space structure
• Reduced Rank Spatio-Temporal Models
• Subsampling-based modified Bayesian information criterion for large-scale stochastic block models
• On Optimal Tracking of Structural Changes in Time-Varying Networks
• Dynamic clustering for heterophilic stochastic block models with time-varying node memberships
• Simultaneous Estimation of Connectivity and Dimensionality in Samples of Networks
• Perturbation-robust predictive modeling of social effects by network subspace generalized linear models
• A goodness-of-fit test for sparse networks
• Community detection in stochastic block models via fused variational estimation
• Goodness-of-fit test for latent block models
• Community detection via an efficient nonconvex optimization approach based on modularity
• Estimating the number of communities by spectral methods
• Adjusted chi-square test for degree-corrected block models

This page was built for publication: Network cross-validation by edge sampling

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q159623)