Gaussianity and typicality in matrix distributional semantics

DOI10.4171/AIHPD/112MaRDI QIDQ2124251zbMATH OpenFDO

Authors Sanjaye Ramgoolam, Mehrnoosh Sadrzadeh, Lewis Sword

Publication date 19 April 2022

Published in Annales de l'Institut Henri Poincaré D. Combinatorics, Physics and their Interactions (AIHPD) (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1912.10839

zbMATH Keywords

distributional semanticsquantum field theoryrandom matrix theorystatistics

Mathematics Subject Classification ID

Software, source code, etc. for problems pertaining to statistics (62-04) Computational methods for problems pertaining to statistics (62-08) Finite-dimensional groups and algebras motivated by physics and their representations (81R05)

Review text

Summary: Constructions in type-driven compositional distributional semantics associate large collections of matrices of size \(D\) to linguistic corpora. We develop the proposal of analysing the statistical characteristics of this data in the framework of permutation invariant matrix models. The observables in this framework are permutation invariant polynomial functions of the matrix entries, which correspond to directed graphs. Using the general 13-parameter permutation invariant Gaussian matrix models recently solved, we find, using a dataset of matrices constructed via standard techniques in distributional semantics, that the expectation values of a large class of cubic and quartic observables show high Gaussianity at levels between 90 to 99 percent. Beyond expectation values, which are averages over words, the dataset allows the computation of standard deviations for each observable, which can be viewed as a measure of typicality for each observable. There is a wide range of magnitudes in the measures of typicality. The permutation invariant matrix models, considered as functions of random couplings, give a very good prediction of the magnitude of the typicality for different observables. We find evidence that observables with similar matrix model characteristics of Gaussianity and typicality also have high degrees of correlation between the ranked lists of words associated to these observables.

Cites work

• A Brownian-Motion Model for the Eigenvalues of a Random Matrix
• A vector space model for automatic indexing
• An SYK-like model without disorder
• Characteristic vectors of bordered matrices with infinite dimensions
• Exact correlators of giant gravitons from dual N=4 SYM theory.
• scientific article; zbMATH DE number 6296862 (Why is no real title available?)
• scientific article; zbMATH DE number 3310083 (Why is no real title available?)
• Invasion of the giant gravitons from anti-de Sitter space
• Lambek vs. Lambek: functorial vector space semantics and string diagrams for Lambek calculus
• Linguistic matrix theory
• Multimodal distributional semantics
• Permutation invariant Gaussian matrix models
• Sentence entailment in compositional distributional semantics
• The large N limit of superconformal field theories and supergravity
• The Mathematics of Sentence Structure

Cited in

(7)

• Hidden symmetries and large \(N\) factorisation for permutation invariant matrix observables
• Gaussianity and typicality in matrix distributional semantics
• Gauged permutation invariant matrix quantum mechanics: path integrals
• Permutation invariant Gaussian matrix models for financial correlation matrices
• Gauged permutation invariant matrix quantum mechanics: partition functions
• Permutation invariant matrix quantum thermodynamics and negative specific heat capacities in large N systems
• Permutation invariant tensor models and partition algebras

Describes a project that uses

Uses Software

• word2vec

This page was built for publication: Gaussianity and typicality in matrix distributional semantics

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2124251)