Sentence entailment in compositional distributional semantics

DOI10.1007/S10472-017-9570-XzbMATH Open1459.03030arXiv1512.04419OpenAlexW3101885140MaRDI QIDQ722091FDOQ722091

Dimitri Kartsaklis, Mehrnoosh Sadrzadeh, Esma Balkır

Publication date: 20 July 2018

Published in: Annals of Mathematics and Artificial Intelligence (Search for Journal in Brave)

Abstract: Distributional semantic models provide vector representations for words by gathering co-occurrence frequencies from corpora of text. Compositional distributional models extend these from words to phrases and sentences. In categorical compositional distributional semantics, phrase and sentence representations are functions of their grammatical structure and representations of the words therein. In this setting, grammatical structures are formalised by morphisms of a compact closed category and meanings of words are formalised by objects of the same category. These can be instantiated in the form of vectors or density matrices. This paper concerns the applications of this model to phrase and sentence level entailment. We argue that entropy-based distances of vectors and density matrices provide a good candidate to measure word-level entailment, show the advantage of density matrices over vectors for word level entailments, and prove that these distances extend compositionally from words to phrases and sentences. We exemplify our theoretical constructions on real data and a toy entailment dataset and provide preliminary experimental evidence.

Full work available at URL: https://arxiv.org/abs/1512.04419

Recommendations

• Distributional sentence entailment using density matrices
• Towards logical negation for compositional distributional semantics
• Distributional Semantics
• Entailments with sentential predicates

zbMATH Keywords

entropydensity matricesentailmentcompositional distributional semanticsdistributional inclusion hypothesisdistributional semantics

Mathematics Subject Classification ID

Logic of natural languages (03B65) Categorical semantics of formal languages (18C50) Natural language processing (68T50)

Cites Work

• Dagger compact closed categories and completely positive maps (extended abstract)
• Categories for the Practising Physicist
• Title not available (Why is that?)
• A vector space model for automatic indexing
• Title not available (Why is that?)
• Coherence for compact closed categories
• Similarity-based models of word cooccurrence probabilities
• Distributional Sentence Entailment Using Density Matrices
• A Compositional Distributional Inclusion Hypothesis
• Similarity of Semantic Relations
• A Frobenius Model of Information Structure in Categorical Compositional Distributional Semantics
• Open System Categorical Quantum Semantics in Natural Language Processing
• A generalised quantifier theory of natural language in categorical compositional distributional semantics with bialgebras
• The Frobenius anatomy of word meanings I: subject and object relative pronouns
• The Frobenius anatomy of word meanings II: possessive relative pronouns
• Type grammars as pregroups
• Sentence entailment in compositional distributional semantics

Cited In (13)

• Quantum computations for disambiguation and question answering
• Title not available (Why is that?)
• Title not available (Why is that?)
• Gaussianity and typicality in matrix distributional semantics
• Linguistic matrix theory
• Sentence entailment in compositional distributional semantics
• Quantum Mathematics in Artificial Intelligence
• Title not available (Why is that?)
• Title not available (Why is that?)
• Putting a spin on language: a quantum interpretation of unary connectives for linguistic applications
• Quantum natural language processing on near-term quantum computers
• QNLP in Practice: Running Compositional Models of Meaning on a Quantum Computer
• A Compositional Distributional Inclusion Hypothesis

This page was built for publication: Sentence entailment in compositional distributional semantics

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q722091)