Managing caching strategies for stream reasoning with reinforcement learning

DOI10.1017/S147106842000037XzbMATH Open1468.68152arXiv2008.03212OpenAlexW3088052656MaRDI QIDQ5140004FDOQ5140004

Authors: Carmine Dodaro, Thomas Eiter, Paul Ogris, Konstantin Schekotihin 

Publication date: 13 December 2020

Published in: Theory and Practice of Logic Programming (Search for Journal in Brave)

Abstract: Efficient decision-making over continuously changing data is essential for many application domains such as cyber-physical systems, industry digitalization, etc. Modern stream reasoning frameworks allow one to model and solve various real-world problems using incremental and continuous evaluation of programs as new data arrives in the stream. Applied techniques use, e.g., Datalog-like materialization or truth maintenance algorithms to avoid costly re-computations, thus ensuring low latency and high throughput of a stream reasoner. However, the expressiveness of existing approaches is quite limited and, e.g., they cannot be used to encode problems with constraints, which often appear in practice. In this paper, we suggest a novel approach that uses the Conflict-Driven Constraint Learning (CDCL) to efficiently update legacy solutions by using intelligent management of learned constraints. In particular, we study the applicability of reinforcement learning to continuously assess the utility of learned constraints computed in previous invocations of the solving algorithm for the current one. Evaluations conducted on real-world reconfiguration problems show that providing a CDCL algorithm with relevant learned constraints from previous iterations results in significant performance improvements of the algorithm in stream reasoning scenarios. Under consideration for acceptance in TPLP.

Full work available at URL: https://arxiv.org/abs/2008.03212

Recommendations

• A distributed approach to LARS stream reasoning (system paper)
• Ticker: a system for incremental ASP-based stream reasoning
• Rule-based Stream Reasoning for Intelligent Administration of Content-Centric Networks
• Prediction and explanation over DL-Lite data streams
• Incremental reasoning on monadic second-order logics with logic programming

zbMATH Keywords

reinforcement learningASPstream reasoningcaching strategies

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05) Problem solving in the context of artificial intelligence (heuristics, search strategies, etc.) (68T20) Online algorithms; streaming algorithms (68W27)

Cites Work

• XSB: extending Prolog with tabled logic programming
• Advances in WASP
• Multi-shot ASP solving with clingo
• Optimization Methods for the Partner Units Problem
• Reinforcement learning. An introduction
• Efficient SAT solving under assumptions
• LARS: a logic-based framework for analytic reasoning over streams
• Asymptotically efficient allocation rules for the multiarmed bandit problem with multiple plays-Part I: I.I.D. rewards
• Rule-based Stream Reasoning for Intelligent Administration of Content-Centric Networks
• Ticker: a system for incremental ASP-based stream reasoning
• Complexity of \(n\)-queens completion
• Incremental answer set programming with overgrounding
• A distributed approach to LARS stream reasoning (system paper)

Cited In (2)

• Ticker: a system for incremental ASP-based stream reasoning
• A distributed approach to LARS stream reasoning (system paper)

Uses Software

• Glucose
• WASP
• Clingo
• XSB
• LARS

This page was built for publication: Managing caching strategies for stream reasoning with reinforcement learning

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5140004)