Learning explanatory rules from noisy data
From MaRDI portal
Abstract: Artificial Neural Networks are powerful function approximators capable of modelling solutions to a wide variety of problems, both supervised and unsupervised. As their size and expressivity increases, so too does the variance of the model, yielding a nearly ubiquitous overfitting problem. Although mitigated by a variety of model regularisation methods, the common cure is to seek large amounts of training data---which is not necessarily easily obtained---that sufficiently approximates the data distribution of the domain we wish to test on. In contrast, logic programming methods such as Inductive Logic Programming offer an extremely data-efficient process by which models can be trained to reason on symbolic domains. However, these methods are unable to deal with the variety of domains neural networks can be applied to: they are not robust to noise in or mislabelling of inputs, and perhaps more importantly, cannot be applied to non-symbolic domains where the data is ambiguous, such as operating on raw pixels. In this paper, we propose a Differentiable Inductive Logic framework, which can not only solve tasks which traditional ILP systems are suited for, but shows a robustness to noise and error in the training data which ILP cannot cope with. Furthermore, as it is trained by backpropagation against a likelihood objective, it can be hybridised by connecting it with neural networks over ambiguous data in order to be applied to domains which ILP cannot address, while providing data efficiency and generalisation beyond what neural networks on their own can achieve.
Recommendations
- A comparative study of three neural-symbolic approaches to inductive logic programming
- First-Order Logical Neural Networks
- Neural probabilistic logic programming in DeepProbLog
- Generating rules with predicates, terms and variables from the pruned neural networks
- Artificial nonmonotonic neural networks
Cited in
(41)- Top program construction and reduction for polynomial time meta-interpretive learning
- Learning programs by learning from failures
- Analyzing differentiable fuzzy logic operators
- Beyond graph neural networks with lifted relational neural networks
- Meta-interpretive learning as metarule specialisation
- Injecting domain knowledge in neural networks: a controlled experiment on a constrained problem
- Learning from interpretation transition using differentiable logic programming semantics
- Inductive logic programming at 30
- Logical reduction of metarules
- Inductive general game playing
- Semiring programming: a semantic framework for generalized sum product problems
- Making sense of sensory input
- Neural probabilistic logic programming in DeepProbLog
- Making sense of raw input
- Logic tensor networks
- A comparative study of three neural-symbolic approaches to inductive logic programming
- scientific article; zbMATH DE number 1706377 (Why is no real title available?)
- Learning Optimal Decision Sets and Lists with SAT
- Learning temporal causal sequence relationships from real-time time-series
- Learning logic programs by explaining their failures
- FFNSL: Feed-forward neural-symbolic learner
- \(\alpha\)ILP: thinking visual scenes as differentiable logic programs
- Learning programs with magic values
- Rule Induction and Reasoning over Knowledge Graphs
- Neural logic rule layers
- From statistical relational to neurosymbolic artificial intelligence: a survey
- A differentiable first-order rule learner for inductive logic programming
- Synergies between machine learning and reasoning -- an introduction by the Kay R. Amel group
- Explainable and interpretable machine learning and data mining
- Reinforcement learning meets logic programming: towards explainable AI
- Boolean matrix logic programming for active learning of gene functions in genome-scale metabolic network models
- Learning answer set programs with aggregates via sampling and genetic programming
- Inductive learning of robot task knowledge from raw data and online expert feedback
- Towards unbiased exploration in partial label learning
- Learning differentiable logic programs for abstract visual reasoning
- NeST: the neuro-symbolic transpiler
- A semantic framework for neurosymbolic computation
- Learning guided automated reasoning: a brief survey
- From monotonic graph neural networks to Datalog and back: expressive power and practical applications
- An empirical comparison of cost functions in inductive logic programming
- Symbols and neurons: a review of symbolic XAI in deep learning
This page was built for publication: Learning explanatory rules from noisy data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4605199)
