Online AutoML: an adaptive AutoML framework for online learning

DOI10.1007/S10994-022-06262-0arXiv2201.09750OpenAlexW4310917384MaRDI QIDQ6174489FDOQ6174489

Authors: Bilge Celik, Prabhant Singh, Joaquin Vanschoren 

Publication date: 14 July 2023

Published in: Machine Learning (Search for Journal in Brave)

Abstract: Automated Machine Learning (AutoML) has been used successfully in settings where the learning task is assumed to be static. In many real-world scenarios, however, the data distribution will evolve over time, and it is yet to be shown whether AutoML techniques can effectively design online pipelines in dynamic environments. This study aims to automate pipeline design for online learning while continuously adapting to data drift. For this purpose, we design an adaptive Online Automated Machine Learning (OAML) system, searching the complete pipeline configuration space of online learners, including preprocessing algorithms and ensembling techniques. This system combines the inherent adaptation capabilities of online learners with the fast automated pipeline (re)optimization capabilities of AutoML. Focusing on optimization techniques that can adapt to evolving objectives, we evaluate asynchronous genetic programming and asynchronous successive halving to optimize these pipelines continually. We experiment on real and artificial data streams with varying types of concept drift to test the performance and adaptation capabilities of the proposed system. The results confirm the utility of OAML over popular online learning algorithms and underscore the benefits of continuous pipeline redesign in the presence of data drift.

Full work available at URL: https://arxiv.org/abs/2201.09750

Recommendations

• An adaptive online machine learning method based on a robust optimal control approach
• Adaptive online sequential extreme learning machine for dynamic modeling
• Automated adaptation strategies for stream learning
• Adaptive and self-confident on-line learning algorithms
• A survey of algorithms and analysis for adaptive online learning
• A new online learning algorithm for structure-adjustable extreme learning machine
• Approximation vector machines for large-scale online learning
• A unified framework of online learning algorithms for training recurrent neural networks

zbMATH Keywords

concept driftautomated drift adaptationautomated online learningonline AutoML

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Cites Work

• Title not available (Why is that?)
• On evaluating stream learning algorithms
• A survey on concept drift adaptation
• Advances in Artificial Intelligence – SBIA 2004
• Incremental learning with partial instance memory
• Characterizing concept drift
• Automated adaptation strategies for stream learning

Cited In (1)

• AutonoML: Towards an Integrated Framework for Autonomous Machine Learning

This page was built for publication: Online AutoML: an adaptive AutoML framework for online learning

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6174489)