MLlib: machine learning in Apache Spark

MaRDI QIDQ2810821zbMATH OpenFDO

Authors Xiangrui Meng, Joseph Bradley, Burak Yavuz, Evan Sparks, Shivaram Venkataraman, Davies Liu, Jeremy Freeman, Db Tsai, Manish Amde, Sean W. Owen, Doris Xin, Reynold Xin, Michael J. Franklin, Reza Zadeh, Matei Zaharia, Ameet Talwalkar

Publication date 6 June 2016

Published in Journal of Machine Learning Research (JMLR) (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1505.06807, http://jmlr.csail.mit.edu/papers/v17/15-237.html

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Recommendations

• Scikit-learn: machine learning in Python
• LIBLINEAR: a library for large linear classification
• LIBOL: a library for online learning algorithms
• scientific article; zbMATH DE number 6276253
• Encog: library of interchangeable machine learning models for Java and C{\#}

Cited in

(32)

• Large scale implementations for Twitter sentiment classification
• Big data: from collection to visualization
• An effective and efficient MapReduce algorithm for computing BFS-based traversals of large-scale RDF graphs
• Julia language in machine learning: algorithms, applications, and open issues
• Widening: using parallel resources to improve model quality
• Big data time series forecasting based on pattern sequence similarity and its application to the electricity demand
• MLP-ANN-based execution time prediction model and assessment of input parameters through structural modeling
• Evidential instance selection for \(K\)-nearest neighbor classification of big data
• A distributed ensemble of relevance vector machines for large-scale data sets on Spark
• A new accelerated proximal boosting machine with convergence rate \(O(1/t^2)\)
• Genuinely distributed Byzantine machine learning
• KATZ centrality with biogeography-based optimization for influence maximization problem
• Spark solutions for discovering fuzzy association rules in big data
• A three-way cluster ensemble approach for large-scale data
• Parametric Gaussian process regression for big data
• Scaling up Bayesian variational inference using distributed computing clusters
• MLlib
• A distributed and incremental SVD algorithm for agglomerative data analysis on large networks
• Java-ML: a machine learning library
• LIBOL: a library for online learning algorithms
• scientific article; zbMATH DE number 6982986 (Why is no real title available?)
• Scalable kernel \(k\)-means clustering with Nyström approximation: relative-error bounds
• Randomized Gradient Boosting Machine
• Love and Hate During Political Campaigns in Social Networks
• Temporal concatenation for Markov decision processes
• An experience in using machine learning for short-term predictions in smart transportation systems
• Performance Comparison of Machine Learning Platforms
• scientific article; zbMATH DE number 6276253 (Why is no real title available?)
• Spectral ensemble clustering with doubly stochastic co-association matrix
• A greedy feature selection algorithm for big data of high dimensionality
• Distribution policies for Datalog
• GSA for machine learning problems: a comprehensive overview

Describes a project that uses

Uses Software

• MapReduce
• NumPy
• Scikit
• Mahout
• pmml
• PLANET
• Breeze
• GraphX
• MLbase
• Apache Spark
• GitHub

This page was built for publication: MLlib: machine learning in Apache Spark

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2810821)