MLlib: machine learning in Apache Spark

MaRDI QIDQ2810821zbMATH OpenFDO

Authors Xiangrui Meng, Joseph Bradley, Burak Yavuz, Evan Sparks, Shivaram Venkataraman, Davies Liu, Jeremy Freeman, Db Tsai, Manish Amde, Sean W. Owen, Doris Xin, Reynold Xin, Michael J. Franklin, Reza Zadeh, Matei Zaharia, Ameet Talwalkar

Publication date 6 June 2016

Published in Journal of Machine Learning Research (JMLR) (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1505.06807, http://jmlr.csail.mit.edu/papers/v17/15-237.html

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Recommendations

• Scikit-learn: machine learning in Python
• LIBLINEAR: a library for large linear classification
• LIBOL: a library for online learning algorithms
• scientific article; zbMATH DE number 6276253
• Encog: library of interchangeable machine learning models for Java and C{\#}

Cited in

(32)

• GSA for machine learning problems: a comprehensive overview
• Parametric Gaussian process regression for big data
• A new accelerated proximal boosting machine with convergence rate \(O(1/t^2)\)
• An effective and efficient MapReduce algorithm for computing BFS-based traversals of large-scale RDF graphs
• Java-ML: a machine learning library
• Spark solutions for discovering fuzzy association rules in big data
• Scalable kernel \(k\)-means clustering with Nyström approximation: relative-error bounds
• MLP-ANN-based execution time prediction model and assessment of input parameters through structural modeling
• KATZ centrality with biogeography-based optimization for influence maximization problem
• A three-way cluster ensemble approach for large-scale data
• Scaling up Bayesian variational inference using distributed computing clusters
• Temporal concatenation for Markov decision processes
• Spectral ensemble clustering with doubly stochastic co-association matrix
• Julia language in machine learning: algorithms, applications, and open issues
• Performance Comparison of Machine Learning Platforms
• Widening: using parallel resources to improve model quality
• MLlib
• Large scale implementations for Twitter sentiment classification
• A distributed and incremental SVD algorithm for agglomerative data analysis on large networks
• scientific article; zbMATH DE number 6276253 (Why is no real title available?)
• Genuinely distributed Byzantine machine learning
• Big data time series forecasting based on pattern sequence similarity and its application to the electricity demand
• Distribution policies for Datalog
• Evidential instance selection for \(K\)-nearest neighbor classification of big data
• Love and Hate During Political Campaigns in Social Networks
• Randomized Gradient Boosting Machine
• A distributed ensemble of relevance vector machines for large-scale data sets on Spark
• An experience in using machine learning for short-term predictions in smart transportation systems
• Big data: from collection to visualization
• A greedy feature selection algorithm for big data of high dimensionality
• LIBOL: a library for online learning algorithms
• scientific article; zbMATH DE number 6982986 (Why is no real title available?)

Describes a project that uses

Uses Software

• GitHub
• Apache Spark
• PLANET
• MLbase
• GraphX
• Breeze
• pmml
• Scikit
• Mahout
• NumPy
• MapReduce

This page was built for publication: MLlib: machine learning in Apache Spark

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2810821)