sparklyr

swMATH19334CRANsparklyrMaRDI QIDQ31162

R Interface to Apache Spark

Javier Luraschi, Lu Wang, Hossein Falaki, the Apache Software Foundation, Edgar Ruiz, Yitao Li, Andy Zhang, Kevin Kuo, Kevin Ushey, Jj Allaire

Last update: 30 October 2023

Copyright license: Apache License, Version 2.0, File License

Software version identifier: 1.8.1, 0.4, 0.5.1, 0.5.2, 0.5.3, 0.5.4, 0.5.5, 0.5.6, 0.5, 0.6.0, 0.6.1, 0.6.2, 0.6.3, 0.6.4, 0.7.0, 0.8.0, 0.8.1, 0.8.2, 0.8.3, 0.8.4, 0.9.1, 0.9.2, 0.9.3, 0.9.4, 1.0.0, 1.0.1, 1.0.2, 1.0.3, 1.0.4, 1.0.5, 1.1.0, 1.2.0, 1.3.0, 1.3.1, 1.4.0, 1.5.0, 1.5.1, 1.5.2, 1.6.0, 1.6.1, 1.6.2, 1.6.3, 1.7.0, 1.7.1, 1.7.2, 1.7.3, 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.7.8, 1.7.9, 1.8.0, 1.8.2, 1.8.3, 1.8.4

Source code repository: https://github.com/cran/sparklyr

Description

R interface to Apache Spark, a fast and general engine for big data processing, see <https://spark.apache.org/>. This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.