sparklyr

MaRDI QIDQ31162swMATHCRANFDO

Authors Kevin Kuo, Yitao Li, Edgar Ruiz, Javier Luraschi, Kevin Ushey, Jj Allaire, Hossein Falaki, Lu Wang, Andy Zhang, the Apache Software Foundation, The Apache Software Foundation

Last update 5 October 2026

Copyright license Apache License, Version 2.0, File License

Software version identifier 1.8.1, 0.4, 0.5.1, 0.5.2, 0.5.3, 0.5.4, 0.5.5, 0.5.6, 0.5, 0.6.0, 0.6.1, 0.6.2, 0.6.3, 0.6.4, 0.7.0, 0.8.0, 0.8.1, 0.8.2, 0.8.3, 0.8.4, 0.9.1, 0.9.2, 0.9.3, 0.9.4, 1.0.0, 1.0.1, 1.0.2, 1.0.3, 1.0.4, 1.0.5, 1.1.0, 1.2.0, 1.3.0, 1.3.1, 1.4.0, 1.5.0, 1.5.1, 1.5.2, 1.6.0, 1.6.1, 1.6.2, 1.6.3, 1.7.0, 1.7.1, 1.7.2, 1.7.3, 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.7.8, 1.7.9, 1.8.0, 1.8.2, 1.8.3, 1.8.4, PACKAGES.rds, 1.8.5, 1.8.6, 1.9.0, 1.9.1, 1.9.2, 1.9.3, 1.9.4, 1.9.5, 1.9.6

Official website https://cran.r-project.org/web/packages/sparklyr/index.html

Source code repository https://github.com/cran/sparklyr

Description

R interface to Apache Spark, a fast and general engine for big data processing, see <https://spark.apache.org/>. This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.

Cited in

(35)

• sparklyr.flint
• sparkwarc
• shinyML
• sparkxgb
• WR
• geospark
• rsparkling
• sparkavro
• sparkhail
• sparkbq
• variantspark
• sparktf
• graphframes
• Rfit
• RCaller
• Modern data science with R
• PoisBinOrdNor
• hybridHclust
• RHIPE
• SparkR
• rslurm
• sdols
• profileR
• Kubernetes
• WINS
• pysparklyr
• pathling
• apache.sedona
• bigMICE
• stddiff.spark
• rollup
• spark.sas7bdat
• sparklyr.nested
• catalog
• s3.resourcer

This page was built for software: sparklyr