sparklyr from

dplyr MLib Extensions News Reference

Using sparklyr

Getting Started
Manipulating data
Machine Learning
Understanding Caching
Deployment Options

Guides

Distributed R
Data Lakes
Extend sparklyr
Text mining
Using H2O

Deployment Examples

Standalone cluster (AWS)
YARN cluster (EMR)
Cloudera cluster

Reference

Using sparklyr

Getting Started
Manipulating data
Machine Learning
Understanding Caching
Deployment Options

Guides

Distributed R
Data Lakes
Extend sparklyr
Text mining
Using H2O

Deployment Examples

Standalone cluster (AWS)
YARN cluster (EMR)
Cloudera cluster

Reference

Checkpoint a Spark DataFrame

Arguments

Checkpoint a Spark DataFrame

sdf_checkpoint(x, eager = TRUE)

Arguments

x	an object coercible to a Spark DataFrame
eager	whether to truncate the lineage of the DataFrame