You can use sparklyr::sdf_sql to query tables that you create with SparkR. For example, you can use SparkR::sql to query tables that you create with sparklyr. You can use SQL as a bridge between SparkR and sparklyr. For example, the way you call sparklyr::sdf_quantile differs slightly from the way you call dplyr::percentile_approx, even though both functions calcuate quantiles. At other times, you might be able to complete an operation with just one or two of these packages, and the operation you choose depends on your usage scenario. For example, to run a query, you can call functions such as SparkR::sql, sparklyr::sdf_sql, and dplyr::select. ![]() Note that as you work with SparkR, sparklyr, and dplyr, you may find that you can complete a particular operation with all of these packages, and you can use the package that you are most comfortable with. ![]() ![]() This article describes how to use R packages such as SparkR, sparklyr, and dplyr to work with R ames, Spark DataFrames, and in-memory tables.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |