diff options
| author | Burak Yavuz <brkyvz@gmail.com> | 2015-08-04 18:20:12 -0700 |
|---|---|---|
| committer | Shivaram Venkataraman <shivaram@cs.berkeley.edu> | 2015-08-04 18:20:12 -0700 |
| commit | c9a4c36d052456c2dd1f7e0a871c6b764b5064d2 (patch) | |
| tree | 63a219ba9757343f09e22caf975dc864d066aaa4 /R/install-dev.sh | |
| parent | a7fe48f68727d5c0247698cff329fb12faff1d50 (diff) | |
| download | spark-c9a4c36d052456c2dd1f7e0a871c6b764b5064d2.tar.gz spark-c9a4c36d052456c2dd1f7e0a871c6b764b5064d2.tar.bz2 spark-c9a4c36d052456c2dd1f7e0a871c6b764b5064d2.zip | |
[SPARK-8313] R Spark packages support
shivaram cafreeman Could you please help me in testing this out? Exposing and running `rPackageBuilder` from inside the shell works, but for some reason, I can't get it to work during Spark Submit. It just starts relaunching Spark Submit.
For testing, you may use the R branch with [sbt-spark-package](https://github.com/databricks/sbt-spark-package). You can call spPackage, and then pass the jar using `--jars`.
Author: Burak Yavuz <brkyvz@gmail.com>
Closes #7139 from brkyvz/r-submit and squashes the following commits:
0de384f [Burak Yavuz] remove unused imports 2
d253708 [Burak Yavuz] removed unused imports
6603d0d [Burak Yavuz] addressed comments
4258ffe [Burak Yavuz] merged master
ddfcc06 [Burak Yavuz] added zipping test
3a1be7d [Burak Yavuz] don't zip
77995df [Burak Yavuz] fix URI
ac45527 [Burak Yavuz] added zipping of all libs
e6bf7b0 [Burak Yavuz] add println ignores
1bc5554 [Burak Yavuz] add assumes for tests
9778e03 [Burak Yavuz] addressed comments
b42b300 [Burak Yavuz] merged master
ffd134e [Burak Yavuz] Merge branch 'master' of github.com:apache/spark into r-submit
d867756 [Burak Yavuz] add apache header
eff5ba1 [Burak Yavuz] ready for review
8838edb [Burak Yavuz] Merge branch 'master' of github.com:apache/spark into r-submit
e5b5a06 [Burak Yavuz] added doc
bb751ce [Burak Yavuz] fix null bug
0226768 [Burak Yavuz] fixed issues
8810beb [Burak Yavuz] R packages support
Diffstat (limited to 'R/install-dev.sh')
| -rwxr-xr-x | R/install-dev.sh | 4 |
1 files changed, 0 insertions, 4 deletions
diff --git a/R/install-dev.sh b/R/install-dev.sh index 4972bb9217..59d98c9c7a 100755 --- a/R/install-dev.sh +++ b/R/install-dev.sh @@ -42,8 +42,4 @@ Rscript -e ' if("devtools" %in% rownames(installed.packages())) { library(devtoo # Install SparkR to $LIB_DIR R CMD INSTALL --library=$LIB_DIR $FWDIR/pkg/ -# Zip the SparkR package so that it can be distributed to worker nodes on YARN -cd $LIB_DIR -jar cfM "$LIB_DIR/sparkr.zip" SparkR - popd > /dev/null |