diff options
author | Adam Roberts <aroberts@uk.ibm.com> | 2016-06-14 13:59:01 +0100 |
---|---|---|
committer | Sean Owen <sowen@cloudera.com> | 2016-06-14 13:59:01 +0100 |
commit | a431e3f1f8575e2498650ac767e69fbc903e9929 (patch) | |
tree | 63f5b690b9846b104de98d921839f3d1fb983ebe /dev/make-distribution.sh | |
parent | 96c3500c666235f1e746cf17b188930280489d50 (diff) | |
download | spark-a431e3f1f8575e2498650ac767e69fbc903e9929.tar.gz spark-a431e3f1f8575e2498650ac767e69fbc903e9929.tar.bz2 spark-a431e3f1f8575e2498650ac767e69fbc903e9929.zip |
[SPARK-15821][DOCS] Include parallel build info
## What changes were proposed in this pull request?
We should mention that users can build Spark using multiple threads to decrease build times; either here or in "Building Spark"
## How was this patch tested?
Built on machines with between one core to 192 cores using mvn -T 1C and observed faster build times with no loss in stability
In response to the question here https://issues.apache.org/jira/browse/SPARK-15821 I think we should suggest this option as we know it works for Spark and can result in faster builds
Author: Adam Roberts <aroberts@uk.ibm.com>
Closes #13562 from a-roberts/patch-3.
Diffstat (limited to 'dev/make-distribution.sh')
-rwxr-xr-x | dev/make-distribution.sh | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/dev/make-distribution.sh b/dev/make-distribution.sh index 4f7544f6ea..9be4fdfa51 100755 --- a/dev/make-distribution.sh +++ b/dev/make-distribution.sh @@ -53,7 +53,7 @@ while (( "$#" )); do --hadoop) echo "Error: '--hadoop' is no longer supported:" echo "Error: use Maven profiles and options -Dhadoop.version and -Dyarn.version instead." - echo "Error: Related profiles include hadoop-2.2, hadoop-2.3 and hadoop-2.4." + echo "Error: Related profiles include hadoop-2.2, hadoop-2.3, hadoop-2.4, hadoop-2.6 and hadoop-2.7." exit_with_usage ;; --with-yarn) @@ -150,7 +150,7 @@ export MAVEN_OPTS="${MAVEN_OPTS:--Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCac # Store the command as an array because $MVN variable might have spaces in it. # Normal quoting tricks don't work. # See: http://mywiki.wooledge.org/BashFAQ/050 -BUILD_COMMAND=("$MVN" clean package -DskipTests $@) +BUILD_COMMAND=("$MVN" -T 1C clean package -DskipTests $@) # Actually build the jar echo -e "\nBuilding with..." |