diff options
| author | Matei Zaharia <matei@databricks.com> | 2014-05-19 18:42:28 -0700 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2014-05-19 18:42:28 -0700 |
| commit | 5af99d7617ba3b9fbfdb345ef9571b7dd41f45a1 (patch) | |
| tree | 2d0e90945da59eaa5df41221027c365a823895bf /bin/spark-class2.cmd | |
| parent | 1811ba8ccb580979aa2e12019e6a82805f09ab53 (diff) | |
| download | spark-5af99d7617ba3b9fbfdb345ef9571b7dd41f45a1.tar.gz spark-5af99d7617ba3b9fbfdb345ef9571b7dd41f45a1.tar.bz2 spark-5af99d7617ba3b9fbfdb345ef9571b7dd41f45a1.zip | |
SPARK-1879. Increase MaxPermSize since some of our builds have many classes
See https://issues.apache.org/jira/browse/SPARK-1879 -- builds with Hadoop2 and Hive ran out of PermGen space in spark-shell, when those things added up with the Scala compiler.
Note that users can still override it by setting their own Java options with this change. Their options will come later in the command string than the -XX:MaxPermSize=128m.
Author: Matei Zaharia <matei@databricks.com>
Closes #823 from mateiz/spark-1879 and squashes the following commits:
6bc0ee8 [Matei Zaharia] Increase MaxPermSize to 128m since some of our builds have lots of classes
Diffstat (limited to 'bin/spark-class2.cmd')
| -rwxr-xr-x | bin/spark-class2.cmd | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/bin/spark-class2.cmd b/bin/spark-class2.cmd index 266edd9fa9..e420eb409e 100755 --- a/bin/spark-class2.cmd +++ b/bin/spark-class2.cmd @@ -77,8 +77,8 @@ rem All drivers use SPARK_JAVA_OPTS + SPARK_DRIVER_MEMORY. The repl also uses SP ) rem Set JAVA_OPTS to be able to load native libraries and to set heap size -set JAVA_OPTS=%OUR_JAVA_OPTS% -Djava.library.path=%SPARK_LIBRARY_PATH% -Xms%OUR_JAVA_MEM% -Xmx%OUR_JAVA_MEM% -rem Attention: when changing the way the JAVA_OPTS are assembled, the change must be reflected in ExecutorRunner.scala! +set JAVA_OPTS=-XX:MaxPermSize=128m %OUR_JAVA_OPTS% -Djava.library.path=%SPARK_LIBRARY_PATH% -Xms%OUR_JAVA_MEM% -Xmx%OUR_JAVA_MEM% +rem Attention: when changing the way the JAVA_OPTS are assembled, the change must be reflected in CommandUtils.scala! rem Test whether the user has built Spark if exist "%FWDIR%RELEASE" goto skip_build_test |