diff options
| author | Kousuke Saruta <sarutak@oss.nttdata.co.jp> | 2015-02-06 09:39:12 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-02-06 09:39:12 +0000 |
| commit | 24dbc50b934bfcd9fc3fd91cfd9966b75b250ad7 (patch) | |
| tree | 6fedc5c910679215d71fdebf55f198fe642d3547 /bin/pyspark.cmd | |
| parent | f6ba813af21f8aa277155b789a7330e356ce15da (diff) | |
| download | spark-24dbc50b934bfcd9fc3fd91cfd9966b75b250ad7.tar.gz spark-24dbc50b934bfcd9fc3fd91cfd9966b75b250ad7.tar.bz2 spark-24dbc50b934bfcd9fc3fd91cfd9966b75b250ad7.zip | |
[SPARK-5157][YARN] Configure more JVM options properly when we use ConcMarkSweepGC for AM.
When we set `SPARK_USE_CONC_INCR_GC`, ConcurrentMarkSweepGC works on the AM.
Actually, if ConcurrentMarkSweepGC is set for the JVM, following JVM options are set automatically and implicitly.
* MaxTenuringThreshold=0
* SurvivorRatio=1024
Those can not be proper value for most cases.
See also http://www.oracle.com/technetwork/java/tuning-139912.html
Author: Kousuke Saruta <sarutak@oss.nttdata.co.jp>
Closes #3956 from sarutak/SPARK-5157 and squashes the following commits:
c15da4e [Kousuke Saruta] Set more JVM options for AM when enabling CMS
Diffstat (limited to 'bin/pyspark.cmd')
0 files changed, 0 insertions, 0 deletions