diff options
| author | Eric Liang <ekl@databricks.com> | 2016-07-06 16:30:25 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-07-06 16:30:25 -0700 |
| commit | 44c7c62bcfca74c82ffc4e3c53997fff47bfacac (patch) | |
| tree | 1df3ded3e2e962bedde1c71dc051c30844b80091 /project | |
| parent | b8ebf63c1e1fa1ab53ea760fa293051c08ce5f59 (diff) | |
| download | spark-44c7c62bcfca74c82ffc4e3c53997fff47bfacac.tar.gz spark-44c7c62bcfca74c82ffc4e3c53997fff47bfacac.tar.bz2 spark-44c7c62bcfca74c82ffc4e3c53997fff47bfacac.zip | |
[SPARK-16021] Fill freed memory in test to help catch correctness bugs
## What changes were proposed in this pull request?
This patches `MemoryAllocator` to fill clean and freed memory with known byte values, similar to https://github.com/jemalloc/jemalloc/wiki/Use-Case:-Find-a-memory-corruption-bug . Memory filling is flag-enabled in test only by default.
## How was this patch tested?
Unit test that it's on in test.
cc sameeragarwal
Author: Eric Liang <ekl@databricks.com>
Closes #13983 from ericl/spark-16021.
Diffstat (limited to 'project')
| -rw-r--r-- | project/SparkBuild.scala | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/project/SparkBuild.scala b/project/SparkBuild.scala index b1a9f39342..c769ba300e 100644 --- a/project/SparkBuild.scala +++ b/project/SparkBuild.scala @@ -825,6 +825,7 @@ object TestSettings { javaOptions in Test += "-Dspark.testing=1", javaOptions in Test += "-Dspark.port.maxRetries=100", javaOptions in Test += "-Dspark.master.rest.enabled=false", + javaOptions in Test += "-Dspark.memory.debugFill=true", javaOptions in Test += "-Dspark.ui.enabled=false", javaOptions in Test += "-Dspark.ui.showConsoleProgress=false", javaOptions in Test += "-Dspark.unsafe.exceptionOnMemoryLeak=true", |