diff options
| author | Tim Ellison <t.p.ellison@gmail.com> | 2015-05-08 14:08:52 -0700 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-05-08 14:08:58 -0700 |
| commit | 31da40dfeeeab69ee7974992328e3f67046ad3da (patch) | |
| tree | 422d42210d30e3484160c68de3727b6701150109 /core | |
| parent | 4e7360e12dc71c2391764e3596a7971b4d9d7bfc (diff) | |
| download | spark-31da40dfeeeab69ee7974992328e3f67046ad3da.tar.gz spark-31da40dfeeeab69ee7974992328e3f67046ad3da.tar.bz2 spark-31da40dfeeeab69ee7974992328e3f67046ad3da.zip | |
[MINOR] Defeat early garbage collection of test suite variable
The JVM is free to collect references to variables that no longer participate in a computation. This simple patch adds an operation to the variable 'rdd' to ensure it is not collected early in the test suite's explicit calls to GC.
ref: http://bugs.java.com/view_bug.do?bug_id=6721588
Author: Tim Ellison <t.p.ellison@gmail.com>
Closes #6010 from tellison/master and squashes the following commits:
77d1c8f [Tim Ellison] Defeat early garbage collection of test suite variable by aggressive JVMs
Diffstat (limited to 'core')
| -rw-r--r-- | core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala b/core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala index c7868ddcf7..cb30e1f4e6 100644 --- a/core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala +++ b/core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala @@ -183,6 +183,7 @@ class ContextCleanerSuite extends ContextCleanerSuiteBase { } // Test that GC causes shuffle cleanup after dereferencing the RDD + rdd.count() // Defeat any early collection of rdd variable by the JVM val postGCTester = new CleanerTester(sc, shuffleIds = Seq(0)) rdd = null // Make RDD out of scope, so that corresponding shuffle goes out of scope runGC() |