aboutsummaryrefslogtreecommitdiff
path: root/pom.xml
diff options
context:
space:
mode:
authorTathagata Das <tathagata.das1565@gmail.com>2015-05-12 16:44:14 -0700
committerTathagata Das <tathagata.das1565@gmail.com>2015-05-12 16:44:14 -0700
commit00e7b09a0bee2fcfd0ce34992bd26435758daf26 (patch)
tree1faf35f02885eb775eb75999e524c4ece7be98d4 /pom.xml
parent96c4846db89802f5a81dca5dcfa3f2a0f72b5cb8 (diff)
downloadspark-00e7b09a0bee2fcfd0ce34992bd26435758daf26.tar.gz
spark-00e7b09a0bee2fcfd0ce34992bd26435758daf26.tar.bz2
spark-00e7b09a0bee2fcfd0ce34992bd26435758daf26.zip
[SPARK-7553] [STREAMING] Added methods to maintain a singleton StreamingContext
In a REPL/notebook environment, its very easy to lose a reference to a StreamingContext by overriding the variable name. So if you happen to execute the following commands ``` val ssc = new StreamingContext(...) // cmd 1 ssc.start() // cmd 2 ... val ssc = new StreamingContext(...) // accidentally run cmd 1 again ``` The value of ssc will be overwritten. Now you can neither start the new context (as only one context can be started), nor stop the previous context (as the reference is lost). Hence its best to maintain a singleton reference to the active context, so that we never loose reference for the active context. Since this problem occurs useful in REPL environments, its best to add this as an Experimental support in the Scala API only so that it can be used in Scala REPLs and notebooks. Author: Tathagata Das <tathagata.das1565@gmail.com> Closes #6070 from tdas/SPARK-7553 and squashes the following commits: 731c9a1 [Tathagata Das] Fixed style a797171 [Tathagata Das] Added more unit tests 19fc70b [Tathagata Das] Added :: Experimental :: in docs 64706c9 [Tathagata Das] Fixed test 634db5d [Tathagata Das] Merge remote-tracking branch 'apache-github/master' into SPARK-7553 3884a25 [Tathagata Das] Fixing test bug d37a846 [Tathagata Das] Added getActive and getActiveOrCreate
Diffstat (limited to 'pom.xml')
0 files changed, 0 insertions, 0 deletions