diff options
| author | Tathagata Das <tathagata.das1565@gmail.com> | 2015-05-07 00:24:44 -0700 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-05-07 00:24:44 -0700 |
| commit | 01187f59b3d118495b6cfea965690829b99a36fa (patch) | |
| tree | 30e3e582fb40096c7bf6eda09119dace1f2e5e66 /python/pyspark/sql/dataframe.py | |
| parent | cfdadcbd2b529cd9ac721509a7ebafe436afcd8d (diff) | |
| download | spark-01187f59b3d118495b6cfea965690829b99a36fa.tar.gz spark-01187f59b3d118495b6cfea965690829b99a36fa.tar.bz2 spark-01187f59b3d118495b6cfea965690829b99a36fa.zip | |
[SPARK-7217] [STREAMING] Add configuration to control the default behavior of StreamingContext.stop() implicitly calling SparkContext.stop()
In environments like notebooks, the SparkContext is managed by the underlying infrastructure and it is expected that the SparkContext will not be stopped. However, StreamingContext.stop() calls SparkContext.stop() as a non-intuitive side-effect. This PR adds a configuration in SparkConf that sets the default StreamingContext stop behavior. It should be such that the existing behavior does not change for existing users.
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #5929 from tdas/SPARK-7217 and squashes the following commits:
869a763 [Tathagata Das] Changed implementation.
685fe00 [Tathagata Das] Added configuration
Diffstat (limited to 'python/pyspark/sql/dataframe.py')
0 files changed, 0 insertions, 0 deletions