diff options
| author | Burak Yavuz <brkyvz@gmail.com> | 2017-03-03 10:35:15 -0800 |
|---|---|---|
| committer | Shixiong Zhu <shixiong@databricks.com> | 2017-03-03 10:35:15 -0800 |
| commit | 9314c08377cc8da88f4e31d1a9d41376e96a81b3 (patch) | |
| tree | 04bfe9cc2d2aa9601113a9b04a2095cf27cf5913 /docs/security.md | |
| parent | 37a1c0e461737d4a4bbb03d397b651ec5ba00e96 (diff) | |
| download | spark-9314c08377cc8da88f4e31d1a9d41376e96a81b3.tar.gz spark-9314c08377cc8da88f4e31d1a9d41376e96a81b3.tar.bz2 spark-9314c08377cc8da88f4e31d1a9d41376e96a81b3.zip | |
[SPARK-19774] StreamExecution should call stop() on sources when a stream fails
## What changes were proposed in this pull request?
We call stop() on a Structured Streaming Source only when the stream is shutdown when a user calls streamingQuery.stop(). We should actually stop all sources when the stream fails as well, otherwise we may leak resources, e.g. connections to Kafka.
## How was this patch tested?
Unit tests in `StreamingQuerySuite`.
Author: Burak Yavuz <brkyvz@gmail.com>
Closes #17107 from brkyvz/close-source.
Diffstat (limited to 'docs/security.md')
0 files changed, 0 insertions, 0 deletions