diff options
author | Josh Rosen <joshrosen@databricks.com> | 2015-05-15 18:06:01 -0700 |
---|---|---|
committer | Patrick Wendell <patrick@databricks.com> | 2015-05-15 18:06:01 -0700 |
commit | 2c04c8a1aed34cce420b3d30d9e885daa6e03d74 (patch) | |
tree | fc851d926b416a96ef4313e616afbfa409d4aab1 /python/pyspark | |
parent | e74545647684b3047248ca3cfee894ac5378dead (diff) | |
download | spark-2c04c8a1aed34cce420b3d30d9e885daa6e03d74.tar.gz spark-2c04c8a1aed34cce420b3d30d9e885daa6e03d74.tar.bz2 spark-2c04c8a1aed34cce420b3d30d9e885daa6e03d74.zip |
[SPARK-7563] OutputCommitCoordinator.stop() should only run on the driver
This fixes a bug where an executor that exits can cause the driver's OutputCommitCoordinator to stop. To fix this, we use an `isDriver` flag and check it in `stop()`.
See https://issues.apache.org/jira/browse/SPARK-7563 for more details.
Author: Josh Rosen <joshrosen@databricks.com>
Closes #6197 from JoshRosen/SPARK-7563 and squashes the following commits:
04b2cc5 [Josh Rosen] [SPARK-7563] OutputCommitCoordinator.stop() should only be executed on the driver
Diffstat (limited to 'python/pyspark')
0 files changed, 0 insertions, 0 deletions