diff options
| author | carlmartin <carlmartinmax@gmail.com> | 2014-12-17 12:24:03 -0800 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2014-12-17 12:24:03 -0800 |
| commit | 4782def094fc5b5030a944290d2301f887f77a02 (patch) | |
| tree | bce13b18100ebf8ab6e8209aa9f4509a35e88a9a /sql/catalyst | |
| parent | 5fdcbdc0c9f91be9380b09643a5db0f96c673ce8 (diff) | |
| download | spark-4782def094fc5b5030a944290d2301f887f77a02.tar.gz spark-4782def094fc5b5030a944290d2301f887f77a02.tar.bz2 spark-4782def094fc5b5030a944290d2301f887f77a02.zip | |
[SPARK-4694]Fix HiveThriftServer2 cann't stop In Yarn HA mode.
HiveThriftServer2 can not exit automactic when changing the standy resource manager in Yarn HA mode.
The scheduler backend was aware of the AM had been exited so it call sc.stop to exit the driver process but there was a user thread(HiveThriftServer2 ) which was still alive and cause this problem.
To fix it, make a demo thread to detect the sparkContext is null or not.If the sc is stopped, call the ThriftServer.stop to stop the user thread.
Author: carlmartin <carlmartinmax@gmail.com>
Closes #3576 from SaintBacchus/ThriftServer2ExitBug and squashes the following commits:
2890b4a [carlmartin] Use SparkListener instead of the demo thread to stop the hive server.
c15da0e [carlmartin] HiveThriftServer2 can not exit automactic when changing the standy resource manager in Yarn HA mode
Diffstat (limited to 'sql/catalyst')
0 files changed, 0 insertions, 0 deletions