diff options
| author | Kousuke Saruta <sarutak@oss.nttdata.co.jp> | 2014-08-20 13:26:11 -0700 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2014-08-20 13:26:11 -0700 |
| commit | 0ea46ac80089e9091d247704b17afbc423c0060d (patch) | |
| tree | e9f926eb2e96a9dda79d7d0160b65a5297fa0f24 /bin/spark-class | |
| parent | cf46e725814f575ebb417e80d2571bccc6dac4a7 (diff) | |
| download | spark-0ea46ac80089e9091d247704b17afbc423c0060d.tar.gz spark-0ea46ac80089e9091d247704b17afbc423c0060d.tar.bz2 spark-0ea46ac80089e9091d247704b17afbc423c0060d.zip | |
[SPARK-3062] [SPARK-2970] [SQL] spark-sql script ends with IOException when EventLogging is enabled
#1891 was to avoid IOException when EventLogging is enabled.
The solution used ShutdownHookManager but it was defined only Hadoop 2.x. Hadoop 1.x don't have ShutdownHookManager so #1891 doesn't compile on Hadoop 1.x
Now, I had a compromised solution for both Hadoop 1.x and 2.x.
Only for FileLogger, an unique FileSystem object is created.
Author: Kousuke Saruta <sarutak@oss.nttdata.co.jp>
Closes #1970 from sarutak/SPARK-2970 and squashes the following commits:
240c91e [Kousuke Saruta] Merge branch 'master' of git://git.apache.org/spark into SPARK-2970
0e7b45d [Kousuke Saruta] Revert "[SPARK-2970] [SQL] spark-sql script ends with IOException when EventLogging is enabled"
e1262ec [Kousuke Saruta] Modified Filelogger to use unique FileSystem instance
Diffstat (limited to 'bin/spark-class')
0 files changed, 0 insertions, 0 deletions