diff options
| author | Bryn Keller <bryn.keller@intel.com> | 2014-02-24 17:35:22 -0800 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-02-24 17:35:22 -0800 |
| commit | 4d880304867b55a4f2138617b30600b7fa013b14 (patch) | |
| tree | e12558c8dd11d830ac783afbd2b2234b65ab7e60 /docs/tuning.md | |
| parent | d8d190efd2d08c3894b20f6814b10f9ca2157309 (diff) | |
| download | spark-4d880304867b55a4f2138617b30600b7fa013b14.tar.gz spark-4d880304867b55a4f2138617b30600b7fa013b14.tar.bz2 spark-4d880304867b55a4f2138617b30600b7fa013b14.zip | |
For outputformats that are Configurable, call setConf before sending data to them.
[SPARK-1108] This allows us to use, e.g. HBase's TableOutputFormat with PairRDDFunctions.saveAsNewAPIHadoopFile, which otherwise would throw NullPointerException because the output table name hasn't been configured.
Note this bug also affects branch-0.9
Author: Bryn Keller <bryn.keller@intel.com>
Closes #638 from xoltar/SPARK-1108 and squashes the following commits:
7e94e7d [Bryn Keller] Import, comment, and format cleanup per code review
7cbcaa1 [Bryn Keller] For outputformats that are Configurable, call setConf before sending data to them. This allows us to use, e.g. HBase TableOutputFormat, which otherwise would throw NullPointerException because the output table name hasn't been configured
Diffstat (limited to 'docs/tuning.md')
0 files changed, 0 insertions, 0 deletions