diff options
| author | CodingCat <zhunansjtu@gmail.com> | 2014-03-18 11:06:18 -0700 |
|---|---|---|
| committer | Matei Zaharia <matei@databricks.com> | 2014-03-18 11:06:18 -0700 |
| commit | 2fa26ec02fc2251102f89bb67523419fd7dd3757 (patch) | |
| tree | 8963dc4db1a27e23279236abf0d971defa2e94d0 /streaming | |
| parent | e7423d4040ebd1ec4105d8d4b9a4a6600b18c2ac (diff) | |
| download | spark-2fa26ec02fc2251102f89bb67523419fd7dd3757.tar.gz spark-2fa26ec02fc2251102f89bb67523419fd7dd3757.tar.bz2 spark-2fa26ec02fc2251102f89bb67523419fd7dd3757.zip | |
SPARK-1102: Create a saveAsNewAPIHadoopDataset method
https://spark-project.atlassian.net/browse/SPARK-1102
Create a saveAsNewAPIHadoopDataset method
By @mateiz: "Right now RDDs can only be saved as files using the new Hadoop API, not as "datasets" with no filename and just a JobConf. See http://codeforhire.com/2014/02/18/using-spark-with-mongodb/ for an example of how you have to give a bogus filename. For the old Hadoop API, we have saveAsHadoopDataset."
Author: CodingCat <zhunansjtu@gmail.com>
Closes #12 from CodingCat/SPARK-1102 and squashes the following commits:
6ba0c83 [CodingCat] add test cases for saveAsHadoopDataSet (new&old API)
a8d11ba [CodingCat] style fix.........
95a6929 [CodingCat] code clean
7643c88 [CodingCat] change the parameter type back to Configuration
a8583ee [CodingCat] Create a saveAsNewAPIHadoopDataset method
Diffstat (limited to 'streaming')
0 files changed, 0 insertions, 0 deletions