diff options
| author | Thomas Omans <tomans@cj.com> | 2015-06-04 11:32:03 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-06-04 11:32:03 -0700 |
| commit | cd3176bd86eafa09a5e11baf3636861c1f46e844 (patch) | |
| tree | 457bf57729fdd9b33b450fc2c04c1b1798181b3c /examples | |
| parent | df7da07a86a30c684d5b07d955f1045a66715e3a (diff) | |
| download | spark-cd3176bd86eafa09a5e11baf3636861c1f46e844.tar.gz spark-cd3176bd86eafa09a5e11baf3636861c1f46e844.tar.bz2 spark-cd3176bd86eafa09a5e11baf3636861c1f46e844.zip | |
[SPARK-7743] [SQL] Parquet 1.7
Resolves [SPARK-7743](https://issues.apache.org/jira/browse/SPARK-7743).
Trivial changes of versions, package names, as well as a small issue in `ParquetTableOperations.scala`
```diff
- val readContext = getReadSupport(configuration).init(
+ val readContext = ParquetInputFormat.getReadSupportInstance(configuration).init(
```
Since ParquetInputFormat.getReadSupport was made package private in the latest release.
Thanks
-- Thomas Omans
Author: Thomas Omans <tomans@cj.com>
Closes #6597 from eggsby/SPARK-7743 and squashes the following commits:
2df0d1b [Thomas Omans] [SPARK-7743] [SQL] Upgrading parquet version to 1.7.0
Diffstat (limited to 'examples')
| -rw-r--r-- | examples/src/main/python/parquet_inputformat.py | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/examples/src/main/python/parquet_inputformat.py b/examples/src/main/python/parquet_inputformat.py index 96ddac761d..e1fd85b082 100644 --- a/examples/src/main/python/parquet_inputformat.py +++ b/examples/src/main/python/parquet_inputformat.py @@ -51,7 +51,7 @@ if __name__ == "__main__": parquet_rdd = sc.newAPIHadoopFile( path, - 'parquet.avro.AvroParquetInputFormat', + 'org.apache.parquet.avro.AvroParquetInputFormat', 'java.lang.Void', 'org.apache.avro.generic.IndexedRecord', valueConverter='org.apache.spark.examples.pythonconverters.IndexedRecordToJavaConverter') |