diff options
| author | Uri Laserson <laserson@cloudera.com> | 2014-09-27 21:48:05 -0700 |
|---|---|---|
| committer | Matei Zaharia <matei@databricks.com> | 2014-09-27 21:48:05 -0700 |
| commit | 248232936e1bead7f102e59eb8faf3126c582d9d (patch) | |
| tree | 8bee3f6fd2ba42230777a5a10ed47deb8f6863b1 /examples/src/main/resources | |
| parent | 5b922bb458e863f5be0ae68167de882743f70b86 (diff) | |
| download | spark-248232936e1bead7f102e59eb8faf3126c582d9d.tar.gz spark-248232936e1bead7f102e59eb8faf3126c582d9d.tar.bz2 spark-248232936e1bead7f102e59eb8faf3126c582d9d.zip | |
[SPARK-3389] Add Converter for ease of Parquet reading in PySpark
https://issues.apache.org/jira/browse/SPARK-3389
Author: Uri Laserson <laserson@cloudera.com>
Closes #2256 from laserson/SPARK-3389 and squashes the following commits:
0ed363e [Uri Laserson] PEP8'd the python file
0b4b380 [Uri Laserson] Moved converter to examples and added python example
eecf4dc [Uri Laserson] [SPARK-3389] Add Converter for ease of Parquet reading in PySpark
Diffstat (limited to 'examples/src/main/resources')
| -rw-r--r-- | examples/src/main/resources/full_user.avsc | 1 | ||||
| -rw-r--r-- | examples/src/main/resources/users.parquet | bin | 0 -> 615 bytes |
2 files changed, 1 insertions, 0 deletions
diff --git a/examples/src/main/resources/full_user.avsc b/examples/src/main/resources/full_user.avsc new file mode 100644 index 0000000000..04e7ba2dca --- /dev/null +++ b/examples/src/main/resources/full_user.avsc @@ -0,0 +1 @@ +{"type": "record", "namespace": "example.avro", "name": "User", "fields": [{"type": "string", "name": "name"}, {"type": ["string", "null"], "name": "favorite_color"}, {"type": {"items": "int", "type": "array"}, "name": "favorite_numbers"}]}
\ No newline at end of file diff --git a/examples/src/main/resources/users.parquet b/examples/src/main/resources/users.parquet Binary files differnew file mode 100644 index 0000000000..aa527338c4 --- /dev/null +++ b/examples/src/main/resources/users.parquet |