diff options
| author | Michael Armbrust <michael@databricks.com> | 2014-11-14 12:00:08 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2014-11-14 12:00:08 -0800 |
| commit | 77e845ca7726ffee2d6f8e33ea56ec005dde3874 (patch) | |
| tree | f562516ace6d891f2455d453559db67b7bc3b4f7 /python/pyspark/context.py | |
| parent | e421072da0ea87e7056cc3f2130ddaafc731530f (diff) | |
| download | spark-77e845ca7726ffee2d6f8e33ea56ec005dde3874.tar.gz spark-77e845ca7726ffee2d6f8e33ea56ec005dde3874.tar.bz2 spark-77e845ca7726ffee2d6f8e33ea56ec005dde3874.zip | |
[SPARK-4394][SQL] Data Sources API Improvements
This PR adds two features to the data sources API:
- Support for pushing down `IN` filters
- The ability for relations to optionally provide information about their `sizeInBytes`.
Author: Michael Armbrust <michael@databricks.com>
Closes #3260 from marmbrus/sourcesImprovements and squashes the following commits:
9a5e171 [Michael Armbrust] Use method instead of configuration directly
99c0e6b [Michael Armbrust] Add support for sizeInBytes.
416f167 [Michael Armbrust] Support for IN in data sources API.
2a04ab3 [Michael Armbrust] Simplify implementation of InSet.
Diffstat (limited to 'python/pyspark/context.py')
0 files changed, 0 insertions, 0 deletions