diff options
| author | Josh Rosen <joshrosen@databricks.com> | 2015-08-25 01:06:36 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-08-25 01:06:36 -0700 |
| commit | 7bc9a8c6249300ded31ea931c463d0a8f798e193 (patch) | |
| tree | f443f097acdfed3dc0d31b5aa7dd7d620a7d6ddb /sql/hive | |
| parent | 2f493f7e3924b769160a16f73cccbebf21973b91 (diff) | |
| download | spark-7bc9a8c6249300ded31ea931c463d0a8f798e193.tar.gz spark-7bc9a8c6249300ded31ea931c463d0a8f798e193.tar.bz2 spark-7bc9a8c6249300ded31ea931c463d0a8f798e193.zip | |
[SPARK-10195] [SQL] Data sources Filter should not expose internal types
Spark SQL's data sources API exposes Catalyst's internal types through its Filter interfaces. This is a problem because types like UTF8String are not stable developer APIs and should not be exposed to third-parties.
This issue caused incompatibilities when upgrading our `spark-redshift` library to work against Spark 1.5.0. To avoid these issues in the future we should only expose public types through these Filter objects. This patch accomplishes this by using CatalystTypeConverters to add the appropriate conversions.
Author: Josh Rosen <joshrosen@databricks.com>
Closes #8403 from JoshRosen/datasources-internal-vs-external-types.
Diffstat (limited to 'sql/hive')
0 files changed, 0 insertions, 0 deletions