diff options
| author | Michael Armbrust <michael@databricks.com> | 2016-03-08 15:19:26 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-03-08 15:19:26 -0800 |
| commit | 1e28840594b9d972c96d3922ca0bf0f76e313e82 (patch) | |
| tree | 5669df597c7c4deea0586830905ddd037eb819a4 /README.md | |
| parent | 076009b94985b586ffa78078cc03abb85e308f06 (diff) | |
| download | spark-1e28840594b9d972c96d3922ca0bf0f76e313e82.tar.gz spark-1e28840594b9d972c96d3922ca0bf0f76e313e82.tar.bz2 spark-1e28840594b9d972c96d3922ca0bf0f76e313e82.zip | |
[SPARK-13738][SQL] Cleanup Data Source resolution
Follow-up to #11509, that simply refactors the interface that we use when resolving a pluggable `DataSource`.
- Multiple functions share the same set of arguments so we make this a case class, called `DataSource`. Actual resolution is now done by calling a function on this class.
- Instead of having multiple methods named `apply` (some of which do writing some of which do reading) we now explicitly have `resolveRelation()` and `write(mode, df)`.
- Get rid of `Array[String]` since this is an internal API and was forcing us to awkwardly call `toArray` in a bunch of places.
Author: Michael Armbrust <michael@databricks.com>
Closes #11572 from marmbrus/dataSourceResolution.
Diffstat (limited to 'README.md')
0 files changed, 0 insertions, 0 deletions