diff options
| author | Michael Armbrust <michael@databricks.com> | 2014-03-24 19:24:22 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-03-24 19:24:22 -0700 |
| commit | 8043b7bc74ff3640743ffc3f1be386dc42f3f44c (patch) | |
| tree | e4afc1d8f77684ec04661ba6ffca0d6bd9b1058d /.gitignore | |
| parent | 56db8a2f053625fa0c5ba1b0dc64de7d4fc80400 (diff) | |
| download | spark-8043b7bc74ff3640743ffc3f1be386dc42f3f44c.tar.gz spark-8043b7bc74ff3640743ffc3f1be386dc42f3f44c.tar.bz2 spark-8043b7bc74ff3640743ffc3f1be386dc42f3f44c.zip | |
SPARK-1294 Fix resolution of uppercase field names using a HiveContext.
Fixing this bug required the following:
- Creation of a new logical node that converts a schema to lowercase.
- Generalization of the subquery eliding rule to also elide this new node
- Fixing of several places where too tight assumptions were made on the types of `InsertIntoTable` children.
- I also removed an API that was left in by accident that exposed catalyst data structures, and fix the logic that pushes down filters into hive tables scans to correctly compare attribute references.
Author: Michael Armbrust <michael@databricks.com>
Closes #202 from marmbrus/upperCaseFieldNames and squashes the following commits:
15e5265 [Michael Armbrust] Support for resolving mixed case fields from a reflected schema using HiveQL.
5aa5035 [Michael Armbrust] Remove API that exposes internal catalyst data structures.
9d99cb6 [Michael Armbrust] Attributes should be compared using exprId, not TreeNode.id.
Diffstat (limited to '.gitignore')
0 files changed, 0 insertions, 0 deletions