diff options
| author | Yin Huai <yhuai@databricks.com> | 2015-02-06 12:38:07 -0800 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2015-02-06 12:38:18 -0800 |
| commit | 3c34d62c447e7fa1e030f4130f6bc08828e5546d (patch) | |
| tree | 9d8dca5ab32cd82f04d6e96287e1d56d8d56559e /examples | |
| parent | 0fc35dafe94df515c32f8dd1273431b23d63601b (diff) | |
| download | spark-3c34d62c447e7fa1e030f4130f6bc08828e5546d.tar.gz spark-3c34d62c447e7fa1e030f4130f6bc08828e5546d.tar.bz2 spark-3c34d62c447e7fa1e030f4130f6bc08828e5546d.zip | |
[SPARK-5595][SPARK-5603][SQL] Add a rule to do PreInsert type casting and field renaming and invalidating in memory cache after INSERT
This PR adds a rule to Analyzer that will add preinsert data type casting and field renaming to the select clause in an `INSERT INTO/OVERWRITE` statement. Also, with the change of this PR, we always invalidate our in memory data cache after inserting into a BaseRelation.
cc marmbrus liancheng
Author: Yin Huai <yhuai@databricks.com>
Closes #4373 from yhuai/insertFollowUp and squashes the following commits:
08237a7 [Yin Huai] Merge remote-tracking branch 'upstream/master' into insertFollowUp
316542e [Yin Huai] Doc update.
c9ccfeb [Yin Huai] Revert a unnecessary change.
84aecc4 [Yin Huai] Address comments.
1951fe1 [Yin Huai] Merge remote-tracking branch 'upstream/master'
c18da34 [Yin Huai] Invalidate cache after insert.
727f21a [Yin Huai] Preinsert casting and renaming.
(cherry picked from commit 3eccf29ce061559c86e6f7338851932fc89a9afd)
Signed-off-by: Michael Armbrust <michael@databricks.com>
Diffstat (limited to 'examples')
0 files changed, 0 insertions, 0 deletions