diff options
| author | gatorsmile <gatorsmile@gmail.com> | 2016-09-05 11:28:19 +0800 |
|---|---|---|
| committer | Wenchen Fan <wenchen@databricks.com> | 2016-09-05 11:28:19 +0800 |
| commit | c1e9a6d274c281ec30e6d022eedfbe3a2988f721 (patch) | |
| tree | 557707ecdeeb8ed29e7ab7d3ef7afd104f34a533 /sql/core/src/test/scala | |
| parent | 1b001b5203444cc8d5c4887a30e03e8fb298d17d (diff) | |
| download | spark-c1e9a6d274c281ec30e6d022eedfbe3a2988f721.tar.gz spark-c1e9a6d274c281ec30e6d022eedfbe3a2988f721.tar.bz2 spark-c1e9a6d274c281ec30e6d022eedfbe3a2988f721.zip | |
[SPARK-17393][SQL] Error Handling when CTAS Against the Same Data Source Table Using Overwrite Mode
### What changes were proposed in this pull request?
When we trying to read a table and then write to the same table using the `Overwrite` save mode, we got a very confusing error message:
For example,
```Scala
Seq((1, 2)).toDF("i", "j").write.saveAsTable("tab1")
table("tab1").write.mode(SaveMode.Overwrite).saveAsTable("tab1")
```
```
Job aborted.
org.apache.spark.SparkException: Job aborted.
at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand$$anonfun$run$1.apply$mcV$sp
...
Caused by: org.apache.spark.SparkException: Task failed while writing rows
at org.apache.spark.sql.execution.datasources.DefaultWriterContainer.writeRows(WriterContainer.scala:266)
at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(InsertIntoHadoopFsRelationCommand.scala:143)
at org.apache.spark.sql.execution.datasources
```
After the PR, we will issue an `AnalysisException`:
```
Cannot overwrite table `tab1` that is also being read from
```
### How was this patch tested?
Added test cases.
Author: gatorsmile <gatorsmile@gmail.com>
Closes #14954 from gatorsmile/ctasQueryAnalyze.
Diffstat (limited to 'sql/core/src/test/scala')
0 files changed, 0 insertions, 0 deletions