diff options
| author | Cheng Lian <lian.cs.zju@gmail.com> | 2014-08-13 16:27:50 -0700 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2014-08-13 16:27:50 -0700 |
| commit | bdc7a1a4749301f8d18617c130c7766684aa8789 (patch) | |
| tree | eadad0f16afbf77e9f605e2df55e941825f60e09 /sql/hive-thriftserver/src/test/resources | |
| parent | 7ecb867c4cd6916b6cb12f2ece1a4c88591ad5b5 (diff) | |
| download | spark-bdc7a1a4749301f8d18617c130c7766684aa8789.tar.gz spark-bdc7a1a4749301f8d18617c130c7766684aa8789.tar.bz2 spark-bdc7a1a4749301f8d18617c130c7766684aa8789.zip | |
[SPARK-3004][SQL] Added null checking when retrieving row set
JIRA issue: [SPARK-3004](https://issues.apache.org/jira/browse/SPARK-3004)
HiveThriftServer2 throws exception when the result set contains `NULL`. Should check `isNullAt` in `SparkSQLOperationManager.getNextRowSet`.
Note that simply using `row.addColumnValue(null)` doesn't work, since Hive set the column type of a null `ColumnValue` to String by default.
Author: Cheng Lian <lian.cs.zju@gmail.com>
Closes #1920 from liancheng/spark-3004 and squashes the following commits:
1b1db1c [Cheng Lian] Adding NULL column values in the Hive way
2217722 [Cheng Lian] Fixed SPARK-3004: added null checking when retrieving row set
Diffstat (limited to 'sql/hive-thriftserver/src/test/resources')
| -rw-r--r-- | sql/hive-thriftserver/src/test/resources/data/files/small_kv_with_null.txt | 10 |
1 files changed, 10 insertions, 0 deletions
diff --git a/sql/hive-thriftserver/src/test/resources/data/files/small_kv_with_null.txt b/sql/hive-thriftserver/src/test/resources/data/files/small_kv_with_null.txt new file mode 100644 index 0000000000..ae08c640e6 --- /dev/null +++ b/sql/hive-thriftserver/src/test/resources/data/files/small_kv_with_null.txt @@ -0,0 +1,10 @@ +238val_238 + +311val_311 +val_27 +val_165 +val_409 +255val_255 +278val_278 +98val_98 +val_484 |