diff options
| author | gatorsmile <gatorsmile@gmail.com> | 2015-11-09 16:06:48 -0800 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2015-11-09 16:06:48 -0800 |
| commit | 2f38378856fb56bdd9be7ccedf56427e81701f4e (patch) | |
| tree | 5540a81228b2fb3668387e034417b7ced5b50815 /docs | |
| parent | 9565c246eadecf4836d247d0067f2200f061d25f (diff) | |
| download | spark-2f38378856fb56bdd9be7ccedf56427e81701f4e.tar.gz spark-2f38378856fb56bdd9be7ccedf56427e81701f4e.tar.bz2 spark-2f38378856fb56bdd9be7ccedf56427e81701f4e.zip | |
[SPARK-11360][DOC] Loss of nullability when writing parquet files
This fix is to add one line to explain the current behavior of Spark SQL when writing Parquet files. All columns are forced to be nullable for compatibility reasons.
Author: gatorsmile <gatorsmile@gmail.com>
Closes #9314 from gatorsmile/lossNull.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/sql-programming-guide.md | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/docs/sql-programming-guide.md b/docs/sql-programming-guide.md index ccd2690432..6e02d6564b 100644 --- a/docs/sql-programming-guide.md +++ b/docs/sql-programming-guide.md @@ -982,7 +982,8 @@ when a table is dropped. [Parquet](http://parquet.io) is a columnar format that is supported by many other data processing systems. Spark SQL provides support for both reading and writing Parquet files that automatically preserves the schema -of the original data. +of the original data. When writing Parquet files, all columns are automatically converted to be nullable for +compatibility reasons. ### Loading Data Programmatically |