diff options
| author | Liang-Chi Hsieh <viirya@gmail.com> | 2015-06-08 17:50:38 +0800 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2015-06-08 17:50:38 +0800 |
| commit | 03ef6be9ce61a13dcd9d8c71298fb4be39119411 (patch) | |
| tree | f37927ddcddee7dd0218969c9b7ba65d996774bb /docs/sql-programming-guide.md | |
| parent | eacd4a929bf5d697c33b1b705dcf958651cd20f4 (diff) | |
| download | spark-03ef6be9ce61a13dcd9d8c71298fb4be39119411.tar.gz spark-03ef6be9ce61a13dcd9d8c71298fb4be39119411.tar.bz2 spark-03ef6be9ce61a13dcd9d8c71298fb4be39119411.zip | |
[SPARK-7939] [SQL] Add conf to enable/disable partition column type inference
JIRA: https://issues.apache.org/jira/browse/SPARK-7939
Author: Liang-Chi Hsieh <viirya@gmail.com>
Closes #6503 from viirya/disable_partition_type_inference and squashes the following commits:
3e90470 [Liang-Chi Hsieh] Default to enable type inference and update docs.
455edb1 [Liang-Chi Hsieh] Merge remote-tracking branch 'upstream/master' into disable_partition_type_inference
9a57933 [Liang-Chi Hsieh] Add conf to enable/disable partition column type inference.
Diffstat (limited to 'docs/sql-programming-guide.md')
| -rw-r--r-- | docs/sql-programming-guide.md | 6 |
1 files changed, 5 insertions, 1 deletions
diff --git a/docs/sql-programming-guide.md b/docs/sql-programming-guide.md index cde5830c73..40e33f757d 100644 --- a/docs/sql-programming-guide.md +++ b/docs/sql-programming-guide.md @@ -1102,7 +1102,11 @@ root {% endhighlight %} Notice that the data types of the partitioning columns are automatically inferred. Currently, -numeric data types and string type are supported. +numeric data types and string type are supported. Sometimes users may not want to automatically +infer the data types of the partitioning columns. For these use cases, the automatic type inference +can be configured by `spark.sql.sources.partitionColumnTypeInference.enabled`, which is default to +`true`. When type inference is disabled, string type will be used for the partitioning columns. + ### Schema merging |