From d207716451f722c899b3845ee454f1e16c094125 Mon Sep 17 00:00:00 2001 From: gatorsmile Date: Mon, 23 May 2016 21:07:14 -0700 Subject: [SPARK-15485][SQL][DOCS] Spark SQL Configuration #### What changes were proposed in this pull request? So far, the page Configuration in the official documentation does not have a section for Spark SQL. http://spark.apache.org/docs/latest/configuration.html For Spark users, the information and default values of these public configuration parameters are very useful. This PR is to add this missing section to the configuration.html. rxin yhuai marmbrus #### How was this patch tested? Below is the generated webpage. screenshot 2016-05-23 11 35 57 screenshot 2016-05-23 11 37 38 screenshot 2016-05-23 11 36 11 screenshot 2016-05-23 11 36 18 Author: gatorsmile Closes #13263 from gatorsmile/configurationSQL. --- docs/configuration.md | 42 ++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 42 insertions(+) diff --git a/docs/configuration.md b/docs/configuration.md index d23f0fe1a1..d6471a8cc7 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1480,6 +1480,48 @@ Apart from these, the following properties are also available, and may be useful +#### Spark SQL +Running the SET -v command will show the entire list of the SQL configuration. + +
+
+ +{% highlight scala %} +// spark is an existing SparkSession +spark.sql("SET -v").show(numRows = 200, truncate = false) +{% endhighlight %} + +
+ +
+ +{% highlight java %} +// spark is an existing SparkSession +spark.sql("SET -v").show(200, false); +{% endhighlight %} +
+ +
+ +{% highlight python %} +# spark is an existing SparkSession +spark.sql("SET -v").show(n=200, truncate=False) +{% endhighlight %} + +
+ +
+ +{% highlight r %} +# sqlContext is an existing sqlContext. +properties <- sql(sqlContext, "SET -v") +showDF(properties, numRows = 200, truncate = FALSE) +{% endhighlight %} + +
+
+ + #### Spark Streaming -- cgit v1.2.3
Property NameDefaultMeaning