diff options
author | Felix Cheung <felixcheung_m@hotmail.com> | 2016-06-22 10:37:13 +0800 |
---|---|---|
committer | Cheng Lian <lian@databricks.com> | 2016-06-22 10:37:13 +0800 |
commit | 79aa1d82ca56eb847cbf4ff81de0564b339988f6 (patch) | |
tree | 560373ceeb81b907a28833040f4890ef37d3a3c5 /docs | |
parent | 9493b079a0050f0a6f4936c17622b96fb185b67f (diff) | |
download | spark-79aa1d82ca56eb847cbf4ff81de0564b339988f6.tar.gz spark-79aa1d82ca56eb847cbf4ff81de0564b339988f6.tar.bz2 spark-79aa1d82ca56eb847cbf4ff81de0564b339988f6.zip |
[SQL][DOC] SQL programming guide add deprecated methods in 2.0.0
## What changes were proposed in this pull request?
Doc changes
## How was this patch tested?
manual
liancheng
Author: Felix Cheung <felixcheung_m@hotmail.com>
Closes #13827 from felixcheung/sqldocdeprecate.
Diffstat (limited to 'docs')
-rw-r--r-- | docs/sql-programming-guide.md | 6 |
1 files changed, 5 insertions, 1 deletions
diff --git a/docs/sql-programming-guide.md b/docs/sql-programming-guide.md index ddf8f701ca..4b52c942e5 100644 --- a/docs/sql-programming-guide.md +++ b/docs/sql-programming-guide.md @@ -2143,7 +2143,7 @@ options. ## Upgrading From Spark SQL 1.6 to 2.0 - `SparkSession` is now the new entry point of Spark that replaces the old `SQLContext` and - `HiveContext`. Note that the old SQLContext and HiveContext are kept for backward compatibility. + `HiveContext`. Note that the old SQLContext and HiveContext are kept for backward compatibility. A new `catalog` interface is accessible from `SparkSession` - existing API on databases and tables access such as `listTables`, `createExternalTable`, `dropTempView`, `cacheTable` are moved here. - Dataset API and DataFrame API are unified. In Scala, `DataFrame` becomes a type alias for `Dataset[Row]`, while Java API users must replace `DataFrame` with `Dataset<Row>`. Both the typed @@ -2153,6 +2153,10 @@ options. APIs. Instead, `DataFrame` remains the primary programing abstraction, which is analogous to the single-node data frame notion in these languages. + - Dataset and DataFrame API `unionAll` has been deprecated and replaced by `union` + - Dataset and DataFrame API `explode` has been deprecated, alternatively, use `functions.explode()` with `select` or `flatMap` + - Dataset and DataFrame API `registerTempTable` has been deprecated and replaced by `createOrReplaceTempView` + ## Upgrading From Spark SQL 1.5 to 1.6 - From Spark 1.6, by default the Thrift server runs in multi-session mode. Which means each JDBC/ODBC |