From c58812cda2f6ee447637cf435384fb028228020d Mon Sep 17 00:00:00 2001 From: Patrick Wendell Date: Sat, 18 Apr 2015 16:54:01 +0000 Subject: Adding new SQL info in 1.3.1 release notes --- site/releases/spark-release-1-3-0.html | 2 +- site/releases/spark-release-1-3-1.html | 1 + 2 files changed, 2 insertions(+), 1 deletion(-) diff --git a/site/releases/spark-release-1-3-0.html b/site/releases/spark-release-1-3-0.html index e49178bac..a9d0953d0 100644 --- a/site/releases/spark-release-1-3-0.html +++ b/site/releases/spark-release-1-3-0.html @@ -195,7 +195,7 @@

Upgrading to Spark 1.3

Spark 1.3 is binary compatible with Spark 1.X releases, so no code changes are necessary. This excludes API’s marked explicitly as unstable.

-

As part of stabilizing the Spark SQL API, the SchemaRDD class has been renamed to DataFrame. Spark SQL’s migration guide describes the upgrade process in detail. Spark SQL also now requires that column identifiers which use reserved words (such as “string” or “table”) be escaped using backticks.

+

As part of stabilizing the Spark SQL API, the SchemaRDD class has been extended renamed to DataFrame. Spark SQL’s migration guide describes the upgrade process in detail. Spark SQL also now requires that column identifiers which use reserved words (such as “string” or “table”) be escaped using backticks.

Known Issues

This release has few known issues which will be addressed in Spark 1.3.1:

diff --git a/site/releases/spark-release-1-3-1.html b/site/releases/spark-release-1-3-1.html index e241725ff..c186541cf 100644 --- a/site/releases/spark-release-1-3-1.html +++ b/site/releases/spark-release-1-3-1.html @@ -183,6 +183,7 @@
  • Parquet no longer caches metadata (SPARK-6575)
  • Bug when joining two Parquet tables (SPARK-6851)
  • Unable to read parquet data generated by Spark 1.1.1 (SPARK-6315)
    • +
  • Parquet data source may use wrong Hadoop FileSystem (SPARK-6330)

    • Spark Streaming

    -- cgit v1.2.3