diff options
-rw-r--r-- | news/_posts/2015-04-17-spark-1-2-2-released.md | 16 | ||||
-rw-r--r-- | news/_posts/2015-04-20-spark-summit-east-2015-videos-posted.md | 17 | ||||
-rw-r--r-- | releases/_posts/2015-04-17-spark-release-1-2-2.md | 78 | ||||
-rw-r--r-- | releases/_posts/2015-04-17-spark-release-1-3-1.md | 105 |
4 files changed, 216 insertions, 0 deletions
diff --git a/news/_posts/2015-04-17-spark-1-2-2-released.md b/news/_posts/2015-04-17-spark-1-2-2-released.md new file mode 100644 index 000000000..f0fa5a62d --- /dev/null +++ b/news/_posts/2015-04-17-spark-1-2-2-released.md @@ -0,0 +1,16 @@ +--- +layout: post +title: Spark 1.2.2 and 1.3.1 released +categories: +- News +tags: [] +status: publish +type: post +published: true +meta: + _edit_last: '4' + _wpas_done_all: '1' +--- +We are happy to announce the availability of <a href="{{site.url}}releases/spark-release-1-2-2.html" title="Spark Release 1.2.2">Spark 1.2.2</a> and <a href="{{site.url}}releases/spark-release-1-3-1.html" title="Spark Release 1.3.1">Spark 1.3.1</a>! These are both maintenance releases that collectively feature the work of more than 90 developers. + +To download either release, visit the <a href="{{site.url}}downloads.html">downloads</a> page. diff --git a/news/_posts/2015-04-20-spark-summit-east-2015-videos-posted.md b/news/_posts/2015-04-20-spark-summit-east-2015-videos-posted.md new file mode 100644 index 000000000..5f5d454ab --- /dev/null +++ b/news/_posts/2015-04-20-spark-summit-east-2015-videos-posted.md @@ -0,0 +1,17 @@ +--- +layout: post +title: Spark Summit East 2015 Videos Posted +categories: +- News +tags: [] +status: publish +type: post +published: true +meta: + _edit_last: '4' + _wpas_done_all: '1' +--- + +The videos and slides for Spark Summit East 2015 are now all <a href="http://spark-summit.org/east/2015">available online</a>. Watch them to get the latest news from the Spark community as well as use cases and applications built on top. + +If you like what you see, consider joining us at the <a href="http://spark-summit.org/2015/agenda">2015 Spark Summit</a> in San Francisco. diff --git a/releases/_posts/2015-04-17-spark-release-1-2-2.md b/releases/_posts/2015-04-17-spark-release-1-2-2.md new file mode 100644 index 000000000..e118849be --- /dev/null +++ b/releases/_posts/2015-04-17-spark-release-1-2-2.md @@ -0,0 +1,78 @@ +--- +layout: post +title: Spark Release 1.2.2 +categories: [] +tags: [] +status: publish +type: post +published: true +meta: + _edit_last: '4' + _wpas_done_all: '1' +--- + +Spark 1.2.2 is a maintenance release containing stability fixes. This release is based on the [branch-1.2](https://github.com/apache/spark/tree/branch-1.2) maintenance branch of Spark. We recommend all 1.2.1 users to upgrade to this stable release. Contributions to this release came from 39 developers. + +To download Spark 1.2.2 visit the <a href="{{site.url}}downloads.html">downloads</a> page. + +### Fixes +Spark 1.2.2 contains bug fixes in several components. Some of the more important fixes are highlighted below. You can visit the [Spark issue tracker](https://issues.apache.org/jira/issues/?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%201.2.2%20ORDER%20BY%20priority%2C%20component) for the full list of fixes. + + +#### Spark Core + * Thread safety problem in Netty shuffle ([SPARK-6578](http://issues.apache.org/jira/browse/SPARK-6578)) + * Memory leak in JobProgressListener ([SPARK-5967](http://issues.apache.org/jira/browse/SPARK-5967)) + * Unable to launch on YARN 2.5.0 and later ([SPARK-4267](http://issues.apache.org/jira/browse/SPARK-4267)) + * YARN auxiliary shuffle issue in secure mode ([SPARK-5655](http://issues.apache.org/jira/browse/SPARK-5655)) + +#### PySpark + * Jobs hang during `collect` operation ([SPARK-6667](http://issues.apache.org/jira/browse/SPARK-6667)) + * Zip fails with serializer error ([SPARK-5973](http://issues.apache.org/jira/browse/SPARK-5973)) + * Memory leak using Spark SQL with PySpark ([SPARK-6055](http://issues.apache.org/jira/browse/SPARK-6055)) + * Hanging when using large broadcast variables ([SPARK-5363](http://issues.apache.org/jira/browse/SPARK-5363)) + +### Contributors +The following developers contributed to this release: + + * Andrew Or -- Bug fixes in Core and YARN + * Andrew Rowson -- Bug fixes in YARN + * Anselme Vignon -- Bug fixes in SQL + * Brennon York -- Bug fixes in GraphX + * Cheng Hao -- Bug fixes in Core + * Cheolsoo Park -- Bug fixes in YARN + * Davies Liu -- Improvements in PySpark; bug fixes in Streaming, Core, SQL, and PySpark; documentation in Core and PySpark + * Emre Sevinc -- Documentation in Core and MLlib; improvement in Core + * Gen TANG -- Bug fixes in EC2 + * Hari Shreedharan -- Bug fixes in Streaming + * Hung Lin -- Bug fixes in scheduler + * Iulian Dragos -- Test in Streaming + * Jacek Lewandowski -- Bug fixes in Core + * Jesper Lundgren -- Bug fixes in Streaming + * Josh Rosen -- Bug fixes in Java API, Streaming, tests, and Core + * Kashish Jain -- Bug fixes in YARN + * Kay Ousterhout -- Bug fixes in Core and SQL + * Kousuke Saruta -- Improvements in Streaming and tests + * Li Zhihui -- Documentation in Core + * Manoj Kumar -- Improvements in MLlib + * Matt Cheah -- Bug fixes in Core + * Michael Nazario -- Bug fixes in PySpark + * Mingyu Kim -- Bug fixes in Core + * Nathan McCarthy -- Bug fixes in Core + * Nicholas Chammas -- Bug fixes in EC2 + * Peng Xu -- Documentation in Core + * Reynold Xin -- Bug fixes in Core + * Ryan Williams -- Improvements in Core + * Sean Owen -- Improvements in EC2; bug fixes in Core, tests, YARN, Streaming, scheduler, and Web UI + * Shixiong Zhu -- Improvements in Shuffle + * Tathagata Das -- Bug fixes in Streaming and Web UI + * Venkata Ramana Gollamudi -- Improvement in Core + * Vladimir Grigor -- Bug fixes in EC2 + * Wang Tao -- Bug fixes in Core + * Winston Chen -- Bug fixes in PySpark + * Yin Huai -- Bug fixes in SQL + * Yuhao Yang -- Bug fixes in MLlib + * Zhan Zhang -- Bug fixes in Core + * Zhang, Liye -- Bug fixes in Core + +_Thanks to everyone who contributed!_ + diff --git a/releases/_posts/2015-04-17-spark-release-1-3-1.md b/releases/_posts/2015-04-17-spark-release-1-3-1.md new file mode 100644 index 000000000..dc7c5d423 --- /dev/null +++ b/releases/_posts/2015-04-17-spark-release-1-3-1.md @@ -0,0 +1,105 @@ +--- +layout: post +title: Spark Release 1.3.1 +categories: [] +tags: [] +status: publish +type: post +published: true +meta: + _edit_last: '4' + _wpas_done_all: '1' +--- + +Spark 1.3.1 is a maintenance release containing stability fixes. This release is based on the [branch-1.3](https://github.com/apache/spark/tree/branch-1.3) maintenance branch of Spark. We recommend all 1.3.0 users to upgrade to this stable release. Contributions to this release came from 60 developers. + +To download Spark 1.3.1 visit the <a href="{{site.url}}downloads.html">downloads</a> page. + +### Fixes +Spark 1.3.1 contains several bug fixes in Spark SQL and assorted fixes in other components. Some of the more important fixes are highlighted below. You can visit the [Spark issue tracker](https://issues.apache.org/jira/issues/?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%201.3.1%20ORDER%20BY%20priority%2C%20component) for the full list of fixes. + +#### Spark SQL + * Unable to use reserved words in DDL ([SPARK-6250](http://issues.apache.org/jira/browse/SPARK-6250)) + * Parquet no longer caches metadata ([SPARK-6575](http://issues.apache.org/jira/browse/SPARK-6575)) + * Bug when joining two Parquet tables ([SPARK-6851](http://issues.apache.org/jira/browse/SPARK-6851)) + * Unable to read parquet data generated by Spark 1.1.1 ([SPARK-6315](http://issues.apache.org/jira/browse/SPARK-6315)) + * Parquet data source may use wrong Hadoop FileSystem ([SPARK-6330](http://issues.apache.org/jira/browse/SPARK-6330)) + +#### Spark Streaming + * Potential for data loss during WAL recovery ([SPARK-6222](http://issues.apache.org/jira/browse/SPARK-6222)) + +#### PySpark + * Potential program hang when calling collect ([SPARK-6667](http://issues.apache.org/jira/browse/SPARK-6667)) + +#### Spark Core + * Thread safety issue in Netty shuffle ([SPARK-6578](http://issues.apache.org/jira/browse/SPARK-6578)) + * Memory leak in output committer map ([SPARK-6737](http://issues.apache.org/jira/browse/SPARK-6737)) + * Unable to perform fetch file when local directories run NFS ([SPARK-6313](http://issues.apache.org/jira/browse/SPARK-6313)) + * NPE when cancelling and using mix of job groups ([SPARK-6414](http://issues.apache.org/jira/browse/SPARK-6414)) + +### Contributors +The following developers contributed to this release: + + * Adam Budde -- Bug fixes in SQL + * Andrew Or -- Bug fixes in Core + * Andrey Zagrebin -- Improvement in SQL + * Bill Chambers -- Documentation in Core + * Cheng Lian -- Bug fixes and improvement in SQL + * Chet Mancini -- Improvements in Core and SQL + * Christophe Preaud -- Documentation in Core and YARN + * Daoyuan Wang -- New features in SQL + * Davies Liu -- Improvements in PySpark and SQL; bug fixes in tests, PySpark, and SQL; improvement in SQL + * Dean Chen -- Bug fixes in Core + * Doing Done -- Bug fixes in Core and SQL + * Hung Lin -- Bug fixes in scheduler + * Ilya Ganelin -- Improvements in Core + * Imran Rashid -- Bug fixes in Core + * Iulian Dragos -- Bug fixes in Core + * Jayson Sunshine -- Documentation in Core + * Jeremy Freeman -- Bug fixes in Streaming and MLlib + * Jongyoul Lee -- Improvements in Mesos; bug fixes in Core + * Joseph K. Bradley -- Documentation in PySpark, Streaming, SQL, MLlib, and Core + * Josh Rosen -- Improvements in Core; bug fixes in Java API, Core, scheduler, and Streaming + * Kai Sasaki -- Documentation in Core and MLlib; bug fixes in MLlib and PySpark + * Kalle Jepsen -- Improvements in PySpark + * Kamil Smuga -- Bug fixes in Core and PySpark + * Kay Ousterhout -- Bug fixes in Core, tests, and Web UI + * Kevin (Sangwoo) Kim -- Bug fixes in Core + * Kousuke Saruta -- Improvements in Streaming and tests + * Lev Khomich -- Improvements in Core + * Liang-Chi Hsieh -- Bug fixes in SQL + * Liangliang Gu -- Bug fixes in spark submit + * Lomig Megard -- Documentation in Core + * Marcelo Vanzin -- Bug fixes in Core and YARN + * Matt Aasted -- Bug fixes in EC2 + * Michael Armbrust -- Improvements in SQL; documentation in Core; bug fixes in SQL; improvement in Core and SQL + * Michael Griffiths -- Bug fixes in Windows and Core + * Milan Straka -- Bug fixes in PySpark + * Nan Zhu -- Bug fixes in Core and SQL + * Nathan McCarthy -- Bug fixes in Core + * Pei-Lun Lee -- Bug fixes in SQL + * Peter Parente -- Improvements in Core + * Peter Rudenko -- Documentation in Core + * Reynold Xin -- Improvements in Core; documentation in Core; bug fixes in Core; improvement in SQL + * Sean Owen -- Bug fixes in Core, tests, and SQL + * Shixiong Zhu -- Bug fixes in Core + * Tathagata Das -- Improvements in Core and Streaming; bug fixes in Streaming + * Thomas Graves -- Bug fixes in Core + * Tijo Thomas -- Bug fixes in Core and SQL + * Venkata Ramana Gollamudi -- Bug fixes in SQL + * Vinod KC -- Bug fixes in Core and SQL + * Volodymyr Lyubinets -- Improvements and bug fixes in SQL + * Xiangrui Meng -- New features in MLlib and PySpark; bug fixes in PySpark, MLlib, and SQL; documentation in Core and MLlib + * Yadong Qi -- Improvements in SQL + * Yanbo Liang -- Bug fixes in MLlib and SQL + * Yash Datta -- Improvements in SQL + * Yin Huai -- Improvements and bug fixes in SQL + * Yp Cat -- Bug fixes in SQL + * Yu ISHIKAWA -- Improvements in MLlib + * Yuri Saito -- Bug fixes in SQL + * Zhang, Liye -- Bug fixes in Core and Web UI + * Zhichao Li -- Bug fixes in Streaming and Web UI + * Zhichao Zhang -- Documentation in Core + +_Thanks to everyone who contributed!_ + |