- -

Spark News Archive

+
+

Spark News

-

Spark 0.8.1 released

- +

Spark 0.8.1 released

+

We’ve just posted Spark Release 0.8.1, a maintenance and performance release for the Scala 2.9 version of Spark. 0.8.1 includes support for YARN 2.2, a high availability mode for the standalone scheduler, optimizations to the shuffle, and many other improvements. We recommend that all users update to this release. Visit the release notes to read about the new features, or download the release today.

@@ -142,18 +169,19 @@
-

Spark Summit 2013 is a Wrap

- +

Spark Summit 2013 is a Wrap

+
-

The Spark Summit 2013, held in early December 2013 in downtown San Francisco, was a success!

+

The Spark Summit 2013, held in early December 2013 in downtown San Francisco, was a success! +Over 450 Spark developers and enthusiasts from 13 countries and more than 180 companies came to learn from project leaders and production users of Spark, Shark, Spark Streaming and related projects about use cases, recent developments, and the Spark community roadmap.

-

Announcing the first Spark Summit: December 2, 2013

- +

Announcing the first Spark Summit: December 2, 2013

+

We are excited to announce the first Spark Summit on Dec 2, 2013 in Downtown San Francisco. Come hear from key production users of Spark, Shark, Spark Streaming and related projects. Also find out where the development is going, and learn how to use the Spark stack in a variety of applications. The summit is being organized and sponsored by leading organizations in the Spark community.

@@ -162,8 +190,8 @@
-

Spark 0.8.0 released

- +

Spark 0.8.0 released

+

We’re proud to announce the release of Apache Spark 0.8.0. Spark 0.8.0 is a major release that includes many new capabilities and usability improvements. It’s also our first release under the Apache incubator. It is the largest Spark release yet, with contributions from 67 developers and 24 companies. Major new features include an expanded monitoring framework and UI, a machine learning library, and support for running Spark inside of YARN.

@@ -172,8 +200,8 @@
-

Spark user survey and "Powered By" page

- +

Spark user survey and "Powered By" page

+

As we continue developing Spark, we would love to get feedback from users and hear what you’d like us to work on next. We’ve decided that a good way to do that is a survey – we hope to run this at regular intervals. If you have a few minutes to participate, fill in the survey here. Your time is greatly appreciated.

@@ -182,8 +210,8 @@
-

Fourth Spark screencast released

- +

Fourth Spark screencast released

+

We have released the next screencast, A Standalone Job in Scala that takes you beyond the Spark shell, helping you write your first standalone Spark job.

@@ -192,8 +220,8 @@
-

Registration open for AMP Camp training camp in Berkeley

- +

Registration open for AMP Camp training camp in Berkeley

+

Want to learn how to use Spark, Shark, GraphX, and related technologies in person? The AMP Lab is hosting a two-day training workshop for them on August 29th and 30th in Berkeley. The workshop will include tutorials, talks from users, and over four hours of hands-on exercises. Registration is now open on the AMP Camp website, for a price of $250 per person. We recommend signing up early because last year’s workshop was sold out.

@@ -202,8 +230,8 @@
-

Spark mailing lists moving to Apache

- +

Spark mailing lists moving to Apache

+

As part of the Spark project's recent move to Apache, we are planning to migrate the mailing lists to Apache infrastructure this month, so that the existing Google groups will become read-only on September 1, 2013. To keep receiving updates about Spark or to participate in development discussions, please subscribe to the following lists:

@@ -223,8 +251,8 @@
-

Spark 0.7.3 released

- +

Spark 0.7.3 released

+

We’ve just posted Spark Release 0.7.3, a maintenance release that contains several fixes, including streaming API updates and new functionality for adding JARs to a spark-shell session. We recommend that all users update to this release. Visit the release notes to read about the new features, or download the release today.

@@ -233,8 +261,8 @@
-

Spark featured in Wired

- +

Spark featured in Wired

+

Spark, its creators at the AMP Lab, and some of its users were featured in a Wired Enterprise article a few days ago. Read on to learn a little about how Spark is being used in industry.

@@ -243,8 +271,8 @@
-

Spark accepted into Apache Incubator

- +

Spark accepted into Apache Incubator

+

Spark was recently accepted into the Apache Incubator, which will serve as the long-term home for the project. While moving the source code and issue tracking to Apache will take some time, we are excited to be joining the community at Apache. Stay tuned on this site for updates on how the project hosting will change.

@@ -253,8 +281,8 @@
-

Spark 0.7.2 released

- +

Spark 0.7.2 released

+

We’re happy to announce the release of Spark 0.7.2, a new maintenance release that includes several bug fixes and improvements, as well as new code examples and API features. We recommend that all users update to this release. Head over to the release notes to read about the new features, or download the release today.

@@ -263,8 +291,8 @@
-

Spark screencasts published

- +

Spark screencasts published

+

We have released the first two screencasts in a series of short hands-on video training courses we will be publishing to help new users get up and running with Spark in minutes.

@@ -279,8 +307,8 @@
-

Strata exercises now available online

- +

Strata exercises now available online

+

At this year’s Strata conference, the AMP Lab hosted a full day of tutorials on Spark, Shark, and Spark Streaming, including online exercises on Amazon EC2. Those exercises are now available online, letting you learn Spark and Shark at your own pace on an EC2 cluster with real data. They are a great resource for learning the systems. You can also find slides from the Strata tutorials online, as well as videos from the AMP Camp workshop we held at Berkeley in August.

@@ -289,8 +317,8 @@
-

Spark 0.7.0 released

- +

Spark 0.7.0 released

+

We’re proud to announce the release of Spark 0.7.0, a new major version of Spark that adds several key features, including a Python API for Spark and an alpha of Spark Streaming. This release is the result of the largest group of contributors yet behind a Spark release – 31 contributors from inside and outside Berkeley. Head over to the release notes to read more about the new features, or download the release today.

@@ -299,8 +327,8 @@
-

Spark/Shark Tutorial for Amazon EMR

- +

Spark/Shark Tutorial for Amazon EMR

+

This weekend, Amazon posted an article and code that make it easy to launch Spark and Shark on Elastic MapReduce. The article includes examples of how to run both interactive Scala commands and SQL queries from Shark on data in S3. Head over to the Amazon article for details. We’re very excited because, to our knowledge, this makes Spark the first non-Hadoop engine that you can launch with EMR.

@@ -309,8 +337,8 @@
-

Spark 0.6.2 released

- +

Spark 0.6.2 released

+

We recently released Spark 0.6.2, a new version of Spark. This is a maintenance release that includes several bug fixes and usability improvements (see the release notes). We recommend that all users upgrade to this release.

@@ -319,8 +347,8 @@
-

Spark tips from Quantifind

- +

Spark tips from Quantifind

+

Quantifind, one of the Bay Area companies that has been using Spark for predictive analytics, recently posted two useful entries on working with Spark in their tech blog:

+ + + + -- cgit v1.2.3