Initial port of Spark website from spark-project.org wordpress to Jekyll.

19 files changed, 296 insertions, 0 deletions

diff --git a/news/_posts/2012-01-10-spark-meetups.html b/news/_posts/2012-01-10-spark-meetups.html
new file mode 100644
index 000000000..5c5ba0faa
--- /dev/null
+++ b/news/_posts/2012-01-10-spark-meetups.html
@@ -0,0 +1,11 @@
+---
+layout: post
+title: We've started hosting a Bay Area Spark User Meetup
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+---
+We've started hosting a regular <a href="http://www.meetup.com/spark-users/">Bay Area Spark User Meetup</a>. Sign up on the meetup.com page to be notified about events and meet other Spark developers and users.
diff --git a/news/_posts/2012-04-25-nsdi-paper.html b/news/_posts/2012-04-25-nsdi-paper.html
new file mode 100644
index 000000000..4f01d52ab
--- /dev/null
+++ b/news/_posts/2012-04-25-nsdi-paper.html
@@ -0,0 +1,14 @@
+---
+layout: post
+title: Spark wins Best Paper Award at USENIX NSDI
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '1'
+  _wp_old_slug: hello-world
+---
+Our <a href="http://www.cs.berkeley.edu/~matei/papers/2012/nsdi_spark.pdf">paper on Spark</a> won the Best Paper Award at the <a href="http://www.usenix.org/nsdi12/">USENIX NSDI conference</a>. You can see a video of the talk, as well as slides, online on the <a href="https://www.usenix.org/conference/nsdi12/resilient-distributed-datasets-fault-tolerant-abstraction-memory-cluster-computing">NSDI website</a>.
diff --git a/news/_posts/2012-10-15-spark-version-0-6-0-released.html b/news/_posts/2012-10-15-spark-version-0-6-0-released.html
new file mode 100644
index 000000000..365145490
--- /dev/null
+++ b/news/_posts/2012-10-15-spark-version-0-6-0-released.html
@@ -0,0 +1,13 @@
+---
+layout: post
+title: Spark version 0.6.0 released
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '1'
+---
+<a href="/spark-release-0-6-0">Spark version 0.6.0</a> was released today, a major release that brings a wide range of performance improvements and new features, including a simpler standalone deploy mode and a Java API. Read more about it in the <a href="/spark-release-0-6-0">release notes</a>.
diff --git a/news/_posts/2012-11-22-spark-0-6-1-and-0-5-2-released.html b/news/_posts/2012-11-22-spark-0-6-1-and-0-5-2-released.html
new file mode 100644
index 000000000..e1da4c3a0
--- /dev/null
+++ b/news/_posts/2012-11-22-spark-0-6-1-and-0-5-2-released.html
@@ -0,0 +1,13 @@
+---
+layout: post
+title: Spark 0.6.1 and 0.5.2 out
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '1'
+---
+Today we've made available two maintenance releases for Spark: <a href="http://spark-project.org/spark-release-0-6-1/" title="Spark Release 0.6.1">0.6.1</a> and <a href="http://spark-project.org/spark-release-0-5-2/" title="Spark Release 0.5.2">0.5.2</a>. They both contain important bug fixes as well as some new features, such as the ability to build against Hadoop 2 distributions. We recommend that users update to the latest version for their branch; for new users, we recommend <a href="http://spark-project.org/spark-release-0-6-1/" title="Spark Release 0.6.1">0.6.1</a>.
diff --git a/news/_posts/2012-12-21-spark-and-shark-in-the-news.html b/news/_posts/2012-12-21-spark-and-shark-in-the-news.html
new file mode 100644
index 000000000..d8f345787
--- /dev/null
+++ b/news/_posts/2012-12-21-spark-and-shark-in-the-news.html
@@ -0,0 +1,25 @@
+---
+layout: post
+title: Spark and Shark in the news
+categories:
+- In-The-News
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+Recently, we've seen quite a bit of coverage of both Spark and <a href="http://shark.cs.berkeley.edu">Shark</a> in the news. I wanted to list some of the more recent articles, for readers interested in learning more.

+

+<ul>

+<li>Curt Monash, editor of the popular DBMS2 blog, wrote a great <a href="http://www.dbms2.com/2012/12/13/introduction-to-spark-shark-bdas-and-amplab/">introduction to Spark and Shark</a>, as well as a more detailed <a href="http://www.dbms2.com/2012/12/13/spark-shark-and-rdds-technology-notes/">technical overview</a>.</li>

+<li><a href="http://siliconangle.com/blog/2012/11/29/big-data-up-to-100x-faster-researchers-crank-up-the-speed-dial/">Silicon Angle</a> covered Spark and Shark after our <a href="https://amplab.cs.berkeley.edu/news/sparkshark-a-big-hit-at-aws-reinvent/">presentation at Amazon re:Invent</a>.</li>

+<li><a href="http://www.datanami.com/datanami/2012-12-01/the_week_in_big_data_research.html?page=2">Datanami</a> highlighted Shark in its survey of big data research projects.</li>

+<li>O'Reilly's Strata blog recently covered <a href="http://strata.oreilly.com/2012/08/seven-reasons-why-i-like-spark.html">Spark</a>, <a href="http://strata.oreilly.com/2012/11/shark-real-time-queries-and-analytics-for-big-data.html">Shark</a>, and the <a href="http://strata.oreilly.com/2012/10/spark-0-6-improves-performance-and-accessibility.html">Spark 0.6 release</a>.</li>

+<li><a href="http://data-informed.com/spark-an-open-source-engine-for-iterative-data-mining/">DataInformed</a> interviewed two Spark users and wrote about their applications in anomaly detection, predictive analytics and data mining.</li>

+</ul>

+

+In other news, there will be a full day of tutorials on Spark and Shark at the <a href="http://strataconf.com/strata2013">O'Reilly Strata conference</a> in February. They include a three-hour <a href="http://strataconf.com/strata2013/public/schedule/detail/27438">introduction to Spark, Shark and BDAS</a> Tuesday morning, and a three-hour <a href="http://strataconf.com/strata2013/public/schedule/detail/27440">hands-on exercise session</a>. 
diff --git a/news/_posts/2012-12-21-video-from-first-spark-development-meetup.html b/news/_posts/2012-12-21-video-from-first-spark-development-meetup.html
new file mode 100644
index 000000000..ba45bc97c
--- /dev/null
+++ b/news/_posts/2012-12-21-video-from-first-spark-development-meetup.html
@@ -0,0 +1,14 @@
+---
+layout: post
+title: Video up from first Spark development meetup
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+On December 18th, we held the first of a series of Spark development meetups, for people interested in learning the Spark codebase and contributing to the project. There was quite a bit more demand than we anticipated, with over 80 people signing up and 64 attending. The first meetup was an <a href="http://www.meetup.com/spark-users/events/94101942/">introduction to Spark internals</a>. Thanks to one of the attendees, there's now a <a href="http://www.youtube.com/watch?v=49Hr5xZyTEA">video of the meetup</a> on YouTube. We've also posted the <a href="http://files.meetup.com/3138542/dev-meetup-dec-2012.pptx">slides</a>. Look to see more development meetups on Spark and Shark in the future.
diff --git a/news/_posts/2013-01-12-spark-tips-from-quantifind.html b/news/_posts/2013-01-12-spark-tips-from-quantifind.html
new file mode 100644
index 000000000..8afac5dd8
--- /dev/null
+++ b/news/_posts/2013-01-12-spark-tips-from-quantifind.html
@@ -0,0 +1,19 @@
+---
+layout: post
+title: Spark tips from Quantifind
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+<a href="http://www.quantfind.com">Quantfind</a>, one of the Bay Area companies that has been using Spark for predictive analytics, recently posted two useful entries on working with Spark in their tech blog:

+<ul>

+<li><a href="http://blog.quantifind.com/posts/spark-unit-test/">Unit testing with Spark</a></li>

+<li><a href="http://blog.quantifind.com/posts/logging-post/">Configuring Spark's logs</a></li>

+</ul>

+Thanks for sharing this, and looking forward to see others!
diff --git a/news/_posts/2013-02-07-spark-0-6-2-released.html b/news/_posts/2013-02-07-spark-0-6-2-released.html
new file mode 100644
index 000000000..ae9146753
--- /dev/null
+++ b/news/_posts/2013-02-07-spark-0-6-2-released.html
@@ -0,0 +1,14 @@
+---
+layout: post
+title: Spark 0.6.2 released
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+We recently released <a href="http://spark-project.org/spark-release-0-6-2/" title="Spark Release 0.6.2">Spark 0.6.2</a>, a new version of Spark. This is a maintenance release that includes several bug fixes and usability improvements (see the <a href="http://spark-project.org/spark-release-0-6-2/" title="Spark Release 0.6.2">release notes</a>). We recommend that all users upgrade to this release.
diff --git a/news/_posts/2013-02-24-run-spark-and-shark-on-amazon-emr.html b/news/_posts/2013-02-24-run-spark-and-shark-on-amazon-emr.html
new file mode 100644
index 000000000..cf86ec957
--- /dev/null
+++ b/news/_posts/2013-02-24-run-spark-and-shark-on-amazon-emr.html
@@ -0,0 +1,14 @@
+---
+layout: post
+title: Spark/Shark Tutorial for Amazon EMR
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+This weekend, Amazon posted an <a href="http://aws.amazon.com/articles/Elastic-MapReduce/4926593393724923">article</a> and code that make it easy to launch Spark and Shark on Elastic MapReduce. The article includes examples of how to run both interactive Scala commands and SQL queries from Shark on data in S3. Head over to the <a href="http://aws.amazon.com/articles/Elastic-MapReduce/4926593393724923">Amazon article</a> for details. We're very excited because, to our knowledge, this makes Spark the first non-Hadoop engine that you can launch with EMR.
diff --git a/news/_posts/2013-02-27-spark-0-7-0-released.html b/news/_posts/2013-02-27-spark-0-7-0-released.html
new file mode 100644
index 000000000..de2e67e20
--- /dev/null
+++ b/news/_posts/2013-02-27-spark-0-7-0-released.html
@@ -0,0 +1,14 @@
+---
+layout: post
+title: Spark 0.7.0 released
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+We're proud to announce the release of <a href="http://spark-project.org/spark-release-0-7-0/" title="Spark Release 0.7.0">Spark 0.7.0</a>, a new major version of Spark that adds several key features, including a <a href="/docs/latest/python-programming-guide.html">Python API</a> for Spark and an <a href="/docs/latest/streaming-programming-guide.html">alpha of Spark Streaming</a>. This release is the result of the largest group of contributors yet behind a Spark release -- 31 contributors from inside and outside Berkeley. Head over to the <a href="http://spark-project.org/spark-release-0-7-0/" title="Spark Release 0.7.0">release notes</a> to read more about the new features, or <a href="/downloads/">download</a> the release today.
diff --git a/news/_posts/2013-03-17-strata-exercises-now-available-online.html b/news/_posts/2013-03-17-strata-exercises-now-available-online.html
new file mode 100644
index 000000000..7ff0eda9d
--- /dev/null
+++ b/news/_posts/2013-03-17-strata-exercises-now-available-online.html
@@ -0,0 +1,14 @@
+---
+layout: post
+title: Strata exercises now available online
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+At this year's <a href="http://strataconf.com/strata2013">Strata</a> conference, the AMP Lab hosted a full day of tutorials on Spark, Shark, and Spark Streaming, including online exercises on Amazon EC2. Those exercises are now <a href="http://ampcamp.berkeley.edu/big-data-mini-course/">available online</a>, letting you learn Spark and Shark at your own pace on an EC2 cluster with real data. They are a great resource for learning the systems. You can also find <a href="http://ampcamp.berkeley.edu/amp-camp-two-strata-2013/">slides</a> from the Strata tutorials online, as well as <a href="http://ampcamp.berkeley.edu/amp-camp-one-berkeley-2012/">videos</a> from the AMP Camp workshop we held at Berkeley in August.
diff --git a/news/_posts/2013-04-16-spark-screencasts-published.html b/news/_posts/2013-04-16-spark-screencasts-published.html
new file mode 100644
index 000000000..96168d292
--- /dev/null
+++ b/news/_posts/2013-04-16-spark-screencasts-published.html
@@ -0,0 +1,20 @@
+---
+layout: post
+title: Spark screencasts published
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '2'
+  _wpas_done_all: '1'
+---
+We have released the first two screencasts in a series of short hands-on video training courses we will be publishing to help new users get up and running with Spark in minutes.

+

+The first Spark screencast is called <a href="http://spark-project.org/screencast-1-first-steps-with-spark/">First Steps With Spark</a> and walks you through downloading and building Spark, as well as using the Spark shell, all in less than 10 minutes!

+

+The second screencast is a 2 minute <a href="http://spark-project.org/spark-documentation-overview-screencast-2/">overview of the Spark documentation</a>.

+

+We hope you find these screencasts useful.
diff --git a/news/_posts/2013-06-02-spark-0-7-2-released.html b/news/_posts/2013-06-02-spark-0-7-2-released.html
new file mode 100644
index 000000000..82ae05345
--- /dev/null
+++ b/news/_posts/2013-06-02-spark-0-7-2-released.html
@@ -0,0 +1,14 @@
+---
+layout: post
+title: Spark 0.7.2 released
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+We're happy to announce the release of <a href="http://spark-project.org/spark-release-0-7-2/" title="Spark Release 0.7.2">Spark 0.7.2</a>, a new maintenance release that includes several bug fixes and improvements, as well as new code examples and API features. We recommend that all users update to this release. Head over to the <a href="http://spark-project.org/spark-release-0-7-2/" title="Spark Release 0.7.2">release notes</a> to read about the new features, or <a href="/downloads/">download</a> the release today.
diff --git a/news/_posts/2013-06-21-spark-accepted-into-apache-incubator.html b/news/_posts/2013-06-21-spark-accepted-into-apache-incubator.html
new file mode 100644
index 000000000..1a6ca6dd8
--- /dev/null
+++ b/news/_posts/2013-06-21-spark-accepted-into-apache-incubator.html
@@ -0,0 +1,14 @@
+---
+layout: post
+title: Spark accepted into Apache Incubator
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+Spark was recently <a href="http://mail-archives.apache.org/mod_mbox/incubator-general/201306.mbox/%3CCDE7B773.E9A48%25chris.a.mattmann%40jpl.nasa.gov%3E">accepted</a> into the <a href="http://incubator.apache.org">Apache Incubator</a>, which will serve as the long-term home for the project. While moving the source code and issue tracking to Apache will take some time, we are excited to be joining the community at Apache. Stay tuned on this site for updates on how the project hosting will change.
diff --git a/news/_posts/2013-06-21-spark-featured-in-wired.html b/news/_posts/2013-06-21-spark-featured-in-wired.html
new file mode 100644
index 000000000..0b3804390
--- /dev/null
+++ b/news/_posts/2013-06-21-spark-featured-in-wired.html
@@ -0,0 +1,15 @@
+---
+layout: post
+title: Spark featured in Wired
+categories:
+- In-The-News
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+Spark, its creators at the AMP Lab, and some of its users were featured in a <a href="http://www.wired.com/wiredenterprise/2013/06/yahoo-amazon-amplab-spark/all/">Wired Enterprise article</a> a few days ago. Read on to learn a little about how Spark is being used in industry.
diff --git a/news/_posts/2013-07-16-spark-0-7-3-released.html b/news/_posts/2013-07-16-spark-0-7-3-released.html
new file mode 100644
index 000000000..862aab74e
--- /dev/null
+++ b/news/_posts/2013-07-16-spark-0-7-3-released.html
@@ -0,0 +1,14 @@
+---
+layout: post
+title: Spark 0.7.3 released
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+We've just posted <a href="http://spark-project.org/spark-release-0-7-3/" title="Spark Release 0.7.3">Spark Release 0.7.3</a>, a maintenance release that contains several fixes, including streaming API updates and new functionality for adding JARs to a <code>spark-shell</code> session. We recommend that all users update to this release. Visit the <a href="http://spark-project.org/spark-release-0-7-3/" title="Spark Release 0.7.3">release notes</a> to read about the new features, or <a href="/downloads/">download</a> the release today.
diff --git a/news/_posts/2013-07-22-spark-mailing-lists-moving-to-apache.html b/news/_posts/2013-07-22-spark-mailing-lists-moving-to-apache.html
new file mode 100644
index 000000000..d0cdb52d3
--- /dev/null
+++ b/news/_posts/2013-07-22-spark-mailing-lists-moving-to-apache.html
@@ -0,0 +1,25 @@
+---
+layout: post
+title: Spark mailing lists moving to Apache
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+<p>As part of the Spark project's recent move to Apache, we are planning to migrate the mailing lists to Apache infrastructure this month, so that <strong>the existing Google groups will become read-only on September 1, 2013</strong>. To keep receiving updates about Spark or to participate in development discussions, please subscribe to the following lists:</p>

+

+<ul>

+  <li>

+    <a href="http://mail-archives.apache.org/mod_mbox/incubator-spark-user/">user@spark.incubator.apache.org</a> -- for usage questions, help, and announcements. <a href="mailto:user-subscribe@spark.incubator.apache.org?subject=(send%20this%20email%20to%20subscribe)">(subscribe)</a> <a href="http://mail-archives.apache.org/mod_mbox/incubator-spark-user/">(archives)</a>

+  </li>

+  <li>

+    <a href="http://mail-archives.apache.org/mod_mbox/incubator-spark-dev/">dev@spark.incubator.apache.org</a> -- for people who want to contribute code to Spark. <a href="mailto:dev-subscribe@spark.incubator.apache.org?subject=(send%20this%20email%20to%20subscribe)">(subscribe)</a> <a href="http://mail-archives.apache.org/mod_mbox/incubator-spark-dev/">(archives)</a>

+  </li>

+</ul>

+

+<p>Most users will probably want the User list, but individuals interested in contributing code to the project should also subscribe to the Dev list.</p>
diff --git a/news/_posts/2013-07-23-amp-camp-2013-registration-ope.html b/news/_posts/2013-07-23-amp-camp-2013-registration-ope.html
new file mode 100644
index 000000000..7be7cc0fe
--- /dev/null
+++ b/news/_posts/2013-07-23-amp-camp-2013-registration-ope.html
@@ -0,0 +1,14 @@
+---
+layout: post
+title: Registration open for AMP Camp training camp in Berkeley
+categories:
+- News
+tags: []
+status: publish
+type: post
+published: true
+meta:
+  _edit_last: '4'
+  _wpas_done_all: '1'
+---
+Want to learn how to use Spark, Shark, GraphX, and related technologies in person? The AMP Lab is hosting a two-day training workshop for them on August 29th and 30th in Berkeley. The workshop will include tutorials, talks from users, and over four hours of hands-on exercises. <a href="http://ampcamp.berkeley.edu/amp-camp-three-berkeley-2013/">Registration is now open on the AMP Camp website</a>, for a price of $250 per person. We recommend signing up early because last year's workshop was sold out.
diff --git a/news/index.md b/news/index.md
new file mode 100644
index 000000000..4434ecde7
--- /dev/null
+++ b/news/index.md
@@ -0,0 +1,15 @@
+---
+layout: global
+type: archive
+title: Spark News Archive
+---
+## Spark News Archive
+{% for post in site.categories.news %}
+  <article class="hentry">
+    <header class="entry-header">
+      <h1 class="entry-title"><a href="{{ post.url }}">{{ post.title }}</a></h1>
+      <div class="entry-meta">{{post.date | date: "%B %d, %Y"}}</div>
+    </header>
+    <div class="entry-content">{{post.excerpt}}</div>
+  </article>
+{% endfor %}