|
|
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>
Spark Release 1.1.1 | Apache Spark
</title>
<!-- Bootstrap core CSS -->
<link href="/css/cerulean.min.css" rel="stylesheet">
<link href="/css/custom.css" rel="stylesheet">
<!-- Code highlighter CSS -->
<link href="/css/pygments-default.css" rel="stylesheet">
<script type="text/javascript">
<!-- Google Analytics initialization -->
var _gaq = _gaq || [];
_gaq.push(['_setAccount', 'UA-32518208-2']);
_gaq.push(['_trackPageview']);
(function() {
var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
})();
<!-- Adds slight delay to links to allow async reporting -->
function trackOutboundLink(link, category, action) {
try {
_gaq.push(['_trackEvent', category , action]);
} catch(err){}
setTimeout(function() {
document.location.href = link.href;
}, 100);
}
</script>
<!-- HTML5 shim and Respond.js IE8 support of HTML5 elements and media queries -->
<!--[if lt IE 9]>
<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
<script src="https://oss.maxcdn.com/libs/respond.js/1.3.0/respond.min.js"></script>
<![endif]-->
</head>
<body>
<script src="https://code.jquery.com/jquery.js"></script>
<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
<script src="/js/lang-tabs.js"></script>
<script src="/js/downloads.js"></script>
<div class="container" style="max-width: 1200px;">
<div class="masthead">
<p class="lead">
<a href="/">
<img src="/images/spark-logo-trademark.png"
style="height:100px; width:auto; vertical-align: bottom; margin-top: 20px;"></a><span class="tagline">
Lightning-fast cluster computing
</span>
</p>
</div>
<nav class="navbar navbar-default" role="navigation">
<!-- Brand and toggle get grouped for better mobile display -->
<div class="navbar-header">
<button type="button" class="navbar-toggle" data-toggle="collapse"
data-target="#navbar-collapse-1">
<span class="sr-only">Toggle navigation</span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
</button>
</div>
<!-- Collect the nav links, forms, and other content for toggling -->
<div class="collapse navbar-collapse" id="navbar-collapse-1">
<ul class="nav navbar-nav">
<li><a href="/downloads.html">Download</a></li>
<li class="dropdown">
<a href="#" class="dropdown-toggle" data-toggle="dropdown">
Libraries <b class="caret"></b>
</a>
<ul class="dropdown-menu">
<li><a href="/sql/">SQL and DataFrames</a></li>
<li><a href="/streaming/">Spark Streaming</a></li>
<li><a href="/mllib/">MLlib (machine learning)</a></li>
<li><a href="/graphx/">GraphX (graph)</a></li>
<li class="divider"></li>
<li><a href="https://cwiki.apache.org/confluence/display/SPARK/Third+Party+Projects">Third-Party Packages</a></li>
</ul>
</li>
<li class="dropdown">
<a href="#" class="dropdown-toggle" data-toggle="dropdown">
Documentation <b class="caret"></b>
</a>
<ul class="dropdown-menu">
<li><a href="/docs/latest/">Latest Release (Spark 2.0.0)</a></li>
<li><a href="/documentation.html">Older Versions and Other Resources</a></li>
</ul>
</li>
<li><a href="/examples.html">Examples</a></li>
<li class="dropdown">
<a href="/community.html" class="dropdown-toggle" data-toggle="dropdown">
Community <b class="caret"></b>
</a>
<ul class="dropdown-menu">
<li><a href="/community.html">Mailing Lists</a></li>
<li><a href="/community.html#events">Events and Meetups</a></li>
<li><a href="/community.html#history">Project History</a></li>
<li><a href="https://cwiki.apache.org/confluence/display/SPARK/Powered+By+Spark">Powered By</a></li>
<li><a href="https://cwiki.apache.org/confluence/display/SPARK/Committers">Project Committers</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPARK">Issue Tracker</a></li>
</ul>
</li>
<li><a href="/faq.html">FAQ</a></li>
</ul>
<ul class="nav navbar-nav navbar-right">
<li class="dropdown">
<a href="http://www.apache.org/" class="dropdown-toggle" data-toggle="dropdown">
Apache Software Foundation <b class="caret"></b></a>
<ul class="dropdown-menu">
<li><a href="http://www.apache.org/">Apache Homepage</a></li>
<li><a href="http://www.apache.org/licenses/">License</a></li>
<li><a href="http://www.apache.org/foundation/sponsorship.html">Sponsorship</a></li>
<li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
<li><a href="http://www.apache.org/security/">Security</a></li>
</ul>
</li>
</ul>
</div>
<!-- /.navbar-collapse -->
</nav>
<div class="row">
<div class="col-md-3 col-md-push-9">
<div class="news" style="margin-bottom: 20px;">
<h5>Latest News</h5>
<ul class="list-unstyled">
<li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a>
<span class="small">(Oct 03, 2016)</span></li>
<li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a>
<span class="small">(Jul 26, 2016)</span></li>
<li><a href="/news/spark-1-6-2-released.html">Spark 1.6.2 released</a>
<span class="small">(Jun 25, 2016)</span></li>
<li><a href="/news/submit-talks-to-spark-summit-eu-2016.html">Call for Presentations for Spark Summit EU is Open</a>
<span class="small">(Jun 16, 2016)</span></li>
</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
<div class="hidden-xs hidden-sm">
<a href="/downloads.html" class="btn btn-success btn-lg btn-block" style="margin-bottom: 30px;">
Download Spark
</a>
<p style="font-size: 16px; font-weight: 500; color: #555;">
Built-in Libraries:
</p>
<ul class="list-none">
<li><a href="/sql/">SQL and DataFrames</a></li>
<li><a href="/streaming/">Spark Streaming</a></li>
<li><a href="/mllib/">MLlib (machine learning)</a></li>
<li><a href="/graphx/">GraphX (graph)</a></li>
</ul>
<a href="https://cwiki.apache.org/confluence/display/SPARK/Third+Party+Projects">Third-Party Packages</a>
</div>
</div>
<div class="col-md-9 col-md-pull-3">
<h2>Spark Release 1.1.1</h2>
<p>Spark 1.1.1 is a maintenance release with bug fixes. This release is based on the <a href="https://github.com/apache/spark/tree/branch-1.1">branch-1.1</a> maintenance branch of Spark. We recommend all 1.1.0 users to upgrade to this stable release. Contributions to this release came from 55 developers.</p>
<p>To download Spark 1.1.1 visit the <a href="/downloads.html">downloads</a> page.</p>
<h3 id="fixes">Fixes</h3>
<p>Spark 1.1.1 contains bug fixes in several components. Some of the more important fixes are highlighted below. You can visit the <a href="http://s.apache.org/z9h">Spark issue tracker</a> for the full list of fixes.</p>
<h4 id="spark-core">Spark Core</h4>
<ul>
<li>Avoid many small spills in external data structures (<a href="https://issues.apache.org/jira/browse/SPARK-4480">SPARK-4480</a>)</li>
<li>Memory leak in connection manager timeout thread (<a href="https://issues.apache.org/jira/browse/SPARK-4393">SPARK-4393</a>)</li>
<li>Incorrect of channel read return value may lead to data truncation (<a href="https://issues.apache.org/jira/browse/SPARK-4107">SPARK-4107</a>)</li>
<li>Stream corruption exceptions observed in sort-based shuffle (<a href="https://issues.apache.org/jira/browse/SPARK-3948">SPARK-3948</a>)</li>
<li>Integer overflow in sort-based shuffle key comparison (<a href="https://issues.apache.org/jira/browse/SPARK-3032">SPARK-3032</a>)</li>
<li>Lack of thread safety in Hadoop configuration usage in Spark (<a href="https://issues.apache.org/jira/browse/SPARK-2546">SPARK-2546</a>)</li>
</ul>
<h4 id="sql">SQL</h4>
<ul>
<li>Wrong Parquet filters are created for all inequality predicates with literals on the left hand side (<a href="https://issues.apache.org/jira/browse/SPARK-4468">SPARK-4468</a>)</li>
<li>Support backticks in aliases (<a href="https://issues.apache.org/jira/browse/SPARK-3708">SPARK-3708</a> and <a href="https://issues.apache.org/jira/browse/SPARK-3834">SPARK-3834</a>)</li>
<li>ColumnValue types do not match in Spark rows vs Hive rows (<a href="https://github.com/apache/spark/pull/3704">SPARK-3704</a>)</li>
</ul>
<h4 id="pyspark">PySpark</h4>
<ul>
<li>Fix sortByKey on empty RDD (<a href="https://issues.apache.org/jira/browse/SPARK-4304">SPARK-4304</a>)</li>
<li>Avoid using the same random seed for all partitions (<a href="https://issues.apache.org/jira/browse/SPARK-4148">SPARK-4148</a>)</li>
<li>Avoid OOMs when take() is run on empty partitions (<a href="https://issues.apache.org/jira/browse/SPARK-3211">SPARK-3211</a>)</li>
</ul>
<h4 id="mllib">MLlib</h4>
<ul>
<li>KryoException caused by ALS.trainImplicit in PySpark (<a href="https://issues.apache.org/jira/browse/SPARK-3990">SPARK-3990</a>)</li>
</ul>
<h4 id="streaming">Streaming</h4>
<ul>
<li>Block replication continuously fails if target is down (<a href="https://issues.apache.org/jira/browse/SPARK-3495">SPARK-3495</a>)</li>
<li>Block replication may choose driver as target (<a href="https://issues.apache.org/jira/browse/SPARK-3496">SPARK-3496</a>)</li>
</ul>
<h4 id="graphx">GraphX</h4>
<ul>
<li>Ensure VertexRDD.apply uses mergeFunc (<a href="https://issues.apache.org/jira/browse/SPARK-2062">SPARK-2062</a>)</li>
</ul>
<h3 id="contributors">Contributors</h3>
<p>The following developers contributed to this release:</p>
<ul>
<li>Andrew Ash - Documentation and bug fixes in Core</li>
<li>Andrew Or - Improvements in Core; bug fixes in Windows, Core, Block Manager, and Shuffle</li>
<li>Aniket Bhatnagar - Bug fixes in Core and Streaming</li>
<li>Benjamin Piering - Improvements in GraphX</li>
<li>Bertrand Bossy - Bug fixes in Core</li>
<li>Brenden Matthews - Bug fixes in Mesos</li>
<li>Chao Chen - Documentation in Core</li>
<li>Cheng Hao - Test in SQL</li>
<li>Cheng Lian - Bug fixes in PySpark, MLlib, and SQL</li>
<li>Chirag Aggarwal - Bug fixes in SQL</li>
<li>Chris Cope - Bug fixes in YARN</li>
<li>Davies Liu - Improvements in PySpark; bug fixes in Core, SQL, and PySpark</li>
<li>Eric Eijkelenboom - Bug fixes in Core</li>
<li>Eric Liang - Bug fixes in Core and SQL</li>
<li>Eugen Cepoi - Improvements in Core</li>
<li>Fei Wang - Improvements in Core and SQL; bug fixes in Core; documentation in Streaming</li>
<li>Grega Kespret - Documentation in Core</li>
<li>Guoqiang Li - Bug fixes in Web UI</li>
<li>Henry Cook - Documentation in Core</li>
<li>Hossein Falaki - Bug fixes in Web UI</li>
<li>Ian Hummel - Improvements in Core</li>
<li>Jakub Dubovsky - Bug fixes in Core</li>
<li>Jerry Shao - Bug fixes in Shuffle</li>
<li>Jongyoul Lee - Bug fixes in Core and Mesos</li>
<li>Josh Rosen - Improvements in Core; bug fixes in Streaming and Core</li>
<li>Kousuke Saruta - Improvements in Core and Web UI; bug fixes in Core, Web UI, and PySpark</li>
<li>Larry Xiao - Bug fixes in GraphX</li>
<li>Lianhui Wang - Bug fixes in GraphX</li>
<li>Liang-Chi Hsieh - Bug fixes in Core</li>
<li>Lu Lu - Improvements in GraphX</li>
<li>Ma Ji - Bug fixes in Streaming</li>
<li>Marcelo Vanzin - Bug fixes in YARN</li>
<li>Mark Hamstra - Bug fixes in Core</li>
<li>Masayoshi Tsuzuki - Improvements in Core, Shell, and PySpark; bug fixes in Windows and PySpark</li>
<li>Michael Armbrust - Documentation in Core</li>
<li>Michael Griffiths - Bug fixes in PySpark</li>
<li>Min Shen - Bug fixes in YARN</li>
<li>Mubarak Seyed - Improvements in Streaming</li>
<li>Nicholas Chammas - Documentation in Core</li>
<li>Niklas Wilcke - Bug fixes in Core</li>
<li>Oded Zimerman - Bug fixes in GraphX</li>
<li>Reynold Xin - New features in Core; bug fixes in Core and SQL</li>
<li>Rongquan Su - Improvements in Streaming</li>
<li>Sandy Ryza - Bug fixes in Core</li>
<li>Sean Owen - Bug fixes in Java API, Core, and Streaming</li>
<li>Shane Knapp - Bug fixes in Core</li>
<li>Shixiong Zhu - Improvements in Web UI; bug fixes in Core and YARN</li>
<li>Shuo Xiang - Bug fixes in MLlib</li>
<li>Tal Sliwowicz - Bug fixes in Core and Block Manager</li>
<li>Tao Wang - Improvements and bug fixes in Core</li>
<li>Tathagata Das - Improvements in Streaming; bug fixes in Core, Block Manager, and Streaming</li>
<li>Xiangrui Meng - Improvements in Web UI and PySpark; bug fixes in Core, MLlib, and PySpark</li>
<li>Yantang Zhai - Bug fixes in Core and Web UI</li>
<li>Yash Datta - Improvements in SQL</li>
<li>Yin Huai - Documentation in Core</li>
</ul>
<p><em>Thanks to everyone who contributed!</em></p>
<p>
<br/>
<a href="/news/">Spark News Archive</a>
</p>
</div>
</div>
<footer class="small">
<hr>
Apache Spark, Spark, Apache, and the Spark logo are <a href="/trademarks.html">trademarks</a> of
<a href="http://www.apache.org">The Apache Software Foundation</a>.
</footer>
</div>
</body>
</html>
|
