diff options
Diffstat (limited to 'site/releases/spark-release-1-0-0.html')
| -rw-r--r-- | site/releases/spark-release-1-0-0.html | 238 |
1 files changed, 119 insertions, 119 deletions
diff --git a/site/releases/spark-release-1-0-0.html b/site/releases/spark-release-1-0-0.html index 5862e2113..76649de87 100644 --- a/site/releases/spark-release-1-0-0.html +++ b/site/releases/spark-release-1-0-0.html @@ -192,11 +192,11 @@ <p>Spark 1.0 adds support for Java 8 <a href="http://docs.oracle.com/javase/tutorial/java/javaOO/lambdaexpressions.html">new lambda syntax</a> in its Java bindings. Java 8 supports a concise syntax for writing anonymous functions, similar to the closure syntax in Scala and Python. This change requires small changes for users of the current Java API, which are noted in the documentation. Spark’s Python API has been extended to support several new functions. We’ve also included several stability improvements in the Python API, particularly for large datasets. PySpark now supports running on YARN as well.</p> <h3 id="documentation">Documentation</h3> -<p>Spark’s <a href="/docs/latest/programming-guide.html">programming guide</a> has been significantly expanded to centrally cover all supported languages and discuss more operators and aspects of the development life cycle. The <a href="/docs/latest/mllib-guide.html">MLlib guide</a> has also been expanded with significantly more detail and examples for each algorithm, while documents on configuration, YARN and Mesos have also been revamped.</p> +<p>Spark’s <a href="/docs/latest/programming-guide.html">programming guide</a> has been significantly expanded to centrally cover all supported languages and discuss more operators and aspects of the development life cycle. The <a href="/docs/latest/mllib-guide.html">MLlib guide</a> has also been expanded with significantly more detail and examples for each algorithm, while documents on configuration, YARN and Mesos have also been revamped.</p> <h3 id="smaller-changes">Smaller Changes</h3> <ul> - <li>PySpark now works with more Python versions than before – Python 2.6+ instead of 2.7+, and NumPy 1.4+ instead of 1.7+.</li> + <li>PySpark now works with more Python versions than before – Python 2.6+ instead of 2.7+, and NumPy 1.4+ instead of 1.7+.</li> <li>Spark has upgraded to Avro 1.7.6, adding support for Avro specific types.</li> <li>Internal instrumentation has been added to allow applications to monitor and instrument Spark jobs.</li> <li>Support for off-heap storage in Tachyon has been added via a special build target.</li> @@ -213,123 +213,123 @@ <p>The following developers contributed to this release:</p> <ul> - <li>Aaron Davidson – packaging and deployment improvements, several bug fixes, local[*] mode</li> - <li>Aaron Kimball – documentation improvements</li> - <li>Abhishek Kumar – Python configuration fixes</li> - <li>Ahir Reddy – PySpark build, fixes, and cancellation support</li> - <li>Allan Douglas R. de Oliveira – Improvements to spark-ec2 scripts</li> - <li>Andre Schumacher – Parquet support and optimizations</li> - <li>Andrew Ash – Mesos documentation and other doc improvements, bug fixes</li> - <li>Andrew Or – history server (lead), garbage collection (lead), spark-submit, PySpark and YARN improvements</li> - <li>Andrew Tulloch – MLlib contributions and code clean-up</li> - <li>Andy Konwinski – documentation fix</li> - <li>Anita Tailor – Cassandra example</li> - <li>Ankur Dave – GraphX (lead) optimizations, documentation, and usability</li> - <li>Archer Shao – bug fixes</li> - <li>Arun Ramakrishnan – improved random sampling</li> - <li>Baishuo – test improvements</li> - <li>Bernardo Gomez Palacio – spark-shell improvements and Mesos updates</li> - <li>Bharath Bhushan – bug fix</li> - <li>Bijay Bisht – bug fixes</li> - <li>Binh Nguyen – dependency fix</li> - <li>Bouke van der Bijl – fixes for PySpark on Mesos and other Mesos fixes</li> - <li>Bryn Keller – improvement to HBase support and unit tests</li> - <li>Chen Chao – documentation, bug fix, and code clean-up</li> - <li>Cheng Hao – performance and feature improvements in Spark SQL</li> - <li>Cheng Lian – column storage and other improvements in Spark SQL</li> - <li>Christian Lundgren – improvement to spark-ec2 scripts</li> - <li>DB Tsai – L-BGFS optimizer in MLlib, MLlib documentation and fixes</li> - <li>Dan McClary – Improvement to stats counter</li> - <li>Daniel Darabos – GraphX performance improvement</li> - <li>Davis Shepherd – bug fix</li> - <li>Diana Carroll – documentation and bug fix</li> - <li>Egor Pakhomov – local iterator for RDD’s</li> - <li>Emtiaz Ahmed – bug fix</li> - <li>Erik Selin – bug fix</li> - <li>Ethan Jewett – documentation improvement</li> - <li>Evan Chan – automatic clean-up of application data</li> - <li>Evan Sparks – MLlib optimizations and doc improvement</li> - <li>Frank Dai – code clean-up in MLlib</li> - <li>Guoquiang Li – build improvements and several bug fixes</li> - <li>Ghidireac – bug fix</li> - <li>Haoyuan Li – Tachyon storage level for RDD’s</li> - <li>Harvey Feng – spark-ec2 update</li> - <li>Henry Saputra – code clean-up</li> - <li>Henry Cook – Spark SQL improvements</li> - <li>Holden Karau – cross validation in MLlib, Python and core engine improvements</li> - <li>Ivan Wick – Mesos bug fix</li> - <li>Jey Kottalam – sbt build improvement</li> - <li>Jerry Shao – Spark metrics and Spark SQL improvements</li> - <li>Jiacheng Guo – bug fix</li> - <li>Jianghan – bug fix</li> - <li>Jianping J Wang – JBLAS support in MLlib</li> - <li>Joseph E. Gonzalez – GraphX improvements, fixes, and documentation</li> - <li>Josh Rosen – PySpark improvements and bug fixes</li> - <li>Jyotiska NK – documentation, test improvements, and bug fix</li> - <li>Kan Zhang – bug fixes in Spark core, SQL, and PySpark</li> - <li>Kay Ousterhout – bug fixes and code refactoring in scheduler</li> - <li>Kelvin Chu – automatic clean-up of application data</li> - <li>Kevin Mader – example fix</li> - <li>Koert Kuipers – code visibility fix</li> - <li>Kousuke Saruta – documentation and build fixes</li> - <li>Kyle Ellrott – improved memory usage for DISK_ONLY persistence</li> - <li>Larva Boy – approximate counts in Spark SQL</li> - <li>Madhu Siddalingaiah – ec2 fixes</li> - <li>Manish Amde – decision trees in MLlib</li> - <li>Marcelo Vanzin – improvements and fixes to YARN support, dependency clean-up</li> - <li>Mark Grover – build fixes</li> - <li>Mark Hamstra – build and dependency improvements, scheduler bug fixes</li> - <li>Margin Jaggi – MLlib documentation improvements</li> - <li>Matei Zaharia – Python versions of several MLlib algorithms, spark-submit improvements, bug fixes, and documentation improvements</li> - <li>Michael Armbrust – Spark SQL (lead), including schema support for RDD’s, catalyst optimizer, and Hive support</li> - <li>Mridul Muralidharan – code visibility changes and bug fixes</li> - <li>Nan Zhu – bug and stability fixes, code clean-up, documentation, and new features</li> - <li>Neville Li – bug fix</li> - <li>Nick Lanham – Tachyon bundling in distribution script</li> - <li>Nirmal Reddy – code clean-up</li> - <li>OuYang Jin – local mode and json improvements</li> - <li>Patrick Wendell – release manager, build improvements, bug fixes, and code clean-up</li> - <li>Petko Nikolov – new utility functions</li> - <li>Prabeesh K – typo fix</li> - <li>Prabin Banka – new PySpark API’s</li> - <li>Prashant Sharma – PySpark improvements, Java 8 lambda support, and build improvements</li> - <li>Punya Biswal – Java API improvements</li> - <li>Qiuzhuang Lian – bug fixes</li> - <li>Rahul Singhal – build improvements, bug fixes</li> - <li>Raymond Liu – YARN build fixes and UI improvements</li> - <li>Reynold Xin – bug fixes, internal changes, Spark SQL improvements, build fixes, and style improvements</li> - <li>Reza Zadeh – SVD implementation in MLlib and other MLlib contributions</li> - <li>Roman Pastukhov – clean-up of broadcast files</li> - <li>Rong Gu – Tachyon storage level for RDD’s</li> - <li>Sandeep Sing – several bug fixes, MLLib improvements and fixes to Spark examples</li> - <li>Sandy Ryza – spark-submit script and several YARN improvements</li> - <li>Saurabh Rawat – Java API improvements</li> - <li>Sean Owen – several build improvements, code clean-up, and MLlib fixes</li> - <li>Semih Salihoglu – GraphX improvements</li> - <li>Shaocun Tian – bug fix in MLlib</li> - <li>Shivaram Venkataraman – bug fixes</li> - <li>Shixiong Zhu – code style and correctness fixes</li> - <li>Shiyun Wxm – typo fix</li> - <li>Stevo Slavic – bug fix</li> - <li>Sumedh Mungee – documentation fix</li> - <li>Sundeep Narravula – “cancel” button in Spark UI</li> - <li>Takayu Ueshin – bug fixes and improvements to Spark SQL</li> - <li>Tathagata Das – web UI and other improvements to Spark Streaming (lead), bug fixes, state clean-up, and release manager</li> - <li>Timothy Chen – Spark SQL improvements</li> - <li>Ted Malaska – improved Flume support</li> - <li>Tom Graves – Hadoop security integration (lead) and YARN support</li> - <li>Tianshuo Deng – Bug fix</li> - <li>Tor Myklebust – improvements to ALS</li> - <li>Wangfei – Spark SQL docs</li> - <li>Wang Tao – code clean-up</li> - <li>William Bendon – JSON support changes and bug fixes</li> - <li>Xiangrui Meng – several improvements to MLlib (lead)</li> - <li>Xuan Nguyen – build fix</li> - <li>Xusen Yin – MLlib contributions and bug fix</li> - <li>Ye Xianjin – test fixes</li> - <li>Yinan Li – addFile improvement</li> - <li>Yin Hua – Spark SQL improvements</li> - <li>Zheng Peng – bug fixes</li> + <li>Aaron Davidson – packaging and deployment improvements, several bug fixes, local[*] mode</li> + <li>Aaron Kimball – documentation improvements</li> + <li>Abhishek Kumar – Python configuration fixes</li> + <li>Ahir Reddy – PySpark build, fixes, and cancellation support</li> + <li>Allan Douglas R. de Oliveira – Improvements to spark-ec2 scripts</li> + <li>Andre Schumacher – Parquet support and optimizations</li> + <li>Andrew Ash – Mesos documentation and other doc improvements, bug fixes</li> + <li>Andrew Or – history server (lead), garbage collection (lead), spark-submit, PySpark and YARN improvements</li> + <li>Andrew Tulloch – MLlib contributions and code clean-up</li> + <li>Andy Konwinski – documentation fix</li> + <li>Anita Tailor – Cassandra example</li> + <li>Ankur Dave – GraphX (lead) optimizations, documentation, and usability</li> + <li>Archer Shao – bug fixes</li> + <li>Arun Ramakrishnan – improved random sampling</li> + <li>Baishuo – test improvements</li> + <li>Bernardo Gomez Palacio – spark-shell improvements and Mesos updates</li> + <li>Bharath Bhushan – bug fix</li> + <li>Bijay Bisht – bug fixes</li> + <li>Binh Nguyen – dependency fix</li> + <li>Bouke van der Bijl – fixes for PySpark on Mesos and other Mesos fixes</li> + <li>Bryn Keller – improvement to HBase support and unit tests</li> + <li>Chen Chao – documentation, bug fix, and code clean-up</li> + <li>Cheng Hao – performance and feature improvements in Spark SQL</li> + <li>Cheng Lian – column storage and other improvements in Spark SQL</li> + <li>Christian Lundgren – improvement to spark-ec2 scripts</li> + <li>DB Tsai – L-BGFS optimizer in MLlib, MLlib documentation and fixes</li> + <li>Dan McClary – Improvement to stats counter</li> + <li>Daniel Darabos – GraphX performance improvement</li> + <li>Davis Shepherd – bug fix</li> + <li>Diana Carroll – documentation and bug fix</li> + <li>Egor Pakhomov – local iterator for RDD’s</li> + <li>Emtiaz Ahmed – bug fix</li> + <li>Erik Selin – bug fix</li> + <li>Ethan Jewett – documentation improvement</li> + <li>Evan Chan – automatic clean-up of application data</li> + <li>Evan Sparks – MLlib optimizations and doc improvement</li> + <li>Frank Dai – code clean-up in MLlib</li> + <li>Guoquiang Li – build improvements and several bug fixes</li> + <li>Ghidireac – bug fix</li> + <li>Haoyuan Li – Tachyon storage level for RDD’s</li> + <li>Harvey Feng – spark-ec2 update</li> + <li>Henry Saputra – code clean-up</li> + <li>Henry Cook – Spark SQL improvements</li> + <li>Holden Karau – cross validation in MLlib, Python and core engine improvements</li> + <li>Ivan Wick – Mesos bug fix</li> + <li>Jey Kottalam – sbt build improvement</li> + <li>Jerry Shao – Spark metrics and Spark SQL improvements</li> + <li>Jiacheng Guo – bug fix</li> + <li>Jianghan – bug fix</li> + <li>Jianping J Wang – JBLAS support in MLlib</li> + <li>Joseph E. Gonzalez – GraphX improvements, fixes, and documentation</li> + <li>Josh Rosen – PySpark improvements and bug fixes</li> + <li>Jyotiska NK – documentation, test improvements, and bug fix</li> + <li>Kan Zhang – bug fixes in Spark core, SQL, and PySpark</li> + <li>Kay Ousterhout – bug fixes and code refactoring in scheduler</li> + <li>Kelvin Chu – automatic clean-up of application data</li> + <li>Kevin Mader – example fix</li> + <li>Koert Kuipers – code visibility fix</li> + <li>Kousuke Saruta – documentation and build fixes</li> + <li>Kyle Ellrott – improved memory usage for DISK_ONLY persistence</li> + <li>Larva Boy – approximate counts in Spark SQL</li> + <li>Madhu Siddalingaiah – ec2 fixes</li> + <li>Manish Amde – decision trees in MLlib</li> + <li>Marcelo Vanzin – improvements and fixes to YARN support, dependency clean-up</li> + <li>Mark Grover – build fixes</li> + <li>Mark Hamstra – build and dependency improvements, scheduler bug fixes</li> + <li>Margin Jaggi – MLlib documentation improvements</li> + <li>Matei Zaharia – Python versions of several MLlib algorithms, spark-submit improvements, bug fixes, and documentation improvements</li> + <li>Michael Armbrust – Spark SQL (lead), including schema support for RDD’s, catalyst optimizer, and Hive support</li> + <li>Mridul Muralidharan – code visibility changes and bug fixes</li> + <li>Nan Zhu – bug and stability fixes, code clean-up, documentation, and new features</li> + <li>Neville Li – bug fix</li> + <li>Nick Lanham – Tachyon bundling in distribution script</li> + <li>Nirmal Reddy – code clean-up</li> + <li>OuYang Jin – local mode and json improvements</li> + <li>Patrick Wendell – release manager, build improvements, bug fixes, and code clean-up</li> + <li>Petko Nikolov – new utility functions</li> + <li>Prabeesh K – typo fix</li> + <li>Prabin Banka – new PySpark API’s</li> + <li>Prashant Sharma – PySpark improvements, Java 8 lambda support, and build improvements</li> + <li>Punya Biswal – Java API improvements</li> + <li>Qiuzhuang Lian – bug fixes</li> + <li>Rahul Singhal – build improvements, bug fixes</li> + <li>Raymond Liu – YARN build fixes and UI improvements</li> + <li>Reynold Xin – bug fixes, internal changes, Spark SQL improvements, build fixes, and style improvements</li> + <li>Reza Zadeh – SVD implementation in MLlib and other MLlib contributions</li> + <li>Roman Pastukhov – clean-up of broadcast files</li> + <li>Rong Gu – Tachyon storage level for RDD’s</li> + <li>Sandeep Sing – several bug fixes, MLLib improvements and fixes to Spark examples</li> + <li>Sandy Ryza – spark-submit script and several YARN improvements</li> + <li>Saurabh Rawat – Java API improvements</li> + <li>Sean Owen – several build improvements, code clean-up, and MLlib fixes</li> + <li>Semih Salihoglu – GraphX improvements</li> + <li>Shaocun Tian – bug fix in MLlib</li> + <li>Shivaram Venkataraman – bug fixes</li> + <li>Shixiong Zhu – code style and correctness fixes</li> + <li>Shiyun Wxm – typo fix</li> + <li>Stevo Slavic – bug fix</li> + <li>Sumedh Mungee – documentation fix</li> + <li>Sundeep Narravula – “cancel” button in Spark UI</li> + <li>Takayu Ueshin – bug fixes and improvements to Spark SQL</li> + <li>Tathagata Das – web UI and other improvements to Spark Streaming (lead), bug fixes, state clean-up, and release manager</li> + <li>Timothy Chen – Spark SQL improvements</li> + <li>Ted Malaska – improved Flume support</li> + <li>Tom Graves – Hadoop security integration (lead) and YARN support</li> + <li>Tianshuo Deng – Bug fix</li> + <li>Tor Myklebust – improvements to ALS</li> + <li>Wangfei – Spark SQL docs</li> + <li>Wang Tao – code clean-up</li> + <li>William Bendon – JSON support changes and bug fixes</li> + <li>Xiangrui Meng – several improvements to MLlib (lead)</li> + <li>Xuan Nguyen – build fix</li> + <li>Xusen Yin – MLlib contributions and bug fix</li> + <li>Ye Xianjin – test fixes</li> + <li>Yinan Li – addFile improvement</li> + <li>Yin Hua – Spark SQL improvements</li> + <li>Zheng Peng – bug fixes</li> </ul> <p><em>Thanks to everyone who contributed!</em></p> |