Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | ported repl improvements from master | Prashant Sharma | 2013-09-15 | 2 | -2/+11 |
| | |||||
* | version changed 2.9.3 -> 2.10 in shell script. | Prashant Sharma | 2013-09-15 | 10 | -17/+9 |
| | |||||
* | Merge branch 'master' of git://github.com/mesos/spark into scala-2.10 | Prashant Sharma | 2013-09-15 | 77 | -465/+1824 |
|\ | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/SparkContext.scala project/SparkBuild.scala | ||||
| * | Merge pull request #929 from pwendell/master | Patrick Wendell | 2013-09-13 | 2 | -5/+11 |
| |\ | | | | | | | Use different Hadoop version for YARN artifacts. | ||||
| | * | Use different Hadoop version for YARN artifacts. | Patrick Wendell | 2013-09-13 | 2 | -5/+11 |
| |/ | | | | | | | | | This uses a seperate Hadoop version for YARN artifact. This means when people link against spark-yarn, things will resolve correctly. | ||||
| * | Add git scm url for publishing | Patrick Wendell | 2013-09-12 | 1 | -0/+1 |
| | | |||||
| * | Merge pull request #926 from kayousterhout/dynamic | Patrick Wendell | 2013-09-11 | 1 | -9/+9 |
| |\ | | | | | | | Changed localProperties to use ThreadLocal (not DynamicVariable). | ||||
| | * | Changed localProperties to use ThreadLocal (not DynamicVariable). | Kay Ousterhout | 2013-09-11 | 1 | -9/+9 |
| | | | | | | | | | | | | | | | | | | The fact that DynamicVariable uses an InheritableThreadLocal can cause problems where the properties end up being shared across threads in certain circumstances. | ||||
| * | | Merge pull request #927 from benh/mesos-docs | Matei Zaharia | 2013-09-11 | 1 | -17/+16 |
| |\ \ | | |/ | |/| | Updated Spark on Mesos documentation. | ||||
| | * | More updates to Spark on Mesos documentation. | Benjamin Hindman | 2013-09-11 | 1 | -2/+2 |
| | | | |||||
| | * | Updated Spark on Mesos documentation. | Benjamin Hindman | 2013-09-11 | 1 | -17/+16 |
| |/ | |||||
| * | Merge pull request #919 from mateiz/jets3t | Patrick Wendell | 2013-09-11 | 3 | -0/+11 |
| |\ | | | | | | | Add explicit jets3t dependency, which is excluded in hadoop-client | ||||
| | * | Add explicit jets3t dependency, which is excluded in hadoop-client | Matei Zaharia | 2013-09-10 | 3 | -0/+11 |
| | | | |||||
| * | | Merge pull request #922 from pwendell/port-change | Patrick Wendell | 2013-09-11 | 7 | -12/+11 |
| |\ \ | | | | | | | | | Change default port number from 3030 to 4030. | ||||
| | * | | Change port from 3030 to 4040 | Patrick Wendell | 2013-09-11 | 7 | -12/+11 |
| | | | | |||||
| * | | | Merge pull request #925 from davidmccauley/master | Reynold Xin | 2013-09-11 | 1 | -1/+3 |
| |\ \ \ | | | | | | | | | | | SPARK-894 - Not all WebUI fields delivered VIA JSON | ||||
| | * | | | SPARK-894 - Not all WebUI fields delivered VIA JSON | David McCauley | 2013-09-11 | 1 | -1/+3 |
| | | |/ | | |/| | |||||
| * | | | Merge pull request #923 from haoyuan/master | Matei Zaharia | 2013-09-10 | 1 | -4/+4 |
| |\ \ \ | | | | | | | | | | | fix run-example script | ||||
| | * | | | better expression | Haoyuan Li | 2013-09-10 | 1 | -4/+4 |
| | | | | | |||||
| | * | | | fix run-example script | Haoyuan Li | 2013-09-10 | 1 | -4/+4 |
| | | |/ | | |/| | |||||
| * | | | Merge pull request #921 from pwendell/master | Patrick Wendell | 2013-09-10 | 2 | -0/+7 |
| |\ \ \ | | |/ / | |/| | | Fix HDFS access bug with assembly build. | ||||
| | * | | Fix HDFS access bug with assembly build. | Patrick Wendell | 2013-09-10 | 2 | -0/+7 |
| |/ / | | | | | | | | | | | | | | | | | | | | | | | | | Due to this change in HDFS: https://issues.apache.org/jira/browse/HADOOP-7549 there is a bug when using the new assembly builds. The symptom is that any HDFS access results in an exception saying "No filesystem for scheme 'hdfs'". This adds a merge strategy in the assembly build which fixes the problem. | ||||
| * / | Update Python API features | Matei Zaharia | 2013-09-10 | 1 | -1/+1 |
| |/ | |||||
| * | Merge pull request #917 from pwendell/master | shivaram | 2013-09-09 | 1 | -0/+7 |
| |\ | | | | | | | Document libgfortran dependency for MLBase | ||||
| | * | Document fortran dependency for MLBase | Patrick Wendell | 2013-09-09 | 1 | -0/+7 |
| |/ | |||||
| * | Merge pull request #915 from ooyala/master | Matei Zaharia | 2013-09-09 | 1 | -1/+9 |
| |\ | | | | | | | Get rid of / improve ugly NPE when Utils.deleteRecursively() fails | ||||
| | * | Style fix: put body of if within curly braces | Evan Chan | 2013-09-09 | 1 | -1/+3 |
| | | | |||||
| | * | Print out more friendly error if listFiles() fails | Evan Chan | 2013-09-09 | 1 | -1/+7 |
| | | | | | | | | | | | | listFiles() could return null if the I/O fails, and this currently results in an ugly NPE which is hard to diagnose. | ||||
| * | | Merge pull request #916 from mateiz/mkdist-fix | Matei Zaharia | 2013-09-09 | 1 | -1/+1 |
| |\ \ | | | | | | | | | Fix copy issue in https://github.com/mesos/spark/pull/899 | ||||
| | * | | Fix copy issue in https://github.com/mesos/spark/pull/899 | Matei Zaharia | 2013-09-09 | 1 | -1/+1 |
| |/ / | |||||
| * | | Merge pull request #907 from stephenh/document_coalesce_shuffle | Matei Zaharia | 2013-09-09 | 2 | -4/+27 |
| |\ \ | | | | | | | | | Add better docs for coalesce. | ||||
| | * | | Use a set since shuffle could change order. | Stephen Haberman | 2013-09-09 | 1 | -1/+1 |
| | | | | |||||
| | * | | Reword 'evenly distributed' to 'distributed with a hash partitioner. | Stephen Haberman | 2013-09-09 | 1 | -2/+2 |
| | | | | |||||
| | * | | Add better docs for coalesce. | Stephen Haberman | 2013-09-08 | 2 | -4/+27 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Include the useful tip that if shuffle=true, coalesce can actually increase the number of partitions. This makes coalesce more like a generic `RDD.repartition` operation. (Ideally this `RDD.repartition` could automatically choose either a coalesce or a shuffle if numPartitions was either less than or greater than, respectively, the current number of partitions.) | ||||
| * | | | Merge pull request #912 from tgravescs/ganglia-pom | Matei Zaharia | 2013-09-09 | 1 | -0/+4 |
| |\ \ \ | | | | | | | | | | | Add metrics-ganglia to core pom file | ||||
| | * | | | Add metrics-ganglia to core pom file | Y.CORP.YAHOO.COM\tgraves | 2013-09-09 | 1 | -0/+4 |
| |/ / / | |||||
| * | | | Merge pull request #911 from pwendell/ganglia-sink | Matei Zaharia | 2013-09-09 | 1 | -0/+5 |
| |\ \ \ | | | | | | | | | | | Adding Manen dependency for Ganglia | ||||
| | * | | | Adding Manen dependency | Patrick Wendell | 2013-09-09 | 1 | -0/+5 |
| | | | | | |||||
| * | | | | Merge pull request #890 from mridulm/master | Matei Zaharia | 2013-09-08 | 3 | -2/+17 |
| |\ \ \ \ | | | | | | | | | | | | | Fix hash bug | ||||
| | * | | | | Address review comments - rename toHash to nonNegativeHash | Mridul Muralidharan | 2013-09-04 | 3 | -3/+3 |
| | | | | | | |||||
| | * | | | | Fix hash bug - caused failure after 35k stages, sigh | Mridul Muralidharan | 2013-09-04 | 3 | -2/+17 |
| | | | | | | |||||
| * | | | | | Merge pull request #909 from mateiz/exec-id-fix | Reynold Xin | 2013-09-08 | 2 | -7/+7 |
| |\ \ \ \ \ | | | | | | | | | | | | | | | Fix an instance where full standalone mode executor IDs were passed to | ||||
| | * | | | | | Fix an instance where full standalone mode executor IDs were passed to | Matei Zaharia | 2013-09-08 | 2 | -7/+7 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | StandaloneSchedulerBackend instead of the smaller IDs used within Spark (that lack the application name). This was reported by ClearStory in https://github.com/clearstorydata/spark/pull/9. Also fixed some messages that said slave instead of executor. | ||||
| * | | | | | | Merge pull request #910 from mateiz/ml-doc-tweaks | Matei Zaharia | 2013-09-08 | 3 | -18/+17 |
| |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | Small tweaks to MLlib docs | ||||
| | * | | | | | | Small tweaks to MLlib docs | Matei Zaharia | 2013-09-08 | 3 | -18/+17 |
| |/ / / / / / | |||||
| * | | | | | | Merge pull request #905 from mateiz/docs2 | Matei Zaharia | 2013-09-08 | 26 | -166/+499 |
| |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | Job scheduling and cluster mode docs | ||||
| | * | | | | | | Fix some review comments | Matei Zaharia | 2013-09-08 | 2 | -2/+2 |
| | | | | | | | | |||||
| | * | | | | | | Fix unit test failure due to changed default | Matei Zaharia | 2013-09-08 | 1 | -1/+1 |
| | | | | | | | | |||||
| | * | | | | | | Updated cluster diagram to show caches | Matei Zaharia | 2013-09-08 | 2 | -0/+0 |
| | | | | | | | | |||||
| | * | | | | | | Review comments | Matei Zaharia | 2013-09-08 | 2 | -1/+48 |
| | | | | | | | |