aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Add git scm url for publishingPatrick Wendell2013-09-121-0/+1
|
* Merge pull request #926 from kayousterhout/dynamicPatrick Wendell2013-09-111-9/+9
|\ | | | | Changed localProperties to use ThreadLocal (not DynamicVariable).
| * Changed localProperties to use ThreadLocal (not DynamicVariable).Kay Ousterhout2013-09-111-9/+9
| | | | | | | | | | | | The fact that DynamicVariable uses an InheritableThreadLocal can cause problems where the properties end up being shared across threads in certain circumstances.
* | Merge pull request #927 from benh/mesos-docsMatei Zaharia2013-09-111-17/+16
|\ \ | |/ |/| Updated Spark on Mesos documentation.
| * More updates to Spark on Mesos documentation.Benjamin Hindman2013-09-111-2/+2
| |
| * Updated Spark on Mesos documentation.Benjamin Hindman2013-09-111-17/+16
|/
* Merge pull request #919 from mateiz/jets3tPatrick Wendell2013-09-113-0/+11
|\ | | | | Add explicit jets3t dependency, which is excluded in hadoop-client
| * Add explicit jets3t dependency, which is excluded in hadoop-clientMatei Zaharia2013-09-103-0/+11
| |
* | Merge pull request #922 from pwendell/port-changePatrick Wendell2013-09-117-12/+11
|\ \ | | | | | | Change default port number from 3030 to 4030.
| * | Change port from 3030 to 4040Patrick Wendell2013-09-117-12/+11
| | |
* | | Merge pull request #925 from davidmccauley/masterReynold Xin2013-09-111-1/+3
|\ \ \ | | | | | | | | SPARK-894 - Not all WebUI fields delivered VIA JSON
| * | | SPARK-894 - Not all WebUI fields delivered VIA JSONDavid McCauley2013-09-111-1/+3
| | |/ | |/|
* | | Merge pull request #923 from haoyuan/masterMatei Zaharia2013-09-101-4/+4
|\ \ \ | | | | | | | | fix run-example script
| * | | better expressionHaoyuan Li2013-09-101-4/+4
| | | |
| * | | fix run-example scriptHaoyuan Li2013-09-101-4/+4
| | |/ | |/|
* | | Merge pull request #921 from pwendell/masterPatrick Wendell2013-09-102-0/+7
|\ \ \ | |/ / |/| | Fix HDFS access bug with assembly build.
| * | Fix HDFS access bug with assembly build.Patrick Wendell2013-09-102-0/+7
|/ / | | | | | | | | | | | | | | | | Due to this change in HDFS: https://issues.apache.org/jira/browse/HADOOP-7549 there is a bug when using the new assembly builds. The symptom is that any HDFS access results in an exception saying "No filesystem for scheme 'hdfs'". This adds a merge strategy in the assembly build which fixes the problem.
* / Update Python API featuresMatei Zaharia2013-09-101-1/+1
|/
* Merge pull request #917 from pwendell/mastershivaram2013-09-091-0/+7
|\ | | | | Document libgfortran dependency for MLBase
| * Document fortran dependency for MLBasePatrick Wendell2013-09-091-0/+7
|/
* Merge pull request #915 from ooyala/masterMatei Zaharia2013-09-091-1/+9
|\ | | | | Get rid of / improve ugly NPE when Utils.deleteRecursively() fails
| * Style fix: put body of if within curly bracesEvan Chan2013-09-091-1/+3
| |
| * Print out more friendly error if listFiles() failsEvan Chan2013-09-091-1/+7
| | | | | | | | listFiles() could return null if the I/O fails, and this currently results in an ugly NPE which is hard to diagnose.
* | Merge pull request #916 from mateiz/mkdist-fixMatei Zaharia2013-09-091-1/+1
|\ \ | | | | | | Fix copy issue in https://github.com/mesos/spark/pull/899
| * | Fix copy issue in https://github.com/mesos/spark/pull/899Matei Zaharia2013-09-091-1/+1
|/ /
* | Merge pull request #907 from stephenh/document_coalesce_shuffleMatei Zaharia2013-09-092-4/+27
|\ \ | | | | | | Add better docs for coalesce.
| * | Use a set since shuffle could change order.Stephen Haberman2013-09-091-1/+1
| | |
| * | Reword 'evenly distributed' to 'distributed with a hash partitioner.Stephen Haberman2013-09-091-2/+2
| | |
| * | Add better docs for coalesce.Stephen Haberman2013-09-082-4/+27
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Include the useful tip that if shuffle=true, coalesce can actually increase the number of partitions. This makes coalesce more like a generic `RDD.repartition` operation. (Ideally this `RDD.repartition` could automatically choose either a coalesce or a shuffle if numPartitions was either less than or greater than, respectively, the current number of partitions.)
* | | Merge pull request #912 from tgravescs/ganglia-pomMatei Zaharia2013-09-091-0/+4
|\ \ \ | | | | | | | | Add metrics-ganglia to core pom file
| * | | Add metrics-ganglia to core pom fileY.CORP.YAHOO.COM\tgraves2013-09-091-0/+4
|/ / /
* | | Merge pull request #911 from pwendell/ganglia-sinkMatei Zaharia2013-09-091-0/+5
|\ \ \ | | | | | | | | Adding Manen dependency for Ganglia
| * | | Adding Manen dependencyPatrick Wendell2013-09-091-0/+5
| | | |
* | | | Merge pull request #890 from mridulm/masterMatei Zaharia2013-09-083-2/+17
|\ \ \ \ | | | | | | | | | | Fix hash bug
| * | | | Address review comments - rename toHash to nonNegativeHashMridul Muralidharan2013-09-043-3/+3
| | | | |
| * | | | Fix hash bug - caused failure after 35k stages, sighMridul Muralidharan2013-09-043-2/+17
| | | | |
* | | | | Merge pull request #909 from mateiz/exec-id-fixReynold Xin2013-09-082-7/+7
|\ \ \ \ \ | | | | | | | | | | | | Fix an instance where full standalone mode executor IDs were passed to
| * | | | | Fix an instance where full standalone mode executor IDs were passed toMatei Zaharia2013-09-082-7/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | StandaloneSchedulerBackend instead of the smaller IDs used within Spark (that lack the application name). This was reported by ClearStory in https://github.com/clearstorydata/spark/pull/9. Also fixed some messages that said slave instead of executor.
* | | | | | Merge pull request #910 from mateiz/ml-doc-tweaksMatei Zaharia2013-09-083-18/+17
|\ \ \ \ \ \ | | | | | | | | | | | | | | Small tweaks to MLlib docs
| * | | | | | Small tweaks to MLlib docsMatei Zaharia2013-09-083-18/+17
|/ / / / / /
* | | | | | Merge pull request #905 from mateiz/docs2Matei Zaharia2013-09-0826-166/+499
|\ \ \ \ \ \ | | | | | | | | | | | | | | Job scheduling and cluster mode docs
| * | | | | | Fix some review commentsMatei Zaharia2013-09-082-2/+2
| | | | | | |
| * | | | | | Fix unit test failure due to changed defaultMatei Zaharia2013-09-081-1/+1
| | | | | | |
| * | | | | | Updated cluster diagram to show cachesMatei Zaharia2013-09-082-0/+0
| | | | | | |
| * | | | | | Review commentsMatei Zaharia2013-09-082-1/+48
| | | | | | |
| * | | | | | Some tweaks to CDH/HDP docMatei Zaharia2013-09-081-10/+52
| | | | | | |
| * | | | | | Added cluster overview doc, made logo higher-resolution, and added moreMatei Zaharia2013-09-087-15/+88
| | | | | | | | | | | | | | | | | | | | | | | | | | | | details on monitoring
| * | | | | | More fair scheduler docs and property names.Matei Zaharia2013-09-0814-98/+185
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Also changed uses of "job" terminology to "application" when they referred to an entire Spark program, to avoid confusion.
| * | | | | | Work in progress:Matei Zaharia2013-09-0810-49/+133
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Add job scheduling docs - Rename some fair scheduler properties - Organize intro page better - Link to Apache wiki for "contributing to Spark"
* | | | | | | Merge pull request #896 from atalwalkar/masterMatei Zaharia2013-09-082-1/+508
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | updated content
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-01 17:22:34 +0000