aboutsummaryrefslogtreecommitdiff
path: root/docs
Commit message (Collapse)AuthorAgeFilesLines
...
| * | | | | | fixed review commentsPrashant Sharma2014-01-031-2/+2
| | | | | | |
| * | | | | | Merge branch 'master' into spark-1002-remove-jarsPrashant Sharma2014-01-0312-75/+154
| |\| | | | |
| * | | | | | Removed sbt folder and changed docs accordinglyPrashant Sharma2014-01-029-15/+15
| | |_|_|/ / | |/| | | |
| * | | | | Revert "Merge pull request #310 from jyunfan/master"Reynold Xin2013-12-281-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This reverts commit 79b20e4dbe3dcd8559ec8316784d3334bb55868b, reversing changes made to 7375047d516c5aa69221611f5f7b0f1d367039af.
| * | | | | Fix typo in the Accumulators sectionJyun-Fan Tsai2013-12-291-1/+1
| | |_|_|/ | |/| | | | | | | | val => var
* | | | | documentation for sparsematrixReza Zadeh2014-01-071-3/+4
| | | | |
* | | | | fix docs to use SparseMatrixReza Zadeh2014-01-051-2/+5
| | | | |
* | | | | add k parameterReza Zadeh2014-01-041-2/+3
| | | | |
* | | | | Merge remote-tracking branch 'upstream/master' into sparsesvdReza Zadeh2014-01-0212-75/+154
|\ \ \ \ \ | | |/ / / | |/| | |
| * | | | Updated docs for SparkConf and handled review commentsMatei Zaharia2013-12-3012-75/+154
| |/ / /
* | | | doc tweaksReza Zadeh2014-01-011-1/+1
| | | |
* | | | doc tweakReza Zadeh2014-01-011-4/+5
| | | |
* | | | doc tweaksReza Zadeh2014-01-011-4/+4
| | | |
* | | | New documentationReza Zadeh2014-01-011-0/+52
|/ / /
* | | changed the example links in the scala-programming-guidfengdong2013-12-181-1/+1
| | |
* | | Fixed the example link.fengdong2013-12-181-1/+1
| | |
* | | Merge pull request #251 from pwendell/masterReynold Xin2013-12-141-5/+7
|\ \ \ | | | | | | | | | | | | | | | | | | | | Fix list rendering in YARN markdown docs. This is some minor clean-up which makes the list render correctly.
| * | | Fix list rendering in YARN markdown docs.Patrick Wendell2013-12-101-5/+7
| | | |
* | | | A few corrections to documentation.Prashant Sharma2013-12-121-7/+7
| | | |
* | | | Merge branch 'master' into akka-bug-fixPrashant Sharma2013-12-1111-18/+69
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/pom.xml core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala pom.xml project/SparkBuild.scala streaming/pom.xml yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocationHandler.scala
| * | | Small fixPatrick Wendell2013-12-071-1/+1
| | | |
| * | | Adding HDP 2.0 versionPatrick Wendell2013-12-071-1/+2
| | | |
| * | | Various broken links in documentationPatrick Wendell2013-12-076-10/+10
| | | |
| * | | Merge pull request #240 from pwendell/masterPatrick Wendell2013-12-071-4/+4
| |\ \ \ | | | | | | | | | | | | | | | SPARK-917 Improve API links in nav bar
| | * | | SPARK-917 Improve API links in nav barPatrick Wendell2013-12-071-4/+4
| | | | |
| * | | | Correct spellling error in configuration.mdAaron Davidson2013-12-071-1/+1
| |/ / /
| * | | Minor formatting fix in config filePatrick Wendell2013-12-061-1/+0
| | | |
| * | | Merge pull request #236 from pwendell/shuffle-docsPatrick Wendell2013-12-061-1/+1
| |\ \ \ | | | | | | | | | | | | | | | Adding disclaimer for shuffle file consolidation
| | * | | Adding disclaimer for shuffle file consolidationPatrick Wendell2013-12-061-1/+1
| | | | |
| * | | | Minor doc fixes and updating READMEPatrick Wendell2013-12-062-2/+4
| |/ / /
| * | | more docsAli Ghodsi2013-12-063-3/+5
| | | |
| * | | Updated documentation about the YARN v2.2 build processAli Ghodsi2013-12-063-1/+13
| | | |
| * | | Merge pull request #228 from pwendell/masterPatrick Wendell2013-12-051-1/+36
| |\ \ \ | | | | | | | | | | | | | | | Document missing configs and set shuffle consolidation to false.
| | * | | Small changes from Matei reviewPatrick Wendell2013-12-041-2/+2
| | | | |
| | * | | Document missing configs and set shuffle consolidation to false.Patrick Wendell2013-12-041-1/+36
| | | | |
| * | | | Typo: applicatonAndrew Ash2013-12-041-2/+2
| |/ / /
* | | | Merge branch 'master' into wip-scala-2.10Prashant Sharma2013-11-272-3/+27
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala core/src/main/scala/org/apache/spark/rdd/MapPartitionsRDD.scala core/src/main/scala/org/apache/spark/rdd/MapPartitionsWithContextRDD.scala core/src/main/scala/org/apache/spark/rdd/RDD.scala python/pyspark/rdd.py
| * | | Update tuning.mdAndrew Ash2013-11-251-1/+2
| | | | | | | | | | | | Clarify when serializer is used based on recent user@ mailing list discussion.
| * | | Merge pull request #101 from colorant/yarn-client-schedulerMatei Zaharia2013-11-251-2/+25
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | For SPARK-527, Support spark-shell when running on YARN sync to trunk and resubmit here In current YARN mode approaching, the application is run in the Application Master as a user program thus the whole spark context is on remote. This approaching won't support application that involve local interaction and need to be run on where it is launched. So In this pull request I have a YarnClientClusterScheduler and backend added. With this scheduler, the user application is launched locally,While the executor will be launched by YARN on remote nodes with a thin AM which only launch the executor and monitor the Driver Actor status, so that when client app is done, it can finish the YARN Application as well. This enables spark-shell to run upon YARN. This also enable other Spark applications to have the spark context to run locally with a master-url "yarn-client". Thus e.g. SparkPi could have the result output locally on console instead of output in the log of the remote machine where AM is running on. Docs also updated to show how to use this yarn-client mode.
| | * | | Add YarnClientClusterScheduler and Backend.Raymond Liu2013-11-221-2/+25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | With this scheduler, the user application is launched locally, While the executor will be launched by YARN on remote nodes. This enables spark-shell to run upon YARN.
* | | | | Improvements from the review comments and followed Boy Scout Rule.Prashant Sharma2013-11-271-2/+2
| | | | |
* | | | | Documenting the newly added spark properties.Prashant Sharma2013-11-261-1/+22
| | | | |
* | | | | Merge branch 'master' into scala-2.10-wipPrashant Sharma2013-11-252-1/+2
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/rdd/RDD.scala project/SparkBuild.scala
| * | | | Merge pull request #151 from russellcardullo/add-graphite-sinkMatei Zaharia2013-11-241-0/+1
| |\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add graphite sink for metrics This adds a metrics sink for graphite. The sink must be configured with the host and port of a graphite node and optionally may be configured with a prefix that will be prepended to all metrics that are sent to graphite.
| | * | | | Add graphite sink for metricsRussell Cardullo2013-11-081-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This adds a metrics sink for graphite. The sink must be configured with the host and port of a graphite node and optionally may be configured with a prefix that will be prepended to all metrics that are sent to graphite.
| * | | | | Fix Kryo Serializer buffer inconsistencyNeal Wiggins2013-11-201-1/+1
| | |/ / / | |/| | | | | | | | The documentation here is inconsistent with the coded default and other documentation.
* | | | | Merge branch 'master' of github.com:apache/incubator-spark into scala-2.10-tempPrashant Sharma2013-11-211-0/+2
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/util/collection/PrimitiveVector.scala streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala
| * | | | Impove Spark on Yarn Error handlingtgravescs2013-11-191-0/+2
| | | | |
| * | | | Fixed typos in the CDH4 distributions version codes.RIA-pierre-borckmans2013-11-141-2/+2
| | | | |
* | | | | Various merge correctionsAaron Davidson2013-11-141-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | I've diff'd this patch against my own -- since they were both created independently, this means that two sets of eyes have gone over all the merge conflicts that were created, so I'm feeling significantly more confident in the resulting PR. @rxin has looked at the changes to the repl and is resoundingly confident that they are correct.
generated by cgit v1.2.3 (git 2.39.1) at 2024-08-01 19:53:11 +0000