aboutsummaryrefslogtreecommitdiff
path: root/docs
Commit message (Collapse)AuthorAgeFilesLines
* WIP. Updating figures and cleaning up initial skeleton for GraphX ↵Joseph E. Gonzalez2014-01-1012-159/+134
| | | | Programming guide.
* Start fixing formatting of graphx-programming-guideAnkur Dave2014-01-091-7/+6
|
* Add docs/graphx-programming-guide.md from ↵Ankur Dave2014-01-091-0/+197
| | | | 7210257ba3038d5e22d4b60fe9c3113dc45c3dff:README.md
* Merge remote-tracking branch 'spark-upstream/master' into HEADAnkur Dave2014-01-0823-221/+661
|\ | | | | | | | | | | | | | | | | | | | | Conflicts: README.md core/src/main/scala/org/apache/spark/util/collection/OpenHashMap.scala core/src/main/scala/org/apache/spark/util/collection/OpenHashSet.scala core/src/main/scala/org/apache/spark/util/collection/PrimitiveKeyOpenHashMap.scala pom.xml project/SparkBuild.scala repl/src/main/scala/org/apache/spark/repl/SparkILoop.scala
| * Merge pull request #345 from colorant/yarnThomas Graves2014-01-081-0/+2
| |\ | | | | | | | | | | | | | | | support distributing extra files to worker for yarn client mode So that user doesn't need to package all dependency into one assemble jar as spark app jar
| | * Export --file for YarnClient mode to support sending extra files to worker ↵Raymond Liu2014-01-071-0/+2
| | | | | | | | | | | | on yarn cluster
| * | Merge pull request #322 from falaki/MLLibDocumentationImprovementPatrick Wendell2014-01-071-56/+274
| |\ \ | | | | | | | | | | | | | | | | | | | | SPARK-1009 Updated MLlib docs to show how to use it in Python In addition added detailed examples for regression, clustering and recommendation algorithms in a separate Scala section. Fixed a few minor issues with existing documentation.
| | * \ Fixed merge conflictHossein Falaki2014-01-0719-149/+233
| | |\ \
| | * | | Added proper evaluation example for collaborative filtering and fixed typoHossein Falaki2014-01-061-4/+8
| | | | |
| | * | | Added table of contents and minor fixesHossein Falaki2014-01-031-8/+16
| | | | |
| | * | | Commented the last part of collaborative filtering examples that lead to errorsHossein Falaki2014-01-021-5/+6
| | | | |
| | * | | Added Scala and Python examples for mllibHossein Falaki2014-01-021-52/+261
| | | | |
| * | | | Address review commentsMatei Zaharia2014-01-071-2/+2
| | | | |
| * | | | Add way to limit default # of cores used by applications on standalone modeMatei Zaharia2014-01-074-8/+42
| | |/ / | |/| | | | | | | | | | Also documents the spark.deploy.spreadOut option.
| * | | Merge pull request #339 from ScrapCodes/conf-improvementsPatrick Wendell2014-01-071-0/+15
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conf improvements There are two new features. 1. Allow users to set arbitrary akka configurations via spark conf. 2. Allow configuration to be printed in logs for diagnosis.
| | * | | formatting related fixes suggested by Patrick.Prashant Sharma2014-01-071-1/+1
| | | | |
| | * | | Allow configuration to be printed in logs for diagnosis.Prashant Sharma2014-01-071-0/+7
| | | | |
| | * | | Allow users to set arbitrary akka configurations via spark conf.Prashant Sharma2014-01-071-0/+8
| | | |/ | | |/|
| * | | Merge pull request #331 from holdenk/masterReynold Xin2014-01-079-18/+18
| |\ \ \ | | |/ / | |/| | | | | | | | | | | | | | Add a script to download sbt if not present on the system As per the discussion on the dev mailing list this script will use the system sbt if present or otherwise attempt to install the sbt launcher. The fall back error message in the event it fails instructs the user to install sbt. While the URLs it fetches from aren't controlled by the spark project directly, they are stable and the current authoritative sources.
| | * | Code review feedbackHolden Karau2014-01-059-18/+18
| | | |
| * | | Clarify spark.cores.maxAndrew Ash2014-01-061-1/+2
| |/ / | | | | | | It controls the count of cores across the cluster, not on a per-machine basis.
| * | Merge remote-tracking branch 'apache-github/master' into remove-binariesPatrick Wendell2014-01-0312-64/+57
| |\ \ | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/test/scala/org/apache/spark/DriverSuite.scala docs/python-programming-guide.md
| | * \ Merge pull request #317 from ScrapCodes/spark-915-segregate-scriptsPatrick Wendell2014-01-0311-52/+52
| | |\ \ | | | | | | | | | | | | | | | Spark-915 segregate scripts
| | | * | sbin/spark-class* -> bin/spark-class*Prashant Sharma2014-01-032-3/+3
| | | | |
| | | * | a few left over document changePrashant Sharma2014-01-021-1/+1
| | | | |
| | | * | pyspark -> bin/pysparkPrashant Sharma2014-01-023-17/+17
| | | | |
| | | * | run-example -> bin/run-examplePrashant Sharma2014-01-026-12/+12
| | | | |
| | | * | spark-shell -> bin/spark-shellPrashant Sharma2014-01-027-13/+13
| | | | |
| | | * | Merge branch 'scripts-reorg' of github.com:shane-huang/incubator-spark into ↵Prashant Sharma2014-01-022-9/+9
| | | |\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | spark-915-segregate-scripts Conflicts: bin/spark-shell core/pom.xml core/src/main/scala/org/apache/spark/SparkContext.scala core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala core/src/main/scala/org/apache/spark/ui/UIWorkloadGenerator.scala core/src/test/scala/org/apache/spark/DriverSuite.scala python/run-tests sbin/compute-classpath.sh sbin/spark-class sbin/stop-slaves.sh
| | | | * \ Merge branch 'reorgscripts' into scripts-reorgshane-huang2013-09-272-9/+9
| | | | |\ \
| | | | | * | add admin scripts to sbinshane-huang2013-09-231-6/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com>
| | | | | * | added spark-class and spark-executor to sbinshane-huang2013-09-232-3/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com>
| | * | | | | fix docs for yarnRaymond Liu2014-01-031-3/+0
| | | | | | |
| | * | | | | Using name yarn-alpha/yarn instead of yarn-2.0/yarn-2.2Raymond Liu2014-01-031-4/+4
| | | | | | |
| | * | | | | Update maven build documentationRaymond Liu2014-01-032-8/+4
| | | | | | |
| | * | | | | Fix yarn/README.md and update docs/running-on-yarn.mdRaymond Liu2014-01-031-1/+1
| | |/ / / /
| * | | | | fixed review commentsPrashant Sharma2014-01-031-2/+2
| | | | | |
| * | | | | Merge branch 'master' into spark-1002-remove-jarsPrashant Sharma2014-01-0312-75/+154
| |\| | | |
| | * | | | Updated docs for SparkConf and handled review commentsMatei Zaharia2013-12-3012-75/+154
| | | | | |
| * | | | | Removed sbt folder and changed docs accordinglyPrashant Sharma2014-01-029-15/+15
| | |_|_|/ | |/| | |
| * | | | Revert "Merge pull request #310 from jyunfan/master"Reynold Xin2013-12-281-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | This reverts commit 79b20e4dbe3dcd8559ec8316784d3334bb55868b, reversing changes made to 7375047d516c5aa69221611f5f7b0f1d367039af.
| * | | | Fix typo in the Accumulators sectionJyun-Fan Tsai2013-12-291-1/+1
| |/ / / | | | | | | | | val => var
| * | | changed the example links in the scala-programming-guidfengdong2013-12-181-1/+1
| | | |
| * | | Fixed the example link.fengdong2013-12-181-1/+1
| | | |
| * | | Merge pull request #251 from pwendell/masterReynold Xin2013-12-141-5/+7
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | Fix list rendering in YARN markdown docs. This is some minor clean-up which makes the list render correctly.
| | * | | Fix list rendering in YARN markdown docs.Patrick Wendell2013-12-101-5/+7
| | | | |
| * | | | A few corrections to documentation.Prashant Sharma2013-12-121-7/+7
| | | | |
| * | | | Merge branch 'master' into akka-bug-fixPrashant Sharma2013-12-1111-18/+69
| |\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/pom.xml core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala pom.xml project/SparkBuild.scala streaming/pom.xml yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocationHandler.scala
| | * | | Small fixPatrick Wendell2013-12-071-1/+1
| | | | |
| | * | | Adding HDP 2.0 versionPatrick Wendell2013-12-071-1/+2
| | | | |