aboutsummaryrefslogtreecommitdiff
path: root/docs/scala-programming-guide.md
Commit message (Collapse)AuthorAgeFilesLines
* Move some classes to more appropriate packages:Matei Zaharia2013-09-011-1/+1
| | | | | | * RDD, *RDDFunctions -> org.apache.spark.rdd * Utils, ClosureCleaner, SizeEstimator -> org.apache.spark.util * JavaSerializer, KryoSerializer -> org.apache.spark.serializer
* Fix more URLs in docsMatei Zaharia2013-09-011-1/+5
|
* Update docs for new packageMatei Zaharia2013-09-011-8/+8
|
* Update docs about HDFS versionsMatei Zaharia2013-08-301-3/+11
|
* Change build and run instructions to use assembliesMatei Zaharia2013-08-291-1/+1
| | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel.
* ADD_JARS environment variable for spark-shellMatei Zaharia2013-06-221-2/+8
|
* Docs: Mention spark shell's default for MASTERAndrew Ash2013-05-151-0/+2
|
* Allow passing sparkHome and JARs to StreamingContext constructorMatei Zaharia2013-02-251-2/+2
| | | | | Also warns if spark.cleaner.ttl is not set in the version where you pass your own SparkContext.
* Merge branch 'master' of https://github.com/mesos/spark into commutativeMark Hamstra2013-02-081-1/+2
|\ | | | | | | | | Conflicts: core/src/main/scala/spark/RDD.scala
| * Made StorageLevel constructor private, and added StorageLevels.create() to ↵Tathagata Das2013-01-231-1/+2
| | | | | | | | the Java API. Updates scala and java programming guides.
* | Change docs on 'reduce' since the merging of local reduces no longer preservesMark Hamstra2013-02-051-1/+1
|/ | | | ordering, so the reduce function must also be commutative.
* Fix Spark groupId in Scala Programming Guide.Josh Rosen2012-10-261-1/+1
|
* Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-10-121-1/+7
|\
| * Updating programming guide with new link instructionsPatrick Wendell2012-10-091-1/+7
| |
* | TweakMatei Zaharia2012-10-121-1/+1
|/
* Updates to documentation:Matei Zaharia2012-10-091-2/+6
| | | | | | | | - Edited quick start and tuning guide to simplify them a little - Simplified top menu bar - Made private a SparkContext constructor parameter that was left as public - Various small fixes
* Updating lots of docs to use the new special version number variables,Andy Konwinski2012-10-081-1/+1
| | | | | also adding the version to the navbar so it is easy to tell which version of Spark these docs were compiled for.
* Adds liquid variables to docs templating system so that they can be usedAndy Konwinski2012-10-081-12/+12
| | | | | | | | | throughout the docs: SPARK_VERSION, SCALA_VERSION, and MESOS_VERSION. To use them, e.g. use {{site.SPARK_VERSION}}. Also removes uses of {{HOME_PATH}} which were being resolved to "" by the templating system anyway.
* Added mapPartitionsWithSplit to the programming guide.Reynold Xin2012-09-291-0/+6
|
* Allow controlling number of splits in distinct().Josh Rosen2012-09-281-0/+4
|
* Renamed storage levels to something cleaner; fixes #223.Matei Zaharia2012-09-271-12/+12
|
* Updates to standalone cluster, web UI and deploy docs.Matei Zaharia2012-09-261-1/+1
|
* More updates to docs, including tuning guideMatei Zaharia2012-09-261-33/+30
|
* Doc tweaksMatei Zaharia2012-09-261-2/+2
|
* Fixes to Java guideMatei Zaharia2012-09-251-1/+6
|
* Various enhancements to the programming guide and HTML/CSSMatei Zaharia2012-09-251-32/+171
|
* More updates to documentationMatei Zaharia2012-09-251-10/+16
|
* - Add docs/api to .gitignoreAndy Konwinski2012-09-161-0/+187
- Rework/expand the nav bar with more of the docs site - Removing parts of docs about EC2 and Mesos that differentiate between running 0.5 and before - Merged subheadings from running-on-amazon-ec2.html that are still relevant (i.e., "Using a newer version of Spark" and "Accessing Data in S3") into ec2-scripts.html and deleted running-on-amazon-ec2.html - Added some TODO comments to a few docs - Updated the blurb about AMP Camp - Renamed programming-guide to spark-programming-guide - Fixing typos/etc. in Standalone Spark doc
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-26 13:47:19 +0000