aboutsummaryrefslogtreecommitdiff
path: root/docs
Commit message (Collapse)AuthorAgeFilesLines
* Removing duplicate doc.Tathagata Das2013-02-242-103/+2
|
* Fixed class paths and dependencies based on Matei's comments.Tathagata Das2013-02-243-3/+104
|
* Updated streaming programming guide with Java API info, and comments from ↵Tathagata Das2013-02-231-11/+74
| | | | Patrick.
* Change spark.cleaner.delay to spark.cleaner.ttl. Updated docs.Tathagata Das2013-02-232-4/+4
|
* Merge branch 'mesos-master' into streamingTathagata Das2013-02-202-1/+2
|\
| * Fixes link to issue tracker in documentation page "Contributing to Spark".Andy Konwinski2013-02-192-1/+2
| |
* | Merge branch 'mesos-master' into streamingTathagata Das2013-02-205-4/+20
|\| | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CheckpointRDD.scala streaming/src/main/scala/spark/streaming/dstream/ReducedWindowedDStream.scala
| * Merge pull request #461 from JoshRosen/fix/issue-tracker-linkMatei Zaharia2013-02-131-1/+1
| |\ | | | | | | Update issue tracker link in contributing guide
| | * Update issue tracker link in contributing guide.Josh Rosen2013-02-101-1/+1
| | |
| * | Use a separate memory setting for standalone cluster daemonsMatei Zaharia2013-02-102-1/+17
| |/ | | | | | | | | Conflicts: docs/_config.yml
| * Merge pull request #460 from markhamstra/404Matei Zaharia2013-02-101-1/+1
| |\ | | | | | | Fixed a 404 in 'Tuning Spark' -- missing '.html'
| | * Fixed a 404 -- missing '.html'Mark Hamstra2013-02-101-1/+1
| | |
| * | Merge branch 'master' of https://github.com/mesos/spark into commutativeMark Hamstra2013-02-0813-44/+589
| |\ \ | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/RDD.scala
| * | | Change docs on 'reduce' since the merging of local reduces no longer preservesMark Hamstra2013-02-051-1/+1
| | |/ | |/| | | | | | | ordering, so the reduce function must also be commutative.
* | | Merge branch 'streaming' into ScrapCodes-streaming-actorTathagata Das2013-02-196-86/+252
|\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: docs/plugin-custom-receiver.md streaming/src/main/scala/spark/streaming/StreamingContext.scala streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/dstream/PluggableInputDStream.scala streaming/src/main/scala/spark/streaming/receivers/ActorReceiver.scala streaming/src/test/scala/spark/streaming/InputStreamsSuite.scala
| * | | Changed networkStream to socketStream and pluggableNetworkStream to become ↵Tathagata Das2013-02-181-5/+5
| | | | | | | | | | | | | | | | networkStream as a way to create streams from arbitrary network receiver.
| * | | Merge branch 'streaming' into ScrapCode-streamingTathagata Das2013-02-1813-96/+448
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/dstream/NetworkInputDStream.scala
| | * | | Added checkpointing and fault-tolerance semantics to the programming guide. ↵Tathagata Das2013-02-182-53/+195
| | | |/ | | |/| | | | | | | | | Fixed default checkpoint interval to being a multiple of slide duration. Fixed visibility of some classes and objects to clean up docs.
| | * | Merge pull request #430 from pwendell/pyspark-guideMatei Zaharia2013-01-301-2/+9
| | |\ \ | | | | | | | | | | Minor improvements to PySpark docs
| | | * | Make module help available in python shell.Patrick Wendell2013-01-301-0/+1
| | | | | | | | | | | | | | | | | | | | Also, adds a line in doc explaining how to use.
| | | * | Inclue packaging and launching pyspark in guide.Patrick Wendell2013-01-301-2/+8
| | | | | | | | | | | | | | | | | | | | It's nicer if all the commands you need are made explicit.
| | * | | Replace old 'master' term with 'driver'.Stephen Haberman2013-01-251-6/+6
| | | | |
| | * | | Made StorageLevel constructor private, and added StorageLevels.create() to ↵Tathagata Das2013-01-232-2/+4
| | | | | | | | | | | | | | | | | | | | the Java API. Updates scala and java programming guides.
| | * | | Add more Akka settings to docsMatei Zaharia2013-01-211-0/+16
| | | | |
| | * | | Clarify the documentation on env variables for standalone modeMatei Zaharia2013-01-211-22/+21
| | |/ /
| * | | Plug in actor as stream receiver APIPrashant Sharma2013-01-191-0/+101
| | | |
* | | | actor as receiverPrashant Sharma2013-01-221-0/+101
| |/ / |/| |
* | | Merge branch 'master' into streamingMatei Zaharia2013-01-202-2/+3
|\ \ \ | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/api/python/PythonRDD.scala
| * \ \ Merge pull request #387 from mateiz/python-accumulatorsJosh Rosen2013-01-201-1/+0
| |\ \ \ | | | | | | | | | | Add accumulators to PySpark
| | * | | Fix Python guide to say accumulators are availableMatei Zaharia2013-01-201-1/+0
| | | | |
| * | | | Changes based on Matei's commentPatrick Wendell2013-01-201-2/+3
| | | | |
| * | | | Clarifying log directory in EC2 guidePatrick Wendell2013-01-191-1/+2
| |/ / /
* | / / Merge branch 'master' into streamingTathagata Das2013-01-157-14/+199
|\| | | | |/ / |/| | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala docs/_layouts/global.html docs/index.md run
| * | Merge pull request #346 from JoshRosen/python-apiMatei Zaharia2013-01-127-11/+192
| |\ \ | | | | | | | | Python API (PySpark)
| | * | Add mapPartitionsWithSplit() to PySpark.Josh Rosen2013-01-081-1/+0
| | | |
| | * | Add `pyspark` script to replace the other scripts.Josh Rosen2013-01-012-7/+46
| | | | | | | | | | | | Expand the PySpark programming guide.
| | * | Rename top-level 'pyspark' directory to 'python'Josh Rosen2013-01-011-4/+4
| | | |
| | * | Minor documentation and style fixes for PySpark.Josh Rosen2013-01-012-4/+7
| | | |
| | * | Merge remote-tracking branch 'origin/master' into python-apiJosh Rosen2012-12-297-31/+33
| | |\| | | | | | | | | | | | | | | | | Conflicts: docs/quick-start.md
| | * | Add documentation for Python API.Josh Rosen2012-12-285-6/+121
| | | |
| | * | Add epydoc API documentation for PySpark.Josh Rosen2012-12-273-5/+30
| | | |
| * | | add repositories section to simple job pom.xmlMichael Heuer2013-01-111-0/+10
| | |/ | |/|
* | | Added documentation for PairDStreamFunctions.Tathagata Das2013-01-131-20/+25
| | |
* | | Renamed examples and added documentation.Tathagata Das2013-01-071-7/+7
| | |
* | | Updated Streaming Programming Guide.Tathagata Das2013-01-014-17/+178
| | |
* | | Improved jekyll and scala docs. Made many classes and method private to ↵Tathagata Das2012-12-292-28/+32
| | | | | | | | | | | | remove them from scala docs.
* | | Merge branch 'mesos' into dev-mergeTathagata Das2012-12-261-14/+16
|\| |
| * | Updated Kryo documentation for Kryo version update.Reynold Xin2012-12-211-14/+16
| | |
* | | Merge branch 'master' of github.com:mesos/spark into devReynold Xin2012-12-202-3/+3
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/PairRDDFunctions.scala core/src/main/scala/spark/ParallelCollection.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/CartesianRDD.scala core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/CoalescedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala core/src/main/scala/spark/rdd/FlatMappedRDD.scala core/src/main/scala/spark/rdd/GlommedRDD.scala core/src/main/scala/spark/rdd/HadoopRDD.scala core/src/main/scala/spark/rdd/MapPartitionsRDD.scala core/src/main/scala/spark/rdd/MapPartitionsWithSplitRDD.scala core/src/main/scala/spark/rdd/MappedRDD.scala core/src/main/scala/spark/rdd/PipedRDD.scala core/src/main/scala/spark/rdd/SampledRDD.scala core/src/main/scala/spark/rdd/ShuffledRDD.scala core/src/main/scala/spark/rdd/UnionRDD.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockManagerId.scala core/src/main/scala/spark/storage/BlockManagerMaster.scala core/src/main/scala/spark/storage/StorageLevel.scala core/src/main/scala/spark/util/MetadataCleaner.scala core/src/main/scala/spark/util/TimeStampedHashMap.scala core/src/test/scala/spark/storage/BlockManagerSuite.scala run
| * | Use spark-env.sh to configure standalone master. See SPARK-638.Josh Rosen2012-12-141-1/+1
| | | | | | | | | | | | Also fixed a typo in the standalone mode documentation.