aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* More doc tweaksMatei Zaharia2013-02-262-2/+4
|
* Some tweaks to docsMatei Zaharia2013-02-263-14/+18
|
* Small hack to work around multiple JARs being built by sbt packageMatei Zaharia2013-02-261-5/+6
|
* Fix a problem with no hosts being counted as alive in the first jobMatei Zaharia2013-02-261-3/+3
|
* Fix overly large thread names in PySparkMatei Zaharia2013-02-261-2/+2
|
* Switch docs to use Akka repo instead of TypesafeMatei Zaharia2013-02-251-3/+3
|
* Change version number to 0.7.0Matei Zaharia2013-02-253-3/+3
|
* Merge branch 'master' of https://github.com/mesos/sparkMatei Zaharia2013-02-251-1/+1
|\
| * Merge pull request #503 from pwendell/bug-fixMatei Zaharia2013-02-251-1/+1
| |\ | | | | | | createNewSparkContext should use sparkHome/jars/environment.
| | * createNewSparkContext should use sparkHome/jars/environment.Patrick Wendell2013-02-251-1/+1
| | | | | | | | | | | | This fixes a bug introduced by Matei's recent change.
* | | Fix Windows script for finding examples JARMatei Zaharia2013-02-251-4/+4
|/ /
* / Pass a code JAR to SparkContext in our examples. Fixes SPARK-594.Matei Zaharia2013-02-2538-82/+174
|/
* Merge pull request #502 from tdas/masterMatei Zaharia2013-02-251-2/+2
|\ | | | | Very minor change in a testcase
| * Changed Flume test to use the same port as other tests, so that can be ↵Tathagata Das2013-02-251-2/+2
| | | | | | | | controlled centrally.
* | Merge pull request #501 from tdas/masterMatei Zaharia2013-02-252-3/+17
|\| | | | | Fixed bug in BlockManager and added a testcase
| * Fixed replication bug in BlockManagerTathagata Das2013-02-252-3/+17
|/
* Fixed something that was reported as a compile error in ScalaDoc.Matei Zaharia2013-02-252-3/+3
| | | | | | For some reason, ScalaDoc complained about no such constructor for StreamingContext; it doesn't seem like an actual Scala error but it prevented sbt publish and from working because docs weren't built.
* Update Hadoop dependency to 1.0.4Matei Zaharia2013-02-252-3/+3
|
* Merge pull request #500 from pwendell/streaming-docsTathagata Das2013-02-251-2/+2
|\ | | | | Minor changes based on feedback
| * meta-dataPatrick Wendell2013-02-251-1/+1
| |
| * One more change done with TDPatrick Wendell2013-02-251-1/+1
| |
| * Minor changes based on feedbackPatrick Wendell2013-02-251-2/+2
| |
* | Some tweaks to docsMatei Zaharia2013-02-252-3/+3
| |
* | Merge branch 'master' of github.com:mesos/sparkMatei Zaharia2013-02-251-4/+6
|\|
| * Merge pull request #499 from pwendell/streaming-docsMatei Zaharia2013-02-251-4/+6
| |\ | | | | | | Some changes to streaming failure docs.
| | * Some changes to streaming failure docs.Patrick Wendell2013-02-251-4/+6
| | | | | | | | | | | | | | | | | | TD gave me the go-ahead to just make these changes: - Define stateful dstream - Some minor wording fixes
* | | Allow passing sparkHome and JARs to StreamingContext constructorMatei Zaharia2013-02-258-22/+76
| | | | | | | | | | | | | | | Also warns if spark.cleaner.ttl is not set in the version where you pass your own SparkContext.
* | | Set spark.deploy.spreadOut to true by default in 0.7 (improves locality)Matei Zaharia2013-02-251-1/+1
| | |
* | | Some tweaks to docsMatei Zaharia2013-02-253-9/+9
|/ /
* | Add a config property for Akka lifecycle event loggingMatei Zaharia2013-02-251-2/+4
| |
* | Fix compile errorMatei Zaharia2013-02-252-2/+2
| |
* | Use public method sparkContext instead of protected sc in streaming examplesMatei Zaharia2013-02-253-4/+4
|/
* Change doc color scheme slightly for Spark 0.7 (to differ from 0.6)Matei Zaharia2013-02-252-16/+16
|
* Use a single setting for disabling API doc buildMatei Zaharia2013-02-252-4/+4
|
* Merge branch 'master' of github.com:mesos/sparkMatei Zaharia2013-02-251-1/+1
|\
| * Merge pull request #498 from pwendell/shutup-akkaMatei Zaharia2013-02-251-1/+1
| |\ | | | | | | Disable remote lifecycle logging from Akka.
| | * Disable remote lifecycle logging from Akka.Patrick Wendell2013-02-251-1/+1
| | | | | | | | | | | | This changes the default setting to `off` for remote lifecycle events. When this is on, it is very chatty at the INFO level. It also prints out several ERROR messages sometimes when sc.stop() is called.
* | | Change tabs to spacesMatei Zaharia2013-02-251-15/+15
|/ /
* | Get spark.default.paralellism on each call to defaultPartitioner,Matei Zaharia2013-02-251-4/+1
| | | | | | | | instead of only once, in case the user changes it across Spark uses
* | Merge pull request #459 from stephenh/bettersplitsMatei Zaharia2013-02-259-42/+94
|\ \ | |/ |/| Change defaultPartitioner to use upstream split size.
| * Use default parallelism if its set.Stephen Haberman2013-02-242-6/+19
| |
| * Merge branch 'master' into bettersplitsStephen Haberman2013-02-24117-879/+1755
| |\ | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/test/scala/spark/ShuffleSuite.scala
| * | Update more javadocs.Stephen Haberman2013-02-162-15/+17
| | |
| * | Tweak test names.Stephen Haberman2013-02-161-2/+2
| | |
| * | Remove fileServerSuite.txt.Stephen Haberman2013-02-161-1/+0
| | |
| * | Update default.parallelism docs, have StandaloneSchedulerBackend use it.Stephen Haberman2013-02-168-28/+43
| | | | | | | | | | | | | | | | | | Only brand new RDDs (e.g. parallelize and makeRDD) now use default parallelism, everything else uses their largest parent's partitioner or partition size.
| * | Change defaultPartitioner to use upstream split size.Stephen Haberman2013-02-103-6/+29
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Previously it used the SparkContext.defaultParallelism, which occassionally ended up being a very bad guess. Looking at upstream RDDs seems to make better use of the context. Also sorted the upstream RDDs by partition size first, as if we have a hugely-partitioned RDD and tiny-partitioned RDD, it is unlikely we want the resulting RDD to be tiny-partitioned.
* | | Merge pull request #497 from ScrapCodes/dep-resolution-fixMatei Zaharia2013-02-251-1/+3
|\ \ \ | | | | | | | | Moving akka dependency resolver to shared.
| * | | Moving akka dependency resolver to shared.Prashant Sharma2013-02-251-1/+3
| | | |
* | | | Merge pull request #494 from mesos/streamingMatei Zaharia2013-02-2466-1227/+3254
|\| | | | | | | | | | | Final set of Spark Streaming changes
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-29 14:20:22 +0000