aboutsummaryrefslogtreecommitdiff
path: root/core/src/test/scala
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch 'master' into master-mergePrashant Sharma2013-07-0325-409/+1504
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/pom.xml core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/RDDCheckpointData.scala core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/Utils.scala core/src/main/scala/spark/api/python/PythonRDD.scala core/src/main/scala/spark/deploy/client/Client.scala core/src/main/scala/spark/deploy/master/MasterWebUI.scala core/src/main/scala/spark/deploy/worker/Worker.scala core/src/main/scala/spark/deploy/worker/WorkerWebUI.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/ZippedRDD.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockManagerMaster.scala core/src/main/scala/spark/storage/BlockManagerMasterActor.scala core/src/main/scala/spark/storage/BlockManagerUI.scala core/src/main/scala/spark/util/AkkaUtils.scala core/src/test/scala/spark/SizeEstimatorSuite.scala pom.xml project/SparkBuild.scala repl/src/main/scala/spark/repl/SparkILoop.scala repl/src/test/scala/spark/repl/ReplSuite.scala streaming/src/main/scala/spark/streaming/StreamingContext.scala streaming/src/main/scala/spark/streaming/api/java/JavaStreamingContext.scala streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/util/MasterFailureTest.scala
| * Merge pull request #664 from pwendell/test-fixMatei Zaharia2013-06-271-1/+0
| |\ | | | | | | Removing incorrect test statement
| | * Removing incorrect test statementPatrick Wendell2013-06-271-1/+0
| | |
| * | Refactored tests to share SparkContexts in some of themMatei Zaharia2013-06-2510-425/+373
| | | | | | | | | | | | | | | Creating these seems to take a while and clutters the output with Akka stuff, so it would be nice to share them.
| * | Some fixes to the launch-java-directly change:Matei Zaharia2013-06-251-14/+39
| | | | | | | | | | | | | | | | | | | | | | | | - Split SPARK_JAVA_OPTS into multiple command-line arguments if it contains spaces; this splitting follows quoting rules in bash - Add the Scala JARs to the classpath if they're not in the CLASSPATH variable because the ExecutorRunner is launched with "scala" (this can happen when using local-cluster URLs in spark-shell)
| * | Fixed deprecated use of expect in SizeEstimatorSuiteMatei Zaharia2013-06-251-36/+36
| | |
| * | Clone the zero value for each key in foldByKeyMatei Zaharia2013-06-231-0/+22
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The old version reused the object within each task, leading to overwriting of the object when a mutable type is used, which is expected to be common in fold. Conflicts: core/src/test/scala/spark/ShuffleSuite.scala
| * | Merge pull request #648 from shivaram/netty-dbgMatei Zaharia2013-06-221-0/+25
| |\ \ | | |/ | |/| Shuffle fixes and cleanup
| | * Fix some comments and styleShivaram Venkataraman2013-06-131-2/+1
| | |
| | * Merge branch 'netty-dbg' of github.com:shivaram/spark into netty-dbgShivaram Venkataraman2013-06-121-0/+26
| | |\
| | | * Don't write zero block files with java serializerShivaram Venkataraman2013-06-051-0/+26
| | | |
| * | | Merge pull request #644 from shimingfei/jobloggerMatei Zaharia2013-06-222-1/+106
| |\ \ \ | | | | | | | | | | add Joblogger to Spark (on new Spark code)
| | * | | edit according to commentsMingfei2013-06-211-1/+1
| | | | |
| | * | | modify sparklister function interface according to commentsMingfei2013-06-131-5/+5
| | | | |
| | * | | Merge branch 'master' of https://github.com/mesos/sparkMingfei2013-06-081-3/+6
| | |\| |
| | * | | modify to pass job annotation by localProperties and use daeamon thread to ↵Mingfei2013-06-082-1/+106
| | | |/ | | |/| | | | | | | | | do joblogger's work
| * | | Merge pull request #643 from adatao/masterMatei Zaharia2013-06-171-2/+19
| |\ \ \ | | | | | | | | | | Bug fix: Zero-length partitions result in NaN for overall mean & variance
| | * | | Import just scala.math.abs rather than scala.math._Christopher Nguyen2013-06-161-1/+1
| | | | |
| | * | | Move zero-length partition testing from JavaAPISuite.java to ↵Christopher Nguyen2013-06-162-24/+19
| | | | | | | | | | | | | | | | | | | | PartitioningSuite.scala
| | * | | Add zeroLengthPartitions() test to make sure, e.g., StatCounter.scala can ↵Christopher Nguyen2013-06-151-0/+22
| | |/ / | | | | | | | | | | | | handle empty partitions without incorrectly returning NaN
| * | | Merge remote-tracking branch 'xiajunluan/xiajunluan'Matei Zaharia2013-06-182-1/+207
| |\ \ \ | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/cluster/TaskSetManager.scala
| | * | | Update LocalSchedulerSuite to avoid using sleep for task launchAndrew xia2013-06-151-24/+59
| | | | |
| | * | | 1. Add unit test for local schedulerAndrew xia2013-05-301-0/+171
| | | | | | | | | | | | | | | | | | | | 2. Move localTaskSetManager to a new file
| | * | | implement FIFO and fair scheduler for spark local modeAndrew xia2013-05-301-1/+1
| | | | |
| * | | | Merge remote-tracking branch 'upstream1/master' into enhance_pipeGavin Li2013-06-166-22/+193
| |\ \ \ \
| | * \ \ \ Merge pull request #649 from ryanlecompte/masterMatei Zaharia2013-06-151-0/+19
| | |\ \ \ \ | | | | | | | | | | | | | | Add top K method to RDD using a bounded priority queue
| | | * | | | add a new top K method to RDD using a bounded priority queueryanlecompte2013-06-121-0/+19
| | | | |_|/ | | | |/| |
| | * | | | Removing print statementPatrick Wendell2013-06-101-1/+0
| | | | | |
| | * | | | Adding Java-API version of compression codecPatrick Wendell2013-06-091-0/+46
| | | | | |
| | * | | | Clean extra whitespacePatrick Wendell2013-06-091-2/+0
| | | | | |
| | * | | | Adding compression to Hadoop save functionsPatrick Wendell2013-06-091-0/+48
| | |/ / /
| | * | | Merge pull request #634 from xiajunluan/masterMatei Zaharia2013-06-071-3/+6
| | |\ \ \ | | | |_|/ | | |/| | [Spark-753] Fix ClusterSchedulSuite unit test failed
| | | * | Fix schedulingAlgorithm bugs for unit testAndrew xia2013-06-031-3/+6
| | | |/
| | * | More block manager cleanup.Reynold Xin2013-05-311-14/+22
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Implemented a removeRdd method in BlockManager, and use that to implement RDD.unpersist. Previously, unpersist needs to send B akka messages, where B = number of blocks. Now unpersist only needs to send W akka messages, where W = the number of workers.
| | * | Fixed the flaky unpersist test in RDDSuite.Reynold Xin2013-05-301-4/+4
| | | |
| | * | Merge branch 'master' of git://github.com/mesos/sparkShivaram Venkataraman2013-05-301-0/+26
| | |\ \ | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/test/scala/spark/ShuffleSuite.scala
| | | * | Skip fetching zero-sized blocks in OIO.Shivaram Venkataraman2013-05-291-0/+27
| | | | | | | | | | | | | | | | | | | | Also unify splitLocalRemoteBlocks for netty/nio and add a test case
| | * | | Flush serializer to fix zero-size kryo blocks bug.Shivaram Venkataraman2013-05-291-5/+17
| | | | | | | | | | | | | | | | | | | | Also convert the local-cluster test case to check for non-zero block sizes
| | * | | Couple of Netty fixesShivaram Venkataraman2013-05-281-1/+13
| | |/ / | | | | | | | | | | | | | | | | | | | | a. Fix the port number by reading it from the bound channel b. Fix the shutdown sequence to make sure we actually block on the channel c. Fix the unit test to use two JVMs.
| * | | update according to commentsGavin Li2013-06-161-4/+9
| | | |
| * | | update according to commentsGavin Li2013-06-051-2/+5
| | | |
| * | | add ut for pipe enhancementGavin Li2013-06-021-0/+31
| |/ /
| * | Merge pull request #529 from xiajunluan/masterMatei Zaharia2013-05-251-0/+247
| |\| | | | | | | [SPARK-663]Implement Fair Scheduler in Spark Cluster Scheduler
| | * fix bug of unit testsAndrew xia2013-05-211-32/+40
| | |
| | * Merge branch 'master' into xiajunluanAndrew xia2013-05-1814-18/+581
| | |\ | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/scheduler/cluster/ClusterScheduler.scala core/src/main/scala/spark/scheduler/cluster/TaskSetManager.scala
| | * | expose TaskSetManager type to resourceOffer function in ClusterSchedulerAndrew xia2013-05-181-46/+66
| | | |
| | * | Fix ClusterScheduler bug to avoid allocating tasks to same slaveAndrew xia2013-05-171-17/+29
| | | |
| | * | refactor the Schedulable interface and add unit test for SchedulingAlgorithmAndrew xia2013-04-181-0/+207
| | | |
| * | | Fixed a stupid mistake that NonJavaSerializableClass was made JavaReynold Xin2013-05-241-1/+1
| | | | | | | | | | | | | | | | serializable.
| * | | Automatically configure Netty port. This makes unit tests usingReynold Xin2013-05-244-25/+25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | local-cluster pass. Previously they were failing because Netty was trying to bind to the same port for all processes. Pair programmed with @shivaram.
generated by cgit v1.2.3 (git 2.39.1) at 2024-08-07 04:49:24 +0000