Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | fixed review comments | Prashant Sharma | 2014-01-03 | 1 | -1/+3 |
| | |||||
* | Miscellaneous fixes from code review. | Matei Zaharia | 2014-01-01 | 1 | -1/+1 |
| | | | | | | Also replaced SparkConf.getOrElse with just a "get" that takes a default value, and added getInt, getLong, etc to make code that uses this simpler later on. | ||||
* | Various fixes to configuration code | Matei Zaharia | 2013-12-28 | 2 | -7/+13 |
| | | | | | | | | | | | | | | - Got rid of global SparkContext.globalConf - Pass SparkConf to serializers and compression codecs - Made SparkConf public instead of private[spark] - Improved API of SparkContext and SparkConf - Switched executor environment vars to be passed through SparkConf - Fixed some places that were still using system properties - Fixed some tests, though others are still failing This still fails several tests in core, repl and streaming, likely due to properties not being set or cleared correctly (some of the tests run fine in isolation). | ||||
* | spark-544, introducing SparkConf and related configuration overhaul. | Prashant Sharma | 2013-12-25 | 2 | -8/+6 |
| | |||||
* | Review comments on the PR for scala 2.10 migration. | Prashant Sharma | 2013-12-13 | 1 | -1/+0 |
| | |||||
* | Fixed compile time warnings and formatting post merge. | Prashant Sharma | 2013-11-26 | 1 | -65/+74 |
| | |||||
* | Various merge corrections | Aaron Davidson | 2013-11-14 | 2 | -12/+4 |
| | | | | | | | | | | I've diff'd this patch against my own -- since they were both created independently, this means that two sets of eyes have gone over all the merge conflicts that were created, so I'm feeling significantly more confident in the resulting PR. @rxin has looked at the changes to the repl and is resoundingly confident that they are correct. | ||||
* | Merge branch 'master' into scala-2.10 | Raymond Liu | 2013-11-14 | 1 | -2/+34 |
|\ | |||||
| * | Propagate the SparkContext local property from the thread that calls the ↵ | Reynold Xin | 2013-11-09 | 2 | -4/+42 |
| | | | | | | | | spark-repl to the actual execution thread. | ||||
* | | Merge branch 'master' into scala-2.10 | Raymond Liu | 2013-11-13 | 1 | -7/+29 |
|\| | |||||
| * | Makes Spark SIMR ready. | Ali Ghodsi | 2013-10-24 | 1 | -0/+14 |
| | | |||||
| * | Spark shell exits if it cannot create SparkContext | Aaron Davidson | 2013-10-17 | 1 | -1/+8 |
| | | | | | | | | | | | | Mainly, this occurs if you provide a messed up MASTER url (one that doesn't match one of our regexes). Previously, we would default to Mesos, fail, and then start the shell anyway, except that any Spark command would fail. | ||||
* | | Merge branch 'master' into scala-2.10 | Prashant Sharma | 2013-10-01 | 1 | -1/+1 |
|\| | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressUI.scala docs/_config.yml project/SparkBuild.scala repl/src/main/scala/org/apache/spark/repl/SparkILoop.scala | ||||
| * | Update build version in master | Patrick Wendell | 2013-09-24 | 1 | -1/+1 |
| | | |||||
* | | ported repl improvements from master | Prashant Sharma | 2013-09-15 | 2 | -2/+11 |
| | | |||||
* | | Fixed repl suite | Prashant Sharma | 2013-09-15 | 2 | -7/+7 |
| | | |||||
* | | Few more fixes to tests broken during merge | Prashant Sharma | 2013-09-10 | 1 | -50/+0 |
| | | |||||
* | | Merged with master | Prashant Sharma | 2013-09-06 | 17 | -201/+300 |
|\| | |||||
| * | Updated LICENSE with third-party licenses | Matei Zaharia | 2013-09-02 | 1 | -0/+17 |
| | | |||||
| * | Move some classes to more appropriate packages: | Matei Zaharia | 2013-09-01 | 1 | -1/+1 |
| | | | | | | | | | | | | * RDD, *RDDFunctions -> org.apache.spark.rdd * Utils, ClosureCleaner, SizeEstimator -> org.apache.spark.util * JavaSerializer, KryoSerializer -> org.apache.spark.serializer | ||||
| * | Initial work to rename package to org.apache.spark | Matei Zaharia | 2013-09-01 | 11 | -24/+24 |
| | | |||||
| * | Format cleanup. | Benjamin Hindman | 2013-07-30 | 1 | -1/+3 |
| | | |||||
| * | Added property 'spark.executor.uri' for launching on Mesos without | Benjamin Hindman | 2013-07-29 | 1 | -0/+2 |
| | | | | | | | | | | | | | | requiring Spark to be installed. Using 'make_distribution.sh' a user can put a Spark distribution at a URI supported by Mesos (e.g., 'hdfs://...') and then set that when launching their job. Also added SPARK_EXECUTOR_URI for the REPL. | ||||
| * | Add Apache license headers and LICENSE and NOTICE files | Matei Zaharia | 2013-07-16 | 4 | -1/+69 |
| | | |||||
* | | Added add jars functionality to new repl, which was dropped while merging ↵ | Prashant Sharma | 2013-07-12 | 3 | -4/+11 |
| | | | | | | | | with old. | ||||
* | | Removed an unnecessary test case | Prashant Sharma | 2013-07-11 | 1 | -101/+0 |
| | | |||||
* | | Merge branch 'master' into master-merge | Prashant Sharma | 2013-07-03 | 2 | -3/+23 |
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/pom.xml core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/RDDCheckpointData.scala core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/Utils.scala core/src/main/scala/spark/api/python/PythonRDD.scala core/src/main/scala/spark/deploy/client/Client.scala core/src/main/scala/spark/deploy/master/MasterWebUI.scala core/src/main/scala/spark/deploy/worker/Worker.scala core/src/main/scala/spark/deploy/worker/WorkerWebUI.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/ZippedRDD.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockManagerMaster.scala core/src/main/scala/spark/storage/BlockManagerMasterActor.scala core/src/main/scala/spark/storage/BlockManagerUI.scala core/src/main/scala/spark/util/AkkaUtils.scala core/src/test/scala/spark/SizeEstimatorSuite.scala pom.xml project/SparkBuild.scala repl/src/main/scala/spark/repl/SparkILoop.scala repl/src/test/scala/spark/repl/ReplSuite.scala streaming/src/main/scala/spark/streaming/StreamingContext.scala streaming/src/main/scala/spark/streaming/api/java/JavaStreamingContext.scala streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/util/MasterFailureTest.scala | ||||
| * | Formatting | Matei Zaharia | 2013-06-25 | 1 | -3/+4 |
| | | |||||
| * | Added a local-cluster mode test to ReplSuite | Matei Zaharia | 2013-06-25 | 1 | -5/+26 |
| | | |||||
| * | Fix search path for REPL class loader to really find added JARs | Matei Zaharia | 2013-06-22 | 1 | -1/+3 |
| | | |||||
| * | ADD_JARS environment variable for spark-shell | Matei Zaharia | 2013-06-22 | 1 | -2/+7 |
| | | |||||
| * | Update ASM to version 4.0 | Matei Zaharia | 2013-06-19 | 1 | -2/+1 |
| | | |||||
| * | Attempt to fix streaming test failures after yarn branch merge | Mridul Muralidharan | 2013-04-28 | 1 | -0/+1 |
| | | |||||
* | | Fix StandaloneClusterReplSuite to allow running multiple tests | Matei Zaharia | 2013-06-08 | 2 | -16/+5 |
| | | |||||
* | | Fixied other warnings | Prashant Sharma | 2013-04-29 | 1 | -1/+1 |
| | | |||||
* | | scala 2.10 and master merge | Prashant Sharma | 2013-04-24 | 3 | -16/+2 |
| | | |||||
* | | Manually merged scala-2.10 and master | Prashant Sharma | 2013-04-22 | 2 | -3/+18 |
|\| | |||||
| * | Merge remote-tracking branch 'jey/bump-development-version-to-0.8.0' | Matei Zaharia | 2013-04-08 | 1 | -1/+1 |
| |\ | | | | | | | | | | | | | | | | Conflicts: docs/_config.yml project/SparkBuild.scala | ||||
| | * | Bump development version to 0.8.0 | Jey Kottalam | 2013-03-28 | 1 | -1/+1 |
| |/ | |||||
| * | Change version to 0.7.1-SNAPSHOT for development branch | Matei Zaharia | 2013-02-27 | 1 | -1/+1 |
| | | |||||
| * | Replace old 'master' term with 'driver'. | Stephen Haberman | 2013-01-25 | 1 | -1/+1 |
| | | |||||
| * | Changed locations for unit test logs. | Tathagata Das | 2013-01-07 | 1 | -2/+2 |
| | | |||||
* | | Added more tests | Prashant Sharma | 2013-04-19 | 3 | -12/+84 |
| | | |||||
* | | Changed spark context as lazy val to become just val. | Prashant Sharma | 2013-04-16 | 2 | -3/+5 |
| | | |||||
* | | Added standalone cluster repl suite | Prashant Sharma | 2013-04-15 | 3 | -47/+100 |
| | | |||||
* | | Added class wrappers instead of object and incorporated most of matei comments | Prashant Sharma | 2013-04-10 | 2 | -20/+39 |
| | | |||||
* | | Made shell loading synchronous as async loading confuses with out of order ↵ | Prashant Sharma | 2013-04-10 | 1 | -1/+2 |
| | | | | | | | | status messages | ||||
* | | Fixed broken tests by last commit for repl. | Prashant Sharma | 2013-03-25 | 1 | -8/+7 |
| | | |||||
* | | Ctrl-D hang bug fixed! | Prashant Sharma | 2013-03-20 | 2 | -1/+13 |
| | | |||||
* | | fixed autocompletion apparent hang due to logging | prashant | 2013-03-19 | 2 | -8/+9 |
| | |