aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Added add jars functionality to new repl, which was dropped while merging ↵Prashant Sharma2013-07-123-4/+11
| | | | with old.
* Removed an unnecessary test casePrashant Sharma2013-07-111-101/+0
|
* Removed some unnecessary code and fixed dependenciesPrashant Sharma2013-07-113-10/+6
|
* Merge branch 'master' into master-mergePrashant Sharma2013-07-03228-2760/+11461
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/pom.xml core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/RDDCheckpointData.scala core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/Utils.scala core/src/main/scala/spark/api/python/PythonRDD.scala core/src/main/scala/spark/deploy/client/Client.scala core/src/main/scala/spark/deploy/master/MasterWebUI.scala core/src/main/scala/spark/deploy/worker/Worker.scala core/src/main/scala/spark/deploy/worker/WorkerWebUI.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/ZippedRDD.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockManagerMaster.scala core/src/main/scala/spark/storage/BlockManagerMasterActor.scala core/src/main/scala/spark/storage/BlockManagerUI.scala core/src/main/scala/spark/util/AkkaUtils.scala core/src/test/scala/spark/SizeEstimatorSuite.scala pom.xml project/SparkBuild.scala repl/src/main/scala/spark/repl/SparkILoop.scala repl/src/test/scala/spark/repl/ReplSuite.scala streaming/src/main/scala/spark/streaming/StreamingContext.scala streaming/src/main/scala/spark/streaming/api/java/JavaStreamingContext.scala streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/util/MasterFailureTest.scala
| * Merge pull request #666 from c0s/masterMatei Zaharia2013-07-011-0/+5
| |\ | | | | | | hbase dependency is missed in hadoop2-yarn profile of examples module
| | * Fixing missed hbase dependency in examples hadoop2-yarn profileKonstantin Boudnik2013-07-011-0/+5
| |/
| * Clarify that PySpark is not supported on Windowsroot2013-07-011-3/+2
| |
| * Fixed PySpark perf regression by not using socket.makefile(), and improvedroot2013-07-013-22/+50
| | | | | | | | | | | | | | debuggability by letting "print" statements show up in the executor's stderr Conflicts: core/src/main/scala/spark/api/python/PythonRDD.scala
| * Fix performance bug with new Python code not using buffered streamsroot2013-07-012-17/+19
| |
| * Increase SLF4j version in Maven tooMatei Zaharia2013-06-301-1/+1
| |
| * Update docs on SCALA_LIBRARY_PATHMatei Zaharia2013-06-302-13/+9
| |
| * Made use of spark.executor.memory setting consistent and documented itMatei Zaharia2013-06-305-34/+43
| | | | | | | | | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala
| * Merge pull request #577 from skumargithub/masterMatei Zaharia2013-06-291-0/+50
| |\ | | | | | | Example of cumulative counting using updateStateByKey
| | * Removed unused code, clarified intent of the program, batch size to 1 secondunknown2013-05-061-5/+3
| | |
| | * Modified as per TD's suggestionsunknown2013-04-301-17/+6
| | |
| | * Examaple of cumulative counting using updateStateByKeyunknown2013-04-221-0/+63
| | |
| * | Remove Twitter4J specific repo since it's in Maven centralMatei Zaharia2013-06-292-13/+1
| | |
| * | Initialize Twitter4J OAuth from system properties instead of promptingMatei Zaharia2013-06-294-38/+23
| | |
| * | Merge remote-tracking branch 'mrpotes/master'Matei Zaharia2013-06-296-50/+97
| |\ \
| | * | Fix usage and parameter extractionJames Phillpotts2013-06-253-12/+9
| | | |
| | * | Include a default OAuth implementation, and update examples and ↵James Phillpotts2013-06-256-28/+81
| | | | | | | | | | | | | | | | JavaStreamingContext
| | * | Twitter API v1 is retired - username/password auth no longer possibleJames Phillpotts2013-06-241-15/+1
| | | |
| | * | Allow other twitter authorizations than username/passwordJames Phillpotts2013-06-212-9/+20
| | | |
| * | | Merge pull request #664 from pwendell/test-fixMatei Zaharia2013-06-271-1/+0
| |\ \ \ | | | | | | | | | | Removing incorrect test statement
| | * | | Removing incorrect test statementPatrick Wendell2013-06-271-1/+0
| | | | |
| * | | | Look at JAVA_HOME before PATH to determine Java executableMatei Zaharia2013-06-271-4/+5
| | | | |
| * | | | Simplify Python docs a little to do substring searchMatei Zaharia2013-06-261-4/+3
| | | | |
| * | | | Fixes to compute-classpath on WindowsMatei Zaharia2013-06-262-2/+3
| | | | |
| * | | | Merge pull request #663 from stephenh/option_and_getenvMatei Zaharia2013-06-261-17/+6
| |\ \ \ \ | | | | | | | | | | | | Be cute with Option and getenv.
| | * | | | Wrap lines.Stephen Haberman2013-06-261-1/+3
| | | | | |
| | * | | | Be cute with Option and getenv.Stephen Haberman2013-06-261-17/+4
| |/ / / /
| * | | | Don't use forward slash in exclusion for JAR signature filesMatei Zaharia2013-06-251-1/+1
| | | | |
| * | | | Refactored tests to share SparkContexts in some of themMatei Zaharia2013-06-2510-425/+373
| | | | | | | | | | | | | | | | | | | | | | | | | Creating these seems to take a while and clutters the output with Akka stuff, so it would be nice to share them.
| * | | | FormattingMatei Zaharia2013-06-251-3/+4
| | | | |
| * | | | Added a local-cluster mode test to ReplSuiteMatei Zaharia2013-06-251-5/+26
| | | | |
| * | | | Fix computation of classpath when we launch java directlyMatei Zaharia2013-06-256-107/+189
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The previous version assumed that a CLASSPATH environment variable was set by the "run" script when launching the process that starts the ExecutorRunner, but unfortunately this is not true in tests. Instead, we factor the classpath calculation into an extenral script and call that. NOTE: This includes a Windows version but hasn't yet been tested there.
| * | | | Some fixes to the launch-java-directly change:Matei Zaharia2013-06-253-31/+138
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Split SPARK_JAVA_OPTS into multiple command-line arguments if it contains spaces; this splitting follows quoting rules in bash - Add the Scala JARs to the classpath if they're not in the CLASSPATH variable because the ExecutorRunner is launched with "scala" (this can happen when using local-cluster URLs in spark-shell)
| * | | | Fixed deprecated use of expect in SizeEstimatorSuiteMatei Zaharia2013-06-251-36/+36
| | | | |
| * | | | Merge remote-tracking branch 'cgrothaus/SPARK-698'Matei Zaharia2013-06-253-13/+45
| |\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: run
| | * | | | Incorporate feedback from mateiz:Christoph Grothaus2013-02-243-25/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - we do not need getEnvOrEmpty - Instead of saving SPARK_NONDAEMON_JAVA_OPTS, it would be better to modify the scripts to use a different variable name for the JAVA_OPTS they do eventually use
| | * | | | Fix SPARK-698. From ExecutorRunner, launch java directly instead via the run ↵Christoph Grothaus2013-02-203-4/+45
| | | | | | | | | | | | | | | | | | | | | | | | scripts.
| * | | | | Merge pull request #661 from mesos/streamingMatei Zaharia2013-06-2512-103/+148
| |\ \ \ \ \ | | | | | | | | | | | | | | Kafka fixes and DStream.count fix for master
| | * \ \ \ \ Merge branch 'master' into streamingTathagata Das2013-06-24289-3293/+13250
| | |\ \ \ \ \ | | |/ / / / / | |/| | | | | | | | | | | | | | | | | | | Conflicts: .gitignore
| * | | | | | Clone the zero value for each key in foldByKeyMatei Zaharia2013-06-232-3/+34
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The old version reused the object within each task, leading to overwriting of the object when a mutable type is used, which is expected to be common in fold. Conflicts: core/src/test/scala/spark/ShuffleSuite.scala
| * | | | | | Fix search path for REPL class loader to really find added JARsMatei Zaharia2013-06-222-17/+25
| | | | | | |
| * | | | | | ADD_JARS environment variable for spark-shellMatei Zaharia2013-06-222-4/+15
| | | | | | |
| * | | | | | Merge pull request #648 from shivaram/netty-dbgMatei Zaharia2013-06-227-86/+151
| |\ \ \ \ \ \ | | |_|_|/ / / | |/| | | | | Shuffle fixes and cleanup
| | * | | | | Fix some comments and styleShivaram Venkataraman2013-06-135-14/+8
| | | | | | |
| | * | | | | Merge branch 'netty-dbg' of github.com:shivaram/spark into netty-dbgShivaram Venkataraman2013-06-124-39/+94
| | |\ \ \ \ \
| | | * | | | | Clean up variables and counters in BlockFetcherIteratorShivaram Venkataraman2013-06-061-23/+31
| | | | | | | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-09 19:47:02 +0000