Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Move some classes to more appropriate packages: | Matei Zaharia | 2013-09-01 | 1 | -1/+1 |
| | | | | | | * RDD, *RDDFunctions -> org.apache.spark.rdd * Utils, ClosureCleaner, SizeEstimator -> org.apache.spark.util * JavaSerializer, KryoSerializer -> org.apache.spark.serializer | ||||
* | Fix some URLs | Matei Zaharia | 2013-09-01 | 1 | -1/+1 |
| | |||||
* | Initial work to rename package to org.apache.spark | Matei Zaharia | 2013-09-01 | 3 | -27/+24 |
| | |||||
* | Change build and run instructions to use assemblies | Matei Zaharia | 2013-08-29 | 3 | -447/+0 |
| | | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel. | ||||
* | Remove redundant dependencies from POMs | Jey Kottalam | 2013-08-18 | 1 | -4/+0 |
| | |||||
* | Maven build now also works with YARN | Jey Kottalam | 2013-08-16 | 1 | -40/+0 |
| | |||||
* | Don't mark hadoop-client as 'provided' | Jey Kottalam | 2013-08-16 | 1 | -1/+0 |
| | |||||
* | Maven build now works with CDH hadoop-2.0.0-mr1 | Jey Kottalam | 2013-08-16 | 1 | -27/+0 |
| | |||||
* | Initial changes to make Maven build agnostic of hadoop version | Jey Kottalam | 2013-08-16 | 1 | -33/+10 |
| | |||||
* | Add Apache license headers and LICENSE and NOTICE files | Matei Zaharia | 2013-07-16 | 7 | -1/+120 |
| | |||||
* | Attempt to fix streaming test failures after yarn branch merge | Mridul Muralidharan | 2013-04-28 | 1 | -0/+1 |
| | |||||
* | Attempt at fixing merge conflict | Mridul Muralidharan | 2013-04-24 | 2 | -4/+4 |
|\ | |||||
| * | Fix passing of superstep in Bagel to avoid seeing new values of the | Matei Zaharia | 2013-04-08 | 1 | -3/+3 |
| | | | | | | | | | | superstep value upon recomputation, and set the default storage level in Bagel to MEMORY_AND_DISK | ||||
| * | Bump development version to 0.8.0 | Jey Kottalam | 2013-03-28 | 1 | -1/+1 |
| | | |||||
* | | Add support for building against hadoop2-yarn : adding new maven profile for it | Mridul Muralidharan | 2013-04-07 | 1 | -0/+37 |
|/ | |||||
* | Add a log4j compile dependency to fix build in IntelliJ | Mikhail Bautin | 2013-03-15 | 1 | -1/+1 |
| | | | | | Also rename parent project to spark-parent (otherwise it shows up as "parent" in IntelliJ, which is very confusing). | ||||
* | Fix doc style | Nick Pentreath | 2013-03-11 | 1 | -7/+13 |
| | |||||
* | Adding test for non-default persistence level | Nick Pentreath | 2013-03-09 | 1 | -0/+18 |
| | |||||
* | Added choice of persitance level to Bagel. Also added documentation. | Nick Pentreath | 2013-03-09 | 1 | -8/+83 |
| | |||||
* | bump version to 0.7.1-SNAPSHOT in the subproject poms to keep the maven ↵ | Mark Hamstra | 2013-02-28 | 1 | -1/+1 |
| | | | | build building. | ||||
* | Renamed "splits" to "partitions" | Matei Zaharia | 2013-02-17 | 3 | -14/+14 |
| | |||||
* | Formatting fixes | Matei Zaharia | 2013-02-11 | 1 | -13/+9 |
| | |||||
* | Fixed an exponential recursion that could happen with doCheckpoint due | Matei Zaharia | 2013-02-11 | 1 | -8/+27 |
| | | | | to lack of memoization | ||||
* | Remove activation of profiles by default | Mikhail Bautin | 2013-01-31 | 1 | -11/+0 |
| | | | | | See the discussion at https://github.com/mesos/spark/pull/355 for why default profile activation is a problem. | ||||
* | Replace old 'master' term with 'driver'. | Stephen Haberman | 2013-01-25 | 1 | -1/+1 |
| | |||||
* | Merge branch 'master' into streaming | Tathagata Das | 2013-01-15 | 1 | -0/+11 |
|\ | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala docs/_layouts/global.html docs/index.md run | ||||
| * | Rename environment variable for hadoop profiles to hadoopVersion | Shivaram Venkataraman | 2013-01-12 | 1 | -2/+2 |
| | | |||||
| * | Activate hadoop2 profile in pom.xml with -Dhadoop=2 | Shivaram Venkataraman | 2013-01-10 | 1 | -0/+6 |
| | | |||||
| * | Activate hadoop1 if property hadoop is missing. hadoop2 can be activated now | Shivaram Venkataraman | 2013-01-08 | 1 | -1/+3 |
| | | | | | | | | by using -Dhadoop -Phadoop2. | ||||
| * | Activate hadoop1 profile by default for maven builds | Shivaram Venkataraman | 2013-01-07 | 1 | -0/+3 |
| | | |||||
* | | Changed locations for unit test logs. | Tathagata Das | 2013-01-07 | 1 | -2/+2 |
|/ | |||||
* | Mark hadoop dependencies provided in all library artifacts | Thomas Dudziak | 2012-12-10 | 1 | -0/+3 |
| | |||||
* | Use the same output directories that SBT had in subprojects | Matei Zaharia | 2012-12-10 | 1 | -1/+3 |
| | | | | This will make it easier to make the "run" script work with a Maven build | ||||
* | Updated versions in the pom.xml files to match current master | Thomas Dudziak | 2012-11-27 | 1 | -1/+1 |
| | |||||
* | Addressed code review comments | Thomas Dudziak | 2012-11-27 | 1 | -0/+1 |
| | |||||
* | Added maven and debian build files | Thomas Dudziak | 2012-11-20 | 1 | -0/+100 |
| | |||||
* | Some doc fixes, including showing version number in nav bar again | Matei Zaharia | 2012-10-13 | 1 | -0/+5 |
| | |||||
* | More doc updates, and moved Serializer to a subpackage. | Matei Zaharia | 2012-10-12 | 1 | -5/+6 |
| | |||||
* | Removed the need to sleep in tests due to waiting for Akka to shut down | Matei Zaharia | 2012-10-07 | 1 | -0/+2 |
| | |||||
* | Write all unit test output to a file | Matei Zaharia | 2012-10-01 | 1 | -4/+6 |
| | |||||
* | Changed the way tasks' dependency files are sent to workers so that | Matei Zaharia | 2012-09-28 | 1 | -1/+4 |
| | | | | custom serializers or Kryo registrators can be loaded. | ||||
* | Set log level in tests to WARN | Matei Zaharia | 2012-08-23 | 1 | -0/+8 |
| | |||||
* | Fix further issues with tests and broadcast. | Matei Zaharia | 2012-08-23 | 1 | -1/+4 |
| | | | | | The broadcast fix is to store values as MEMORY_ONLY_DESER instead of MEMORY_ONLY, which will save substantial time on serialization. | ||||
* | Stlystic changes | Denny | 2012-07-23 | 1 | -2/+2 |
| | | | | | | Conflicts: core/src/test/scala/spark/MesosSchedulerSuite.scala | ||||
* | Always destroy SparkContext in after block for the unit tests. | Denny | 2012-07-23 | 1 | -6/+11 |
| | | | | | | Conflicts: core/src/test/scala/spark/ShuffleSuite.scala | ||||
* | Merge branch 'master' into dev | Matei Zaharia | 2012-06-15 | 2 | -3/+1 |
|\ | |||||
| * | Performance improvements to shuffle operations: in particular, preserve | Matei Zaharia | 2012-06-09 | 2 | -3/+1 |
| | | | | | | | | | | RDD partitioning in more cases where it's possible, and use iterators instead of materializing collections when doing joins. | ||||
* | | Merge in engine improvements from the Spark Streaming project, developed | Matei Zaharia | 2012-06-07 | 1 | -5/+6 |
|/ | | | | | | jointly with Tathagata Das and Haoyuan Li. This commit imports the changes and ports them to Mesos 0.9, but does not yet pass unit tests due to various classes not supporting a graceful stop() yet. | ||||
* | Added an option (spark.closure.serializer) to specify the serializer for | Reynold Xin | 2012-04-09 | 1 | -0/+4 |
| | | | | closures. This enables using Kryo as the closure serializer. | ||||
* | Update Bagel unit tests to reflect API change | Ankur Dave | 2011-11-08 | 1 | -23/+21 |
| |