| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | Merging build changes in from 0.8 | Patrick Wendell | 2013-10-05 | 1 | -8/+22 |
| | | |||||
| * | Update build version in master | Patrick Wendell | 2013-09-24 | 1 | -1/+1 |
| | | |||||
| * | Minor YARN build cleanups | Jey Kottalam | 2013-09-06 | 1 | -14/+0 |
| | | |||||
| * | Fix some URLs | Matei Zaharia | 2013-09-01 | 1 | -1/+1 |
| | | |||||
| * | Initial work to rename package to org.apache.spark | Matei Zaharia | 2013-09-01 | 1 | -7/+7 |
| | | |||||
| * | Update Maven build to create assemblies expected by new scripts | Matei Zaharia | 2013-08-29 | 1 | -6/+56 |
| | | | | | | | | | | | | | | | | This includes the following changes: - The "assembly" package now builds in Maven by default, and creates an assembly containing both hadoop-client and Spark, unlike the old BigTop distribution assembly that skipped hadoop-client - There is now a bigtop-dist package to build the old BigTop assembly - The repl-bin package is no longer built by default since the scripts don't reply on it; instead it can be enabled with -Prepl-bin - Py4J is now included in the assembly/lib folder as a local Maven repo, so that the Maven package can link to it - run-example now adds the original Spark classpath as well because the Maven examples assembly lists spark-core and such as provided - The various Maven projects add a spark-yarn dependency correctly | ||||
| * | Change build and run instructions to use assemblies | Matei Zaharia | 2013-08-29 | 1 | -0/+5 |
| | | | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel. | ||||
| * | Remove redundant dependencies from POMs | Jey Kottalam | 2013-08-18 | 1 | -4/+0 |
| | | |||||
| * | Updates to repl and example POMs to match SBT build | Jey Kottalam | 2013-08-16 | 1 | -0/+10 |
| | | |||||
| * | Maven build now also works with YARN | Jey Kottalam | 2013-08-16 | 1 | -57/+0 |
| | | |||||
| * | Don't mark hadoop-client as 'provided' | Jey Kottalam | 2013-08-16 | 1 | -1/+0 |
| | | |||||
| * | Maven build now works with CDH hadoop-2.0.0-mr1 | Jey Kottalam | 2013-08-16 | 1 | -44/+0 |
| | | |||||
| * | Initial changes to make Maven build agnostic of hadoop version | Jey Kottalam | 2013-08-16 | 1 | -84/+60 |
| | | |||||
| * | Fixed path to JavaALS.java and JavaKMeans.java, fixed hadoop2-yarn profile | Alexander Pivovarov | 2013-08-10 | 1 | -0/+6 |
| | | |||||
| * | Java examples, tests for KMeans and ALS | Shivaram Venkataraman | 2013-08-06 | 1 | -0/+12 |
| | | | | | | | | | | | | | | | | - Changes ALS to accept RDD[Rating] instead of (Int, Int, Double) making it easier to call from Java - Renames class methods from `train` to `run` to enable static methods to be called from Java. - Add unit tests which check if both static / class methods can be called. - Also add examples which port the main() function in ALS, KMeans to the examples project. Couple of minor changes to existing code: - Add a toJavaRDD method in RDD to convert scala RDD to java RDD easily - Workaround a bug where using double[] from Java leads to class cast exception in KMeans init | ||||
| * | Add Apache license headers and LICENSE and NOTICE files | Matei Zaharia | 2013-07-16 | 1 | -0/+17 |
| | | |||||
| * | pom cleanup | Mark Hamstra | 2013-07-08 | 1 | -1/+0 |
| | | |||||
| * | Explicit dependencies for scala-library and scalap to prevent 2.9.2 vs. ↵ | Mark Hamstra | 2013-07-08 | 1 | -0/+5 |
| | | | | | 2.9.3 problems | ||||
| * | Fixing missed hbase dependency in examples hadoop2-yarn profile | Konstantin Boudnik | 2013-07-01 | 1 | -0/+5 |
| | | |||||
| * | Merge remote-tracking branch 'milliondreams/casdemo' | Matei Zaharia | 2013-06-18 | 1 | -0/+35 |
| |\ | | | | | | | | | Conflicts: project/SparkBuild.scala | ||||
| | * | Adding deps to examples/pom.xml | Rohit Rai | 2013-06-02 | 1 | -0/+35 |
| | | | | | | | | | Fixing exclusion in examples deps in SparkBuild.scala | ||||
| * | | Add hBase dependency to examples POM | Ethan Jewett | 2013-05-20 | 1 | -0/+10 |
| |/ | |||||
| * | Attempt at fixing merge conflict | Mridul Muralidharan | 2013-04-24 | 1 | -2/+2 |
| |\ | |||||
| | * | Merge remote-tracking branch 'jey/bump-development-version-to-0.8.0' | Matei Zaharia | 2013-04-08 | 1 | -1/+1 |
| | |\ | | | | | | | | | | | | | | | | Conflicts: docs/_config.yml project/SparkBuild.scala | ||||
| | | * | Bump development version to 0.8.0 | Jey Kottalam | 2013-03-28 | 1 | -1/+1 |
| | | | | |||||
| | * | | Bumping Algebird version in examples now that it supports JDK 1.6 | Nick Pentreath | 2013-04-03 | 1 | -1/+1 |
| | |/ | |||||
| * / | Add support for building against hadoop2-yarn : adding new maven profile for it | Mridul Muralidharan | 2013-04-07 | 1 | -0/+43 |
| |/ | |||||
| * | Add a log4j compile dependency to fix build in IntelliJ | Mikhail Bautin | 2013-03-15 | 1 | -1/+1 |
| | | | | | | Also rename parent project to spark-parent (otherwise it shows up as "parent" in IntelliJ, which is very confusing). | ||||
| * | bump version to 0.7.1-SNAPSHOT in the subproject poms to keep the maven ↵ | Mark Hamstra | 2013-02-28 | 1 | -1/+1 |
| | | | | | build building. | ||||
| * | Changed Algebird from 0.1.9 to 0.1.8 | Tathagata Das | 2013-02-24 | 1 | -1/+1 |
| | | |||||
| * | Bumping Algebird to 0.1.9 | Nick Pentreath | 2013-02-21 | 1 | -1/+1 |
| | | |||||
| * | Dependencies and refactoring for streaming HLL example, and using ↵ | Nick Pentreath | 2013-02-19 | 1 | -6/+0 |
| | | | | | context.twitterStream method | ||||
| * | Adding streaming HyperLogLog example using Algebird | Nick Pentreath | 2013-02-19 | 1 | -0/+5 |
| | | |||||
| * | Remove activation of profiles by default | Mikhail Bautin | 2013-01-31 | 1 | -11/+0 |
| | | | | | | See the discussion at https://github.com/mesos/spark/pull/355 for why default profile activation is a problem. | ||||
| * | Add Maven build file for streaming, and fix some issues in SBT file | Matei Zaharia | 2013-01-20 | 1 | -0/+17 |
| | | | | | | | As part of this, changed our Scala 2.9.2 Kafka library to be available as a local Maven repository, following the example in (http://blog.dub.podval.org/2010/01/maven-in-project-repository.html) | ||||
| * | Rename environment variable for hadoop profiles to hadoopVersion | Shivaram Venkataraman | 2013-01-12 | 1 | -2/+2 |
| | | |||||
| * | Activate hadoop2 profile in pom.xml with -Dhadoop=2 | Shivaram Venkataraman | 2013-01-10 | 1 | -0/+6 |
| | | |||||
| * | Activate hadoop1 if property hadoop is missing. hadoop2 can be activated now | Shivaram Venkataraman | 2013-01-08 | 1 | -1/+3 |
| | | | | | by using -Dhadoop -Phadoop2. | ||||
| * | Activate hadoop1 profile by default for maven builds | Shivaram Venkataraman | 2013-01-07 | 1 | -0/+3 |
| | | |||||
| * | Mark hadoop dependencies provided in all library artifacts | Thomas Dudziak | 2012-12-10 | 1 | -0/+3 |
| | | |||||
| * | Use the same output directories that SBT had in subprojects | Matei Zaharia | 2012-12-10 | 1 | -1/+3 |
| | | | | | This will make it easier to make the "run" script work with a Maven build | ||||
| * | Updated versions in the pom.xml files to match current master | Thomas Dudziak | 2012-11-27 | 1 | -1/+1 |
| | | |||||
| * | Addressed code review comments | Thomas Dudziak | 2012-11-27 | 1 | -0/+1 |
| | | |||||
| * | Added maven and debian build files | Thomas Dudziak | 2012-11-20 | 1 | -0/+100 |
 |
index : spark | |
| Mirror of Apache Spark |
| aboutsummaryrefslogtreecommitdiff |