aboutsummaryrefslogtreecommitdiff
path: root/project
Commit message (Collapse)AuthorAgeFilesLines
...
| | * | | | | | | | | Fix SBT build under Hadoop 0.23.xJey Kottalam2013-08-161-0/+11
| | | | | | | | | | |
| | * | | | | | | | | Fix repl/assembly when YARN enabledJey Kottalam2013-08-161-3/+4
| | | | | | | | | | |
| | * | | | | | | | | Allow make-distribution.sh to specify Hadoop version usedJey Kottalam2013-08-161-6/+22
| | | | | | | | | | |
| | * | | | | | | | | Update default version of Hadoop to 1.2.1Jey Kottalam2013-08-151-1/+1
| | | | | | | | | | |
| | * | | | | | | | | yarn supportJey Kottalam2013-08-151-6/+6
| | | | | | | | | | |
| | * | | | | | | | | yarn sbtJey Kottalam2013-08-151-13/+15
| | | | | | | | | | |
| | * | | | | | | | | dynamically detect hadoop versionJey Kottalam2013-08-151-32/+3
| | | | | | | | | | |
| * | | | | | | | | | Use the JSON formatter from Scala library and removed dependency on lift-json.Reynold Xin2013-08-151-1/+0
| |/ / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | It made the JSON creation slightly more complicated, but reduces one external dependency. The scala library also properly escape "/" (which lift-json doesn't).
| * | | | | | | | | Update to Mesos 0.12.1Matei Zaharia2013-08-131-1/+1
| | | | | | | | | |
| * | | | | | | | | Add MetricsServlet for Spark metrics systemjerryshao2013-08-121-0/+1
| | | | | | | | | |
| * | | | | | | | | Merge pull request #800 from dlyubimov/HBASE_VERSIONMatei Zaharia2013-08-091-1/+4
| |\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | Pull HBASE_VERSION in the head of sbt build
| | * | | | | | | | | fewer wordsDmitriy Lyubimov2013-08-091-1/+1
| | | | | | | | | | |
| | * | | | | | | | | Pull HBASE_VERSION in the head of sbt buildDmitriy Lyubimov2013-08-091-1/+4
| | | | | | | | | | |
| * | | | | | | | | | Merge pull request #786 from shivaram/mllib-javaMatei Zaharia2013-08-091-1/+1
| |\ \ \ \ \ \ \ \ \ \ | | |/ / / / / / / / / | |/| | | | | | | | | Java fixes, tests and examples for ALS, KMeans
| | * | | | | | | | | Java examples, tests for KMeans and ALSShivaram Venkataraman2013-08-061-1/+1
| | |/ / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Changes ALS to accept RDD[Rating] instead of (Int, Int, Double) making it easier to call from Java - Renames class methods from `train` to `run` to enable static methods to be called from Java. - Add unit tests which check if both static / class methods can be called. - Also add examples which port the main() function in ALS, KMeans to the examples project. Couple of minor changes to existing code: - Add a toJavaRDD method in RDD to convert scala RDD to java RDD easily - Workaround a bug where using double[] from Java leads to class cast exception in KMeans init
| * / / / / / / / / Update to Chill 0.3.1Matei Zaharia2013-08-081-2/+2
| |/ / / / / / / /
| * | | | | | | | Revert Mesos version to 0.9 since the 0.12 artifact has target Java 7Matei Zaharia2013-08-011-1/+1
| | | | | | | | |
| * | | | | | | | Merge pull request #753 from shivaram/glm-refactorMatei Zaharia2013-07-311-2/+4
| |\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | Build changes for ML lib
| | * | | | | | | | Add mllib, bagel to repl dependenciesShivaram Venkataraman2013-07-301-3/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Also don't build an assembly jar for them
| | * | | | | | | | Add bagel, mllib to SBT assembly.Shivaram Venkataraman2013-07-301-2/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Also add jblas dependency to mllib pom.xml
| * | | | | | | | | Merge pull request #749 from benh/spark-executor-uriMatei Zaharia2013-07-311-1/+1
| |\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | Added property 'spark.executor.uri' for launching on Mesos.
| | * | | | | | | | | Added property 'spark.executor.uri' for launching on Mesos withoutBenjamin Hindman2013-07-291-1/+1
| | |/ / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | requiring Spark to be installed. Using 'make_distribution.sh' a user can put a Spark distribution at a URI supported by Mesos (e.g., 'hdfs://...') and then set that when launching their job. Also added SPARK_EXECUTOR_URI for the REPL.
| * | | | | | | | | Exclude older version of Snappy in streaming and examples.Reynold Xin2013-07-301-1/+3
| | | | | | | | | |
| * | | | | | | | | Merge branch 'lazy_file_open' of github.com:lyogavin/spark into compressionReynold Xin2013-07-301-0/+1
| |\ \ \ \ \ \ \ \ \ | | |/ / / / / / / / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: project/SparkBuild.scala
| | * | | | | | | | fix dependenciesGavin Li2013-07-031-1/+2
| | | |_|_|_|_|_|/ | | |/| | | | | |
| * | | | | | | | refactor Kryo serializer support to use chill/chill-javaryanlecompte2013-07-241-2/+3
| | | | | | | | |
| * | | | | | | | Fix some typosjerryshao2013-07-241-1/+1
| | | | | | | | |
| * | | | | | | | Add dependency of Codahale's metrics libraryjerryshao2013-07-241-0/+2
| | | | | | | | |
| * | | | | | | | Add JavaAPICompletenessChecker.Josh Rosen2013-07-221-1/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is used to find methods in the Scala API that need to be ported to the Java API. To use it: ./run spark.tools.JavaAPICompletenessChecker Conflicts: project/SparkBuild.scala run run2.cmd
| * | | | | | | | also exclude asm for hadoop2. hadoop1 looks like no need to do that too.Liang-Chi Hsieh2013-07-201-2/+2
| | | | | | | | |
| * | | | | | | | fix a bug in build process that pulls in two versionf of ASM.Liang-Chi Hsieh2013-07-191-4/+4
| | | | | | | | |
| * | | | | | | | Merge pull request #708 from ScrapCodes/dependencies-upgradeMatei Zaharia2013-07-161-4/+4
| |\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | Dependency upgrade Akka 2.0.3 -> 2.0.5
| | * | | | | | | | Dependency upgrade Akka 2.0.3 -> 2.0.5Prashant Sharma2013-07-161-4/+4
| | | | | | | | | |
| * | | | | | | | | Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-162-0/+33
| |/ / / / / / / /
* | | | | | | | | Adding commons io as dependencyPrashant Sharma2013-07-151-1/+3
| | | | | | | | |
* | | | | | | | | Merge branch 'master' of github.com:mesos/spark into scala-2.10Prashant Sharma2013-07-151-3/+2
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/Utils.scala core/src/test/scala/spark/ui/UISuite.scala project/SparkBuild.scala run
| * | | | | | | | Merge branch 'master' of github.com:mesos/sparkMatei Zaharia2013-07-131-1/+1
| |\ \ \ \ \ \ \ \
| | * | | | | | | | changing com.google.code.findbugs maven coordinatesseanm2013-07-131-1/+1
| | | | | | | | | |
| * | | | | | | | | Merge remote-tracking branch 'origin/pr/662'Matei Zaharia2013-07-131-1/+1
| |\ \ \ \ \ \ \ \ \ | | |/ / / / / / / / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: bin/compute-classpath.sh
| | * | | | | | | | Merge branch 'master' into 2013-06/assembly-jar-deployEvan Chan2013-06-281-1/+1
| | |\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: run Previous changes that I made to run and set-dev-classpath.sh instead have been folded into compute-classpath.sh
| | * | | | | | | | Merge branch 'master' into 2013-06/assembly-jar-deployEvan Chan2013-06-252-6/+25
| | |\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: run
| | * | | | | | | | | Enable building a fat jar for the Spark REPLEvan Chan2013-06-201-1/+1
| | | |_|_|_|_|_|_|/ | | |/| | | | | | |
* | | | | | | | | | Merge branch 'master' into master-mergePrashant Sharma2013-07-122-27/+31
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: README.md core/pom.xml core/src/main/scala/spark/deploy/JsonProtocol.scala core/src/main/scala/spark/deploy/LocalSparkCluster.scala core/src/main/scala/spark/deploy/master/Master.scala core/src/main/scala/spark/deploy/master/MasterWebUI.scala core/src/main/scala/spark/deploy/worker/Worker.scala core/src/main/scala/spark/deploy/worker/WorkerWebUI.scala core/src/main/scala/spark/storage/BlockManagerUI.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml project/SparkBuild.scala streaming/src/main/scala/spark/streaming/receivers/ActorReceiver.scala
| * | | | | | | | | Merge pull request #668 from shimingfei/guava-14.0.1Matei Zaharia2013-07-061-1/+2
| |\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | update guava version from 11.0.1 to 14.0.1
| | * | | | | | | | | update guava version from 11.0.1 to 14.0.1Mingfei2013-07-031-1/+2
| | | | | | | | | | |
| * | | | | | | | | | Merge remote-tracking branch 'pwendell/ui-updates'Matei Zaharia2013-07-062-7/+2
| |\ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/DAGScheduler.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml
| | * | | | | | | | | | Changing JSON protocol and removing spray codePatrick Wendell2013-06-222-7/+2
| | | | | | | | | | | |
| * | | | | | | | | | | Renamed ML package to MLlib and added it to classpathMatei Zaharia2013-07-051-4/+4
| | | | | | | | | | | |
| * | | | | | | | | | | Removed dependency on Apache Commons MathMatei Zaharia2013-07-051-2/+1
| | | | | | | | | | | |
| * | | | | | | | | | | Minor clean up of the RidgeRegression code. I am not even sure why I didReynold Xin2013-07-051-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | this :s.