diff options
author | Tathagata Das <tathagata.das1565@gmail.com> | 2014-05-22 20:48:55 -0700 |
---|---|---|
committer | Tathagata Das <tathagata.das1565@gmail.com> | 2014-05-22 20:48:55 -0700 |
commit | b2bdd0e505f1ae3d39c46139f17bd43779ece635 (patch) | |
tree | fd1f6274986c3bf259c0dd3a0adaf6c2cfddc1a1 /dev/audit-release/sbt_app_core/src | |
parent | cce77457e00aa5f1f4db3d50454cf257efb156ed (diff) | |
download | spark-b2bdd0e505f1ae3d39c46139f17bd43779ece635.tar.gz spark-b2bdd0e505f1ae3d39c46139f17bd43779ece635.tar.bz2 spark-b2bdd0e505f1ae3d39c46139f17bd43779ece635.zip |
Updated scripts for auditing releases
- Added script to automatically generate change list CHANGES.txt
- Added test for verifying linking against maven distributions of `spark-sql` and `spark-hive`
- Added SBT projects for testing functionality of `spark-sql` and `spark-hive`
- Fixed issues in existing tests that might have come up because of changes in Spark 1.0
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #844 from tdas/update-dev-scripts and squashes the following commits:
25090ba [Tathagata Das] Added missing license
e2e20b3 [Tathagata Das] Updated tests for auditing releases.
Diffstat (limited to 'dev/audit-release/sbt_app_core/src')
-rw-r--r-- | dev/audit-release/sbt_app_core/src/main/scala/SparkApp.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/dev/audit-release/sbt_app_core/src/main/scala/SparkApp.scala b/dev/audit-release/sbt_app_core/src/main/scala/SparkApp.scala index a89b0d7d38..77bbd167b1 100644 --- a/dev/audit-release/sbt_app_core/src/main/scala/SparkApp.scala +++ b/dev/audit-release/sbt_app_core/src/main/scala/SparkApp.scala @@ -19,6 +19,7 @@ package main.scala import scala.util.Try +import org.apache.spark.SparkConf import org.apache.spark.SparkContext import org.apache.spark.SparkContext._ @@ -30,7 +31,6 @@ object SimpleApp { } val logFile = "input.txt" val sc = new SparkContext(conf) - SparkContext.jarOfClass(this.getClass).foreach(sc.addJar) val logData = sc.textFile(logFile, 2).cache() val numAs = logData.filter(line => line.contains("a")).count() val numBs = logData.filter(line => line.contains("b")).count() |