diff options
author | Cheng Lian <lian@databricks.com> | 2014-11-27 18:01:14 -0800 |
---|---|---|
committer | Matei Zaharia <matei@databricks.com> | 2014-11-27 18:01:26 -0800 |
commit | 092800435c27c97bf445de934826a1316666dfba (patch) | |
tree | bd261c6aeeccbfa2ab99993584941530798c7a11 /core/src/test/scala | |
parent | bfba8bf602074a346e31917b97a6db205d62df69 (diff) | |
download | spark-092800435c27c97bf445de934826a1316666dfba.tar.gz spark-092800435c27c97bf445de934826a1316666dfba.tar.bz2 spark-092800435c27c97bf445de934826a1316666dfba.zip |
[SPARK-4613][Core] Java API for JdbcRDD
This PR introduces a set of Java APIs for using `JdbcRDD`:
1. Trait (interface) `JdbcRDD.ConnectionFactory`: equivalent to the `getConnection: () => Connection` parameter in `JdbcRDD` constructor.
2. Two overloaded versions of `Jdbc.create`: used to create `JavaRDD` that wraps a `JdbcRDD`.
<!-- Reviewable:start -->
[<img src="https://reviewable.io/review_button.png" height=40 alt="Review on Reviewable"/>](https://reviewable.io/reviews/apache/spark/3478)
<!-- Reviewable:end -->
Author: Cheng Lian <lian@databricks.com>
Closes #3478 from liancheng/japi-jdbc-rdd and squashes the following commits:
9a54625 [Cheng Lian] Only shutdowns a single DB rather than the whole Derby driver
d4cedc5 [Cheng Lian] Moves Java JdbcRDD test case to a separate test suite
ffcdf2e [Cheng Lian] Java API for JdbcRDD
(cherry picked from commit 120a350240f58196eafcb038ca3a353636d89239)
Signed-off-by: Matei Zaharia <matei@databricks.com>
Diffstat (limited to 'core/src/test/scala')
-rw-r--r-- | core/src/test/scala/org/apache/spark/rdd/JdbcRDDSuite.scala | 7 |
1 files changed, 4 insertions, 3 deletions
diff --git a/core/src/test/scala/org/apache/spark/rdd/JdbcRDDSuite.scala b/core/src/test/scala/org/apache/spark/rdd/JdbcRDDSuite.scala index 76e317d754..6138d0bbd5 100644 --- a/core/src/test/scala/org/apache/spark/rdd/JdbcRDDSuite.scala +++ b/core/src/test/scala/org/apache/spark/rdd/JdbcRDDSuite.scala @@ -65,10 +65,11 @@ class JdbcRDDSuite extends FunSuite with BeforeAndAfter with LocalSparkContext { after { try { - DriverManager.getConnection("jdbc:derby:;shutdown=true") + DriverManager.getConnection("jdbc:derby:target/JdbcRDDSuiteDb;shutdown=true") } catch { - case se: SQLException if se.getSQLState == "XJ015" => - // normal shutdown + case se: SQLException if se.getSQLState == "08006" => + // Normal single database shutdown + // https://db.apache.org/derby/docs/10.2/ref/rrefexcept71493.html } } } |