diff options
| author | John Muller <jmuller@us.imshealth.com> | 2016-09-15 10:00:28 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2016-09-15 10:00:28 +0100 |
| commit | 71a65825c5d5d0886ac3e11f9945cfcb39573ac3 (patch) | |
| tree | 0f6c2cad75057165a1a0ef6ce578425dc7fca0e3 /sql/core | |
| parent | ad79fc0a8407a950a03869f2f8cdc3ed0bf13875 (diff) | |
| download | spark-71a65825c5d5d0886ac3e11f9945cfcb39573ac3.tar.gz spark-71a65825c5d5d0886ac3e11f9945cfcb39573ac3.tar.bz2 spark-71a65825c5d5d0886ac3e11f9945cfcb39573ac3.zip | |
[SPARK-17536][SQL] Minor performance improvement to JDBC batch inserts
## What changes were proposed in this pull request?
Optimize a while loop during batch inserts
## How was this patch tested?
Unit tests were done, specifically "mvn test" for sql
Author: John Muller <jmuller@us.imshealth.com>
Closes #15098 from blue666man/SPARK-17536.
Diffstat (limited to 'sql/core')
| -rw-r--r-- | sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala b/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala index 132472ad0c..b09fd511a9 100644 --- a/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala +++ b/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala @@ -590,12 +590,12 @@ object JdbcUtils extends Logging { val stmt = insertStatement(conn, table, rddSchema, dialect) val setters: Array[JDBCValueSetter] = rddSchema.fields.map(_.dataType) .map(makeSetter(conn, dialect, _)).toArray + val numFields = rddSchema.fields.length try { var rowCount = 0 while (iterator.hasNext) { val row = iterator.next() - val numFields = rddSchema.fields.length var i = 0 while (i < numFields) { if (row.isNullAt(i)) { |