aboutsummaryrefslogtreecommitdiff
path: root/sql/core/src/test/resources/sql-tests/results/show_columns.sql.out
diff options
context:
space:
mode:
authorhyukjinkwon <gurwls223@gmail.com>2017-01-23 12:23:12 +0800
committerWenchen Fan <wenchen@databricks.com>2017-01-23 12:23:12 +0800
commit74e65cb74a8c023870a2ac9b1216c9d89c02f014 (patch)
treec3cde098d50b9b25459277272cf72772d5faf951 /sql/core/src/test/resources/sql-tests/results/show_columns.sql.out
parent0c589e3713655f25547d6945a40786da900ec2fc (diff)
downloadspark-74e65cb74a8c023870a2ac9b1216c9d89c02f014.tar.gz
spark-74e65cb74a8c023870a2ac9b1216c9d89c02f014.tar.bz2
spark-74e65cb74a8c023870a2ac9b1216c9d89c02f014.zip
[SPARK-16101][SQL] Refactoring CSV read path to be consistent with JSON data source
## What changes were proposed in this pull request? This PR refactors CSV read path to be consistent with JSON data source. It makes the methods in classes have consistent arguments with JSON ones. `UnivocityParser` and `JacksonParser` ``` scala private[csv] class UnivocityParser( schema: StructType, requiredSchema: StructType, options: CSVOptions) extends Logging { ... def parse(input: String): Seq[InternalRow] = { ... ``` ``` scala class JacksonParser( schema: StructType, columnNameOfCorruptRecord: String, options: JSONOptions) extends Logging { ... def parse(input: String): Option[InternalRow] = { ... ``` These allow parsing an iterator (`String` to `InternalRow`) as below for both JSON and CSV: ```scala iter.flatMap(parser.parse) ``` ## How was this patch tested? Existing tests should cover this. Author: hyukjinkwon <gurwls223@gmail.com> Closes #16669 from HyukjinKwon/SPARK-16101-read.
Diffstat (limited to 'sql/core/src/test/resources/sql-tests/results/show_columns.sql.out')
0 files changed, 0 insertions, 0 deletions