diff options
| author | jayadevanmurali <jayadevan.m@tcs.com> | 2017-01-19 20:07:52 +0800 |
|---|---|---|
| committer | Wenchen Fan <wenchen@databricks.com> | 2017-01-19 20:07:52 +0800 |
| commit | 064fadd2a25d1c118e062e505a0ed56be31bdf34 (patch) | |
| tree | 9e60454632a67dfd1b70fdc00d857ffeaae2afa9 /core/src/main | |
| parent | 8ccca9170f983f74a7482f67206dae070c77b419 (diff) | |
| download | spark-064fadd2a25d1c118e062e505a0ed56be31bdf34.tar.gz spark-064fadd2a25d1c118e062e505a0ed56be31bdf34.tar.bz2 spark-064fadd2a25d1c118e062e505a0ed56be31bdf34.zip | |
[SPARK-19059][SQL] Unable to retrieve data from parquet table whose name startswith underscore
## What changes were proposed in this pull request?
The initial shouldFilterOut() method invocation filter the root path name(table name in the intial call) and remove if it contains _. I moved the check one level below, so it first list files/directories in the given root path and then apply filter.
(Please fill in changes proposed in this fix)
## How was this patch tested?
Added new test case for this scenario
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)
Please review http://spark.apache.org/contributing.html before opening a pull request.
Author: jayadevanmurali <jayadevan.m@tcs.com>
Author: jayadevan <jayadevan.m@tcs.com>
Closes #16635 from jayadevanmurali/branch-0.1-SPARK-19059.
Diffstat (limited to 'core/src/main')
0 files changed, 0 insertions, 0 deletions