diff options
author | Shixiong Zhu <shixiong@databricks.com> | 2016-04-12 10:46:28 -0700 |
---|---|---|
committer | Michael Armbrust <michael@databricks.com> | 2016-04-12 10:46:28 -0700 |
commit | 6bf692147c21dd74e91e2bd95845f11ef0a303e6 (patch) | |
tree | fb7cf4acded554c3a57807296b011120f54667f6 /mllib | |
parent | da60b34d2f6eba19633e4f1b46504ce92cd6c179 (diff) | |
download | spark-6bf692147c21dd74e91e2bd95845f11ef0a303e6.tar.gz spark-6bf692147c21dd74e91e2bd95845f11ef0a303e6.tar.bz2 spark-6bf692147c21dd74e91e2bd95845f11ef0a303e6.zip |
[SPARK-14474][SQL] Move FileSource offset log into checkpointLocation
## What changes were proposed in this pull request?
Now that we have a single location for storing checkpointed state. This PR just propagates the checkpoint location into FileStreamSource so that we don't have one random log off on its own.
## How was this patch tested?
test("metadataPath should be in checkpointLocation")
Author: Shixiong Zhu <shixiong@databricks.com>
Closes #12247 from zsxwing/file-source-log-location.
Diffstat (limited to 'mllib')
0 files changed, 0 insertions, 0 deletions