diff options
author | Liang-Chi Hsieh <viirya@gmail.com> | 2017-03-01 00:19:57 -0800 |
---|---|---|
committer | Wenchen Fan <wenchen@databricks.com> | 2017-03-01 00:19:57 -0800 |
commit | 38e7835347a2e1803b1df5e73cf8b749951b11b2 (patch) | |
tree | 47bf9b56af726f39cc414714f59d61b72e784780 /mllib | |
parent | 4913c92c2fbfcc22b41afb8ce79687165392d7da (diff) | |
download | spark-38e7835347a2e1803b1df5e73cf8b749951b11b2.tar.gz spark-38e7835347a2e1803b1df5e73cf8b749951b11b2.tar.bz2 spark-38e7835347a2e1803b1df5e73cf8b749951b11b2.zip |
[SPARK-19736][SQL] refreshByPath should clear all cached plans with the specified path
## What changes were proposed in this pull request?
`Catalog.refreshByPath` can refresh the cache entry and the associated metadata for all dataframes (if any), that contain the given data source path.
However, `CacheManager.invalidateCachedPath` doesn't clear all cached plans with the specified path. It causes some strange behaviors reported in SPARK-15678.
## How was this patch tested?
Jenkins tests.
Please review http://spark.apache.org/contributing.html before opening a pull request.
Author: Liang-Chi Hsieh <viirya@gmail.com>
Closes #17064 from viirya/fix-refreshByPath.
Diffstat (limited to 'mllib')
0 files changed, 0 insertions, 0 deletions