aboutsummaryrefslogtreecommitdiff
path: root/python/pyspark/sql/tests.py
diff options
context:
space:
mode:
authorMarcelo Vanzin <vanzin@cloudera.com>2016-08-15 11:09:54 -0700
committerMarcelo Vanzin <vanzin@cloudera.com>2016-08-15 11:09:54 -0700
commit5da6c4b24f512b63cd4e6ba7dd8968066a9396f5 (patch)
tree7bf18c71a8c55eef6539bc484a73a2e20d97d4e1 /python/pyspark/sql/tests.py
parent564fe614c11deb657e0ac9e6b75e65370c48b7fe (diff)
downloadspark-5da6c4b24f512b63cd4e6ba7dd8968066a9396f5.tar.gz
spark-5da6c4b24f512b63cd4e6ba7dd8968066a9396f5.tar.bz2
spark-5da6c4b24f512b63cd4e6ba7dd8968066a9396f5.zip
[SPARK-16671][CORE][SQL] Consolidate code to do variable substitution.
Both core and sql have slightly different code that does variable substitution of config values. This change refactors that code and encapsulates the logic of reading config values and expading variables in a new helper class, which can be configured so that both core and sql can use it without losing existing functionality, and allows for easier testing and makes it easier to add more features in the future. Tested with existing and new unit tests, and by running spark-shell with some configs referencing variables and making sure it behaved as expected. Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #14468 from vanzin/SPARK-16671.
Diffstat (limited to 'python/pyspark/sql/tests.py')
0 files changed, 0 insertions, 0 deletions