diff options
| author | Sital Kedia <skedia@fb.com> | 2016-10-02 15:47:36 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-10-02 15:47:36 -0700 |
| commit | f8d7fade4b9a78ae87b6012e3d6f71eef3032b22 (patch) | |
| tree | 02d94ff639ac9a24b8ac6f1b2a5b082b068d09de /sbin | |
| parent | b88cb63da39786c07cb4bfa70afed32ec5eb3286 (diff) | |
| download | spark-f8d7fade4b9a78ae87b6012e3d6f71eef3032b22.tar.gz spark-f8d7fade4b9a78ae87b6012e3d6f71eef3032b22.tar.bz2 spark-f8d7fade4b9a78ae87b6012e3d6f71eef3032b22.zip | |
[SPARK-17509][SQL] When wrapping catalyst datatype to Hive data type avoid…
## What changes were proposed in this pull request?
When wrapping catalyst datatypes to Hive data type, wrap function was doing an expensive pattern matching which was consuming around 11% of cpu time. Avoid the pattern matching by returning the wrapper only once and reuse it.
## How was this patch tested?
Tested by running the job on cluster and saw around 8% cpu improvements.
Author: Sital Kedia <skedia@fb.com>
Closes #15064 from sitalkedia/skedia/hive_wrapper.
Diffstat (limited to 'sbin')
0 files changed, 0 insertions, 0 deletions