diff options
| author | Eric Liang <ekl@databricks.com> | 2016-06-11 23:16:21 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-06-11 23:16:21 -0700 |
| commit | e1f986c7a3fcc3864d53ef99ef7f14fa4d262ac3 (patch) | |
| tree | f1295516a2696cfe16f8706e57ee4cb75169e22c /python/pyspark/sql/readwriter.py | |
| parent | 3fd2ff4dd85633af49865456a52bf0c09c99708b (diff) | |
| download | spark-e1f986c7a3fcc3864d53ef99ef7f14fa4d262ac3.tar.gz spark-e1f986c7a3fcc3864d53ef99ef7f14fa4d262ac3.tar.bz2 spark-e1f986c7a3fcc3864d53ef99ef7f14fa4d262ac3.zip | |
[SPARK-15860] Metrics for codegen size and perf
## What changes were proposed in this pull request?
Adds codahale metrics for the codegen source text size and how long it takes to compile. The size is particularly interesting, since the JVM does have hard limits on how large methods can get.
To simplify, I added the metrics under a statically-initialized source that is always registered with SparkEnv.
## How was this patch tested?
Unit tests
Author: Eric Liang <ekl@databricks.com>
Closes #13586 from ericl/spark-15860.
Diffstat (limited to 'python/pyspark/sql/readwriter.py')
0 files changed, 0 insertions, 0 deletions