diff options
| author | Tim Ellison <t.p.ellison@gmail.com> | 2015-05-13 21:01:42 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-05-13 21:01:42 +0100 |
| commit | 3cd9ad2406c59cd0ede6c9c8428a4ce4b805f8fa (patch) | |
| tree | abe07183c9d136f9cb7d7c7240f897c9215e1190 /python/pyspark/ml/feature.py | |
| parent | e676fc0c6326f3ddeced87214cc88534ea646473 (diff) | |
| download | spark-3cd9ad2406c59cd0ede6c9c8428a4ce4b805f8fa.tar.gz spark-3cd9ad2406c59cd0ede6c9c8428a4ce4b805f8fa.tar.bz2 spark-3cd9ad2406c59cd0ede6c9c8428a4ce4b805f8fa.zip | |
[MINOR] Enhance SizeEstimator to detect IBM compressed refs and s390 …
…arch.
- zSeries 64-bit Java reports its architecture as s390x, so enhance the 64-bit check to accommodate that value.
- SizeEstimator can detect whether IBM Java is using compressed object pointers using info in the "java.vm.info" property, so will do a better job than failing on the HotSpot MBean and guessing.
Author: Tim Ellison <t.p.ellison@gmail.com>
Closes #6085 from tellison/SizeEstimator and squashes the following commits:
1b6ff6a [Tim Ellison] Merge branch 'master' of https://github.com/apache/spark into SizeEstimator
0968989 [Tim Ellison] [MINOR] Enhance SizeEstimator to detect IBM compressed refs and s390 arch.
Diffstat (limited to 'python/pyspark/ml/feature.py')
0 files changed, 0 insertions, 0 deletions