diff options
| author | Wenchen Fan <wenchen@databricks.com> | 2016-05-24 21:23:39 -0700 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2016-05-24 21:23:39 -0700 |
| commit | 50b660d725269dc0c11e0d350ddd7fc8b19539a0 (patch) | |
| tree | 6cbf51ce284def719bd30f4f90d086e9693de2c1 /external/kafka-0-8 | |
| parent | 4acababcaba567c85f3be0d5e939d99119b82d1d (diff) | |
| download | spark-50b660d725269dc0c11e0d350ddd7fc8b19539a0.tar.gz spark-50b660d725269dc0c11e0d350ddd7fc8b19539a0.tar.bz2 spark-50b660d725269dc0c11e0d350ddd7fc8b19539a0.zip | |
[SPARK-15498][TESTS] fix slow tests
## What changes were proposed in this pull request?
This PR fixes 3 slow tests:
1. `ParquetQuerySuite.read/write wide table`: This is not a good unit test as it runs more than 5 minutes. This PR removes it and add a new regression test in `CodeGenerationSuite`, which is more "unit".
2. `ParquetQuerySuite.returning batch for wide table`: reduce the threshold and use smaller data size.
3. `DatasetSuite.SPARK-14554: Dataset.map may generate wrong java code for wide table`: Improve `CodeFormatter.format`(introduced at https://github.com/apache/spark/pull/12979) can dramatically speed this it up.
## How was this patch tested?
N/A
Author: Wenchen Fan <wenchen@databricks.com>
Closes #13273 from cloud-fan/test.
Diffstat (limited to 'external/kafka-0-8')
0 files changed, 0 insertions, 0 deletions