diff options
| author | Michael Armbrust <michael@databricks.com> | 2014-06-09 14:24:19 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2014-06-09 14:24:52 -0700 |
| commit | 65fa7bcac81fc2a7a6c578775f72929cb201c20a (patch) | |
| tree | 8045a1f6951d048dac0b37c6632fbee497002b98 /sql/catalyst | |
| parent | 73cd1f8223a4799fd104fe48ba011315236cf4a8 (diff) | |
| download | spark-65fa7bcac81fc2a7a6c578775f72929cb201c20a.tar.gz spark-65fa7bcac81fc2a7a6c578775f72929cb201c20a.tar.bz2 spark-65fa7bcac81fc2a7a6c578775f72929cb201c20a.zip | |
[SQL] Simple framework for debugging query execution
Only records number of tuples and unique dataTypes output right now...
Example:
```scala
scala> import org.apache.spark.sql.execution.debug._
scala> hql("SELECT value FROM src WHERE key > 10").debug(sparkContext)
Results returned: 489
== Project [value#1:0] ==
Tuples output: 489
value StringType: {java.lang.String}
== Filter (key#0:1 > 10) ==
Tuples output: 489
value StringType: {java.lang.String}
key IntegerType: {java.lang.Integer}
== HiveTableScan [value#1,key#0], (MetastoreRelation default, src, None), None ==
Tuples output: 500
value StringType: {java.lang.String}
key IntegerType: {java.lang.Integer}
```
Author: Michael Armbrust <michael@databricks.com>
Closes #1005 from marmbrus/debug and squashes the following commits:
dcc3ca6 [Michael Armbrust] Add comments.
c9dded2 [Michael Armbrust] Simple framework for debugging query execution
(cherry picked from commit c6e041d171e3d9882ab15e2bd7a7217dc19647f6)
Signed-off-by: Reynold Xin <rxin@apache.org>
Diffstat (limited to 'sql/catalyst')
0 files changed, 0 insertions, 0 deletions