diff options
author | Michael Armbrust <michael@databricks.com> | 2014-03-31 15:23:46 -0700 |
---|---|---|
committer | Reynold Xin <rxin@apache.org> | 2014-03-31 15:23:46 -0700 |
commit | 5731af5be65ccac831445f351baf040a0d007687 (patch) | |
tree | 992d6369f4311802eb8f33993997e6c757fea85a /sql/hive/src/main | |
parent | 841721e03cc44ee7d8fe72c882db8c0f9f3af365 (diff) | |
download | spark-5731af5be65ccac831445f351baf040a0d007687.tar.gz spark-5731af5be65ccac831445f351baf040a0d007687.tar.bz2 spark-5731af5be65ccac831445f351baf040a0d007687.zip |
[SQL] Rewrite join implementation to allow streaming of one relation.
Before we were materializing everything in memory. This also uses the projection interface so will be easier to plug in code gen (its ported from that branch).
@rxin @liancheng
Author: Michael Armbrust <michael@databricks.com>
Closes #250 from marmbrus/hashJoin and squashes the following commits:
1ad873e [Michael Armbrust] Change hasNext logic back to the correct version.
8e6f2a2 [Michael Armbrust] Review comments.
1e9fb63 [Michael Armbrust] style
bc0cb84 [Michael Armbrust] Rewrite join implementation to allow streaming of one relation.
Diffstat (limited to 'sql/hive/src/main')
-rw-r--r-- | sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala index fc5057b73f..197b557cba 100644 --- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala +++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala @@ -194,7 +194,7 @@ class HiveContext(sc: SparkContext) extends SQLContext(sc) { DataSinks, Scripts, PartialAggregation, - SparkEquiInnerJoin, + HashJoin, BasicOperators, CartesianProduct, BroadcastNestedLoopJoin |