diff options
author | Davies Liu <davies@databricks.com> | 2016-02-09 16:41:21 -0800 |
---|---|---|
committer | Davies Liu <davies.liu@gmail.com> | 2016-02-09 16:41:21 -0800 |
commit | 0e5ebac3c1f1ff58f938be59c7c9e604977d269c (patch) | |
tree | 6a572ee7aa4f79f285a78a083dc69eef87627be0 /project | |
parent | fae830d15846f7ffdfe49eeb45e175a3cdd2c670 (diff) | |
download | spark-0e5ebac3c1f1ff58f938be59c7c9e604977d269c.tar.gz spark-0e5ebac3c1f1ff58f938be59c7c9e604977d269c.tar.bz2 spark-0e5ebac3c1f1ff58f938be59c7c9e604977d269c.zip |
[SPARK-12950] [SQL] Improve lookup of BytesToBytesMap in aggregate
This PR improve the lookup of BytesToBytesMap by:
1. Generate code for calculate the hash code of grouping keys.
2. Do not use MemoryLocation, fetch the baseObject and offset for key and value directly (remove the indirection).
Author: Davies Liu <davies@databricks.com>
Closes #11010 from davies/gen_map.
Diffstat (limited to 'project')
-rw-r--r-- | project/MimaExcludes.scala | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 9209094385..133894704b 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -40,6 +40,7 @@ object MimaExcludes { excludePackage("org.apache.spark.rpc"), excludePackage("org.spark-project.jetty"), excludePackage("org.apache.spark.unused"), + excludePackage("org.apache.spark.unsafe"), excludePackage("org.apache.spark.util.collection.unsafe"), excludePackage("org.apache.spark.sql.catalyst"), excludePackage("org.apache.spark.sql.execution"), |