diff options
| author | Matthew Taylor <matthew.t@tbfe.net> | 2014-11-07 12:53:08 -0800 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2014-11-07 12:53:32 -0800 |
| commit | c96da3676c32579d0f97347d35d95353b1d2ef07 (patch) | |
| tree | 52970f211187b459ac1dd67abc024467896ffced /sql/hive-thriftserver/src | |
| parent | 684d1f0ecd77d639557b4ca3c26ced950c9ab9fc (diff) | |
| download | spark-c96da3676c32579d0f97347d35d95353b1d2ef07.tar.gz spark-c96da3676c32579d0f97347d35d95353b1d2ef07.tar.bz2 spark-c96da3676c32579d0f97347d35d95353b1d2ef07.zip | |
[SPARK-4203][SQL] Partition directories in random order when inserting into hive table
When doing an insert into hive table with partitions the folders written to the file system are in a random order instead of the order defined in table creation. Seems that the loadPartition method in Hive.java has a Map<String,String> parameter but expects to be called with a map that has a defined ordering such as LinkedHashMap. Working on a test but having intillij problems
Author: Matthew Taylor <matthew.t@tbfe.net>
Closes #3076 from tbfenet/partition_dir_order_problem and squashes the following commits:
f1b9a52 [Matthew Taylor] Comment format fix
bca709f [Matthew Taylor] review changes
0e50f6b [Matthew Taylor] test fix
99f1a31 [Matthew Taylor] partition ordering fix
369e618 [Matthew Taylor] partition ordering fix
(cherry picked from commit ac70c972a51952f801fd02dd5962c0a0c1aba8f8)
Signed-off-by: Michael Armbrust <michael@databricks.com>
Diffstat (limited to 'sql/hive-thriftserver/src')
0 files changed, 0 insertions, 0 deletions