aboutsummaryrefslogtreecommitdiff
path: root/sql/catalyst
Commit message (Collapse)AuthorAgeFilesLines
* Preparing Spark release v1.4.1-rc4v1.4.1Patrick Wendell2015-07-081-1/+1
|
* Preparing development version 1.4.2-SNAPSHOTPatrick Wendell2015-07-061-1/+1
|
* Preparing Spark release v1.4.1-rc3Patrick Wendell2015-07-061-1/+1
|
* Preparing development version 1.4.2-SNAPSHOTPatrick Wendell2015-07-061-1/+1
|
* Preparing Spark release v1.4.1-rc3Patrick Wendell2015-07-061-1/+1
|
* Preparing development version 1.4.2-SNAPSHOTPatrick Wendell2015-07-021-1/+1
|
* Preparing Spark release v1.4.1-rc2Patrick Wendell2015-07-021-1/+1
|
* fix string order for non-ascii characterDavies Liu2015-07-022-1/+7
|
* [SPARK-8621] [SQL] support empty string as column nameWenchen Fan2015-07-011-2/+2
| | | | | | | | | | | | | | improve the empty check in `parseAttributeName` so that we can allow empty string as column name. Close https://github.com/apache/spark/pull/7117 Author: Wenchen Fan <cloud0fan@outlook.com> Closes #7149 from cloud-fan/8621 and squashes the following commits: efa9e3e [Wenchen Fan] support empty string (cherry picked from commit 31b4a3d7f2be9053a041e5ae67418562a93d80d8) Signed-off-by: Reynold Xin <rxin@databricks.com>
* [SPARK-8628] [SQL] Race condition in AbstractSparkSQLParser.parseVinod K C2015-06-302-3/+5
| | | | | | | | | | | | | | | | | Made lexical iniatialization as lazy val Author: Vinod K C <vinod.kc@huawei.com> Closes #7015 from vinodkc/handle_lexical_initialize_schronization and squashes the following commits: b6d1c74 [Vinod K C] Avoided repeated lexical initialization 5863cf7 [Vinod K C] Removed space e27c66c [Vinod K C] Avoid reinitialization of lexical in parse method ef4f60f [Vinod K C] Reverted import order e9fc49a [Vinod K C] handle synchronization in SqlLexical.initialize (cherry picked from commit b8e5bb6fc1553256e950fdad9cb5acc6b296816e) Signed-off-by: Michael Armbrust <michael@databricks.com>
* [SPARK-8710] [SQL] Change ScalaReflection.mirror from a val to a def.Yin Huai2015-06-291-2/+6
| | | | | | | | | | | | | jira: https://issues.apache.org/jira/browse/SPARK-8710 Author: Yin Huai <yhuai@databricks.com> Closes #7094 from yhuai/SPARK-8710 and squashes the following commits: c854baa [Yin Huai] Change ScalaReflection.mirror from a val to a def. (cherry picked from commit 4b497a724a87ef24702c2df9ec6863ee57a87c1c) Signed-off-by: Reynold Xin <rxin@databricks.com>
* [HOTFIX] Fix whitespace style errorMichael Armbrust2015-06-291-2/+1
| | | | | | | | Author: Michael Armbrust <michael@databricks.com> Closes #7102 from marmbrus/fixStyle and squashes the following commits: 8c08124 [Michael Armbrust] [HOTFIX] Fix whitespace style error
* [SQL] [MINOR] Skip unresolved expression for InConversionscwf2015-06-291-0/+3
| | | | | | | | | | | Author: scwf <wangfei1@huawei.com> Closes #6145 from scwf/InConversion and squashes the following commits: 5c8ac6b [scwf] minir fix for InConversion (cherry picked from commit edf09ea1bd4bf7692e0085ad9c70cb1bfc8d06d8) Signed-off-by: Cheng Lian <lian@databricks.com>
* Preparing development version 1.4.2-SNAPSHOTPatrick Wendell2015-06-231-1/+1
|
* Preparing Spark release v1.4.1-rc1Patrick Wendell2015-06-231-1/+1
|
* Preparing development version 1.4.2-SNAPSHOTPatrick Wendell2015-06-221-1/+1
|
* Preparing Spark release v1.4.1-rc1Patrick Wendell2015-06-221-1/+1
|
* [BUILD] Preparing Spark release 1.4.1Patrick Wendell2015-06-221-1/+1
|
* [SPARK-8420] [SQL] Fix comparision of timestamps/dates with strings (branch-1.4)Michael Armbrust2015-06-222-3/+23
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is branch 1.4 backport of https://github.com/apache/spark/pull/6888. Below is the original description. In earlier versions of Spark SQL we casted `TimestampType` and `DataType` to `StringType` when it was involved in a binary comparison with a `StringType`. This allowed comparing a timestamp with a partial date as a user would expect. - `time > "2014-06-10"` - `time > "2014"` In 1.4.0 we tried to cast the String instead into a Timestamp. However, since partial dates are not a valid complete timestamp this results in `null` which results in the tuple being filtered. This PR restores the earlier behavior. Note that we still special case equality so that these comparisons are not affected by not printing zeros for subsecond precision. Author: Michael Armbrust <michaeldatabricks.com> Closes #6888 from marmbrus/timeCompareString and squashes the following commits: bdef29c [Michael Armbrust] test partial date 1f09adf [Michael Armbrust] special handling of equality 1172c60 [Michael Armbrust] more test fixing 4dfc412 [Michael Armbrust] fix tests aaa9508 [Michael Armbrust] newline 04d908f [Michael Armbrust] [SPARK-8420][SQL] Fix comparision of timestamps/dates with strings Conflicts: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala Author: Michael Armbrust <michael@databricks.com> Closes #6914 from yhuai/timeCompareString-1.4 and squashes the following commits: 9882915 [Michael Armbrust] [SPARK-8420] [SQL] Fix comparision of timestamps/dates with strings
* Fix break introduced by backportPunya Biswal2015-06-162-33/+5
| | | | | | | | | | rxin this is the fix you requested for the break introduced by backporting #6793 Author: Punya Biswal <pbiswal@palantir.com> Closes #6850 from punya/feature/fix-backport-break and squashes the following commits: fdc3693 [Punya Biswal] Fix break introduced by backport
* SPARK-8336 Fix NullPointerException with functions.rand()tedyu2015-06-152-1/+38
| | | | | | | | | | | | | | | | | | This PR fixes the problem reported by Justin Yip in the thread 'NullPointerException with functions.rand()' Tested using spark-shell and verified that the following works: sqlContext.createDataFrame(Seq((1,2), (3, 100))).withColumn("index", rand(30)).show() Author: tedyu <yuzhihong@gmail.com> Closes #6793 from tedyu/master and squashes the following commits: 62fd97b [tedyu] Create RandomSuite 750f92c [tedyu] Add test for Rand() with seed a1d66c5 [tedyu] Fix NullPointerException with functions.rand() (cherry picked from commit 1a62d61696a0481508d83a07d19ab3701245ac20) Signed-off-by: Reynold Xin <rxin@databricks.com>
* [SPARK-8358] [SQL] Wait for child resolution when resolving generatorsMichael Armbrust2015-06-141-2/+4
| | | | | | | | | | | | | Author: Michael Armbrust <michael@databricks.com> Closes #6811 from marmbrus/aliasExplodeStar and squashes the following commits: fbd2065 [Michael Armbrust] more style 806a373 [Michael Armbrust] fix style 7cbb530 [Michael Armbrust] [SPARK-8358][SQL] Wait for child resolution when resolving generatorsa (cherry picked from commit 9073a426e444e4bc6efa8608e54e0a986f38a270) Signed-off-by: Michael Armbrust <michael@databricks.com>
* [SPARK-8354] [SQL] Fix off-by-factor-of-8 error when allocating scratch ↵Josh Rosen2015-06-142-16/+16
| | | | | | | | | | | | | | | | | space in UnsafeFixedWidthAggregationMap UnsafeFixedWidthAggregationMap contains an off-by-factor-of-8 error when allocating row conversion scratch space: we take a size requirement, measured in bytes, then allocate a long array of that size. This means that we end up allocating 8x too much conversion space. This patch fixes this by allocating a `byte[]` array instead. This doesn't impose any new limitations on the maximum sizes of UnsafeRows, since UnsafeRowConverter already used integers when calculating the size requirements for rows. Author: Josh Rosen <joshrosen@databricks.com> Closes #6809 from JoshRosen/sql-bytes-vs-words-fix and squashes the following commits: 6520339 [Josh Rosen] Updates to reflect fact that UnsafeRow max size is constrained by max byte[] size (cherry picked from commit ea7fd2ff6454e8d819a39bf49901074e49b5714e) Signed-off-by: Josh Rosen <joshrosen@databricks.com>
* [SPARK-7558] Demarcate tests in unit-tests.log (1.4)Andrew Or2015-06-0319-43/+51
| | | | | | | | | | | | | | | | | | | | | | | | | | | | This includes the following commits: original: 9eb222c hotfix1: 8c99793 hotfix2: a4f2412 scalastyle check: 609c492 --- Original patch #6441 Branch-1.3 patch #6602 Author: Andrew Or <andrew@databricks.com> Closes #6598 from andrewor14/demarcate-tests-1.4 and squashes the following commits: 4c3c566 [Andrew Or] Merge branch 'branch-1.4' of github.com:apache/spark into demarcate-tests-1.4 e217b78 [Andrew Or] [SPARK-7558] Guard against direct uses of FunSuite / FunSuiteLike 46d4361 [Andrew Or] Various whitespace changes (minor) 3d9bf04 [Andrew Or] Make all test suites extend SparkFunSuite instead of FunSuite eaa520e [Andrew Or] Fix tests? b4d93de [Andrew Or] Fix tests 634a777 [Andrew Or] Fix log message a932e8d [Andrew Or] Fix manual things that cannot be covered through automation 8bc355d [Andrew Or] Add core tests as dependencies in all modules 75d361f [Andrew Or] Introduce base abstract class for all test suites
* Preparing development version 1.4.0-SNAPSHOTPatrick Wendell2015-06-021-1/+1
|
* Preparing Spark release v1.4.0-rc4v1.4.0Patrick Wendell2015-06-021-1/+1
|
* Preparing development version 1.4.0-SNAPSHOTPatrick Wendell2015-06-021-1/+1
|
* Preparing Spark release v1.4.0-rc4Patrick Wendell2015-06-021-1/+1
|
* Preparing development version 1.4.0-SNAPSHOTPatrick Wendell2015-06-021-1/+1
|
* Preparing Spark release v1.4.0-rc4Patrick Wendell2015-06-021-1/+1
|
* [HOT-FIX] Add EvaluatedType back to RDGYin Huai2015-06-021-0/+2
| | | | | | | | | | https://github.com/apache/spark/commit/87941ff8c49a6661f22c31aa7b84ac1fce768135 accidentally removed the EvaluatedType. Author: Yin Huai <yhuai@databricks.com> Closes #6589 from yhuai/getBackEvaluatedType and squashes the following commits: 618c2eb [Yin Huai] Add EvaluatedType back.
* Preparing development version 1.4.0-SNAPSHOTPatrick Wendell2015-06-021-1/+1
|
* Preparing Spark release v1.4.0-rc4Patrick Wendell2015-06-021-1/+1
|
* [SPARK-8023][SQL] Add "deterministic" attribute to Expression to avoid ↵Yin Huai2015-06-024-2/+92
| | | | | | | | | | | | | | | | | | | | | | | collapsing nondeterministic projects. This closes #6570. Author: Yin Huai <yhuai@databricks.com> Author: Reynold Xin <rxin@databricks.com> Closes #6573 from rxin/deterministic and squashes the following commits: 356cd22 [Reynold Xin] Added unit test for the optimizer. da3fde1 [Reynold Xin] Merge pull request #6570 from yhuai/SPARK-8023 da56200 [Yin Huai] Comments. e38f264 [Yin Huai] Comment. f9d6a73 [Yin Huai] Add a deterministic method to Expression. (cherry picked from commit 0f80990bfac1e9969644952d1d8edaf7d26fb436) Signed-off-by: Reynold Xin <rxin@databricks.com> Conflicts: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/random.scala
* Fixed typo in the previous commit.Reynold Xin2015-06-011-1/+1
| | | | | (cherry picked from commit b53a0116473a03607c5be3e4135151b4932acc06) Signed-off-by: Reynold Xin <rxin@databricks.com>
* [SPARK-7965] [SPARK-7972] [SQL] Handle expressions containing multiple ↵Yin Huai2015-06-011-27/+81
| | | | | | | | | | | | | | | | | | | | | | | window expressions and make parser match window frames in case insensitive way JIRAs: https://issues.apache.org/jira/browse/SPARK-7965 https://issues.apache.org/jira/browse/SPARK-7972 Author: Yin Huai <yhuai@databricks.com> Closes #6524 from yhuai/7965-7972 and squashes the following commits: c12c79c [Yin Huai] Add doc for returned value. de64328 [Yin Huai] Address rxin's comments. fc9b1ad [Yin Huai] wip 2996da4 [Yin Huai] scala style 20b65b7 [Yin Huai] Handle expressions containing multiple window expressions. 9568b21 [Yin Huai] case insensitive matches 41f633d [Yin Huai] Failed test case. (cherry picked from commit e797dba58e8cafdd30683dd1e0263f00ce30ccc0) Signed-off-by: Reynold Xin <rxin@databricks.com>
* [HOTFIX] Remove trailing whitespace to fix Scalastyle checksJosh Rosen2015-05-312-2/+2
| | | | 866652c903d06d1cb4356283e0741119d84dcc21 enabled this check.
* [SPARK-3850] Trim trailing spaces for SQL.Reynold Xin2015-05-3113-25/+25
| | | | | | | | | | | | | | | | | Author: Reynold Xin <rxin@databricks.com> Closes #6535 from rxin/whitespace-sql and squashes the following commits: de50316 [Reynold Xin] [SPARK-3850] Trim trailing spaces for SQL. (cherry picked from commit 63a50be13d32b9e5f3aad8d1a6ba5362f17a252f) Signed-off-by: Reynold Xin <rxin@databricks.com> Conflicts: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala sql/catalyst/src/main/scala/org/apache/spark/sql/types/StructType.scala sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeSuite.scala sql/core/src/test/scala/org/apache/spark/sql/DataFrameStatSuite.scala
* [SPARK-7971] Add JavaDoc style deprecation for deprecated DataFrame methodsReynold Xin2015-05-301-0/+3
| | | | | | | | | | | | | Scala deprecated annotation actually doesn't show up in JavaDoc. Author: Reynold Xin <rxin@databricks.com> Closes #6523 from rxin/df-deprecated-javadoc and squashes the following commits: 26da2b2 [Reynold Xin] [SPARK-7971] Add JavaDoc style deprecation for deprecated DataFrame methods. (cherry picked from commit c63e1a742b3e87e79a4466e9bd0b927a24645756) Signed-off-by: Reynold Xin <rxin@databricks.com>
* [SQL] Tighten up visibility for JavaDoc.Reynold Xin2015-05-303-7/+7
| | | | | | | | | | | | | I went through all the JavaDocs and tightened up visibility. Author: Reynold Xin <rxin@databricks.com> Closes #6526 from rxin/sql-1.4-visibility-for-docs and squashes the following commits: bc37d1e [Reynold Xin] Tighten up visibility for JavaDoc. (cherry picked from commit 14b314dc2cad7bbf23976347217c676d338e0a2d) Signed-off-by: Reynold Xin <rxin@databricks.com>
* [SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH, ↵Reynold Xin2015-05-291-1/+1
| | | | | | | | | | | | | | | LARROW, RARROW in style checker. … Author: Reynold Xin <rxin@databricks.com> Closes #6491 from rxin/more-whitespace and squashes the following commits: f6e63dc [Reynold Xin] [SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH, LARROW, RARROW in style checker. (cherry picked from commit 94f62a4979e4bc5f7bf4f5852d76977e097209e6) Signed-off-by: Reynold Xin <rxin@databricks.com>
* Preparing development version 1.4.0-SNAPSHOTPatrick Wendell2015-05-291-1/+1
|
* Preparing Spark release v1.4.0-rc3Patrick Wendell2015-05-291-1/+1
|
* Preparing development version 1.4.0-SNAPSHOTPatrick Wendell2015-05-291-1/+1
|
* Preparing Spark release v1.4.0-rc3Patrick Wendell2015-05-291-1/+1
|
* HOTFIX: Scala style checker for DataTypeSuite.scala.Reynold Xin2015-05-291-1/+1
|
* Preparing development version 1.4.0-SNAPSHOTPatrick Wendell2015-05-281-1/+1
|
* Preparing Spark release v1.4.0-rc3Patrick Wendell2015-05-281-1/+1
|
* Preparing development version 1.4.0-SNAPSHOTPatrick Wendell2015-05-281-1/+1
|
* Preparing Spark release v1.4.0-rc3Patrick Wendell2015-05-281-1/+1
|
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-21 23:07:25 +0000