diff options
| author | Herman van Hovell <hvanhovell@questtec.nl> | 2016-01-31 13:56:13 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-01-31 13:56:13 -0800 |
| commit | 5a8b978fabb60aa178274f86432c63680c8b351a (patch) | |
| tree | dd3de9b6cd79870813ccc8ca898da182f2bd881b /graphx | |
| parent | 0e6d92d042b0a2920d8df5959d5913ba0166a678 (diff) | |
| download | spark-5a8b978fabb60aa178274f86432c63680c8b351a.tar.gz spark-5a8b978fabb60aa178274f86432c63680c8b351a.tar.bz2 spark-5a8b978fabb60aa178274f86432c63680c8b351a.zip | |
[SPARK-13049] Add First/last with ignore nulls to functions.scala
This PR adds the ability to specify the ```ignoreNulls``` option to the functions dsl, e.g:
```df.select($"id", last($"value", ignoreNulls = true).over(Window.partitionBy($"id").orderBy($"other"))```
This PR is some where between a bug fix (see the JIRA) and a new feature. I am not sure if we should backport to 1.6.
cc yhuai
Author: Herman van Hovell <hvanhovell@questtec.nl>
Closes #10957 from hvanhovell/SPARK-13049.
Diffstat (limited to 'graphx')
0 files changed, 0 insertions, 0 deletions