diff options
author | Cheng Lian <lian@databricks.com> | 2015-04-01 21:34:45 +0800 |
---|---|---|
committer | Cheng Lian <lian@databricks.com> | 2015-04-01 21:34:45 +0800 |
commit | d36c5fca7b9227c4c6e1b0c1455269b5fd8d4852 (patch) | |
tree | b9c314ba0fcad297ebe1b3ff0ccaefd6222ecbb8 /streaming | |
parent | 0358b08db85b3ee4ae70834626e7a42311bcc635 (diff) | |
download | spark-d36c5fca7b9227c4c6e1b0c1455269b5fd8d4852.tar.gz spark-d36c5fca7b9227c4c6e1b0c1455269b5fd8d4852.tar.bz2 spark-d36c5fca7b9227c4c6e1b0c1455269b5fd8d4852.zip |
[SPARK-6608] [SQL] Makes DataFrame.rdd a lazy val
Before 1.3.0, `SchemaRDD.id` works as a unique identifier of each `SchemaRDD`. In 1.3.0, unlike `SchemaRDD`, `DataFrame` is no longer an RDD, and `DataFrame.rdd` is actually a function which always returns a new RDD instance. Making `DataFrame.rdd` a lazy val should bring the unique identifier back.
<!-- Reviewable:start -->
[<img src="https://reviewable.io/review_button.png" height=40 alt="Review on Reviewable"/>](https://reviewable.io/reviews/apache/spark/5265)
<!-- Reviewable:end -->
Author: Cheng Lian <lian@databricks.com>
Closes #5265 from liancheng/spark-6608 and squashes the following commits:
7500968 [Cheng Lian] Updates javadoc
7f37d21 [Cheng Lian] Makes DataFrame.rdd a lazy val
Diffstat (limited to 'streaming')
0 files changed, 0 insertions, 0 deletions