diff options
author | Tathagata Das <tathagata.das1565@gmail.com> | 2016-12-28 12:11:25 -0800 |
---|---|---|
committer | Shixiong Zhu <shixiong@databricks.com> | 2016-12-28 12:11:25 -0800 |
commit | 092c6725bf039bf33299b53791e1958c4ea3f6aa (patch) | |
tree | 88c1d8529183b7081b58d0102882eed4bb327a86 /docs/img | |
parent | 6a475ae466a7ce28d507244bf6db91be06ed81ef (diff) | |
download | spark-092c6725bf039bf33299b53791e1958c4ea3f6aa.tar.gz spark-092c6725bf039bf33299b53791e1958c4ea3f6aa.tar.bz2 spark-092c6725bf039bf33299b53791e1958c4ea3f6aa.zip |
[SPARK-18669][SS][DOCS] Update Apache docs for Structured Streaming regarding watermarking and status
## What changes were proposed in this pull request?
- Extended the Window operation section with code snippet and explanation of watermarking
- Extended the Output Mode section with a table showing the compatibility between query type and output mode
- Rewrote the Monitoring section with updated jsons generated by StreamingQuery.progress/status
- Updated API changes in the StreamingQueryListener example
TODO
- [x] Figure showing the watermarking
## How was this patch tested?
N/A
## Screenshots
### Section: Windowed Aggregation with Event Time
<img width="927" alt="screen shot 2016-12-15 at 3 33 10 pm" src="https://cloud.githubusercontent.com/assets/663212/21246197/0e02cb1a-c2dc-11e6-8816-0cd28d8201d7.png">
![image](https://cloud.githubusercontent.com/assets/663212/21246241/45b0f87a-c2dc-11e6-9c29-d0a89e07bf8d.png)
<img width="929" alt="screen shot 2016-12-15 at 3 33 46 pm" src="https://cloud.githubusercontent.com/assets/663212/21246202/1652cefa-c2dc-11e6-8c64-3c05977fb3fc.png">
----------------------------
### Section: Output Modes
![image](https://cloud.githubusercontent.com/assets/663212/21246276/8ee44948-c2dc-11e6-9fa2-30502fcf9a55.png)
----------------------------
### Section: Monitoring
![image](https://cloud.githubusercontent.com/assets/663212/21246535/3c5baeb2-c2de-11e6-88cd-ca71db7c5cf9.png)
![image](https://cloud.githubusercontent.com/assets/663212/21246574/789492c2-c2de-11e6-8471-7bef884e1837.png)
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #16294 from tdas/SPARK-18669.
Diffstat (limited to 'docs/img')
-rw-r--r-- | docs/img/structured-streaming-watermark.png | bin | 0 -> 252000 bytes |
-rw-r--r-- | docs/img/structured-streaming.pptx | bin | 1105413 -> 1113902 bytes |
2 files changed, 0 insertions, 0 deletions
diff --git a/docs/img/structured-streaming-watermark.png b/docs/img/structured-streaming-watermark.png Binary files differnew file mode 100644 index 0000000000..f21fbda171 --- /dev/null +++ b/docs/img/structured-streaming-watermark.png diff --git a/docs/img/structured-streaming.pptx b/docs/img/structured-streaming.pptx Binary files differindex 6aad2ed33e..f5bdfc078c 100644 --- a/docs/img/structured-streaming.pptx +++ b/docs/img/structured-streaming.pptx |