diff options
| author | Tathagata Das <tathagata.das1565@gmail.com> | 2016-12-28 12:11:25 -0800 |
|---|---|---|
| committer | Shixiong Zhu <shixiong@databricks.com> | 2016-12-28 12:11:25 -0800 |
| commit | 092c6725bf039bf33299b53791e1958c4ea3f6aa (patch) | |
| tree | 88c1d8529183b7081b58d0102882eed4bb327a86 /sql/core | |
| parent | 6a475ae466a7ce28d507244bf6db91be06ed81ef (diff) | |
| download | spark-092c6725bf039bf33299b53791e1958c4ea3f6aa.tar.gz spark-092c6725bf039bf33299b53791e1958c4ea3f6aa.tar.bz2 spark-092c6725bf039bf33299b53791e1958c4ea3f6aa.zip | |
[SPARK-18669][SS][DOCS] Update Apache docs for Structured Streaming regarding watermarking and status
## What changes were proposed in this pull request?
- Extended the Window operation section with code snippet and explanation of watermarking
- Extended the Output Mode section with a table showing the compatibility between query type and output mode
- Rewrote the Monitoring section with updated jsons generated by StreamingQuery.progress/status
- Updated API changes in the StreamingQueryListener example
TODO
- [x] Figure showing the watermarking
## How was this patch tested?
N/A
## Screenshots
### Section: Windowed Aggregation with Event Time
<img width="927" alt="screen shot 2016-12-15 at 3 33 10 pm" src="https://cloud.githubusercontent.com/assets/663212/21246197/0e02cb1a-c2dc-11e6-8816-0cd28d8201d7.png">
<img width="929" alt="screen shot 2016-12-15 at 3 33 46 pm" src="https://cloud.githubusercontent.com/assets/663212/21246202/1652cefa-c2dc-11e6-8c64-3c05977fb3fc.png">
----------------------------
### Section: Output Modes
----------------------------
### Section: Monitoring
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #16294 from tdas/SPARK-18669.
Diffstat (limited to 'sql/core')
0 files changed, 0 insertions, 0 deletions