diff options
| author | likun <jacky.likun@huawei.com> | 2014-10-17 10:33:45 -0700 |
|---|---|---|
| committer | Andrew Or <andrewor14@gmail.com> | 2014-10-17 10:33:45 -0700 |
| commit | c351862064ed7d2031ea4c8bf33881e5f702ea0a (patch) | |
| tree | ab4afa5214bfd7cea6865c712836ea9ac4024104 /yarn/common | |
| parent | e678b9f02a2936b35c95e91a5f0ff388b5720261 (diff) | |
| download | spark-c351862064ed7d2031ea4c8bf33881e5f702ea0a.tar.gz spark-c351862064ed7d2031ea4c8bf33881e5f702ea0a.tar.bz2 spark-c351862064ed7d2031ea4c8bf33881e5f702ea0a.zip | |
[SPARK-3935][Core] log the number of records that has been written
There is a unused variable(count) in saveAsHadoopDataset in PairRDDFunctions.scala. The initial idea of this variable seems to count the number of records, so I am adding a log statement to log the number of records that has been written to the writer.
Author: likun <jacky.likun@huawei.com>
Author: jackylk <jacky.likun@huawei.com>
Closes #2791 from jackylk/SPARK-3935 and squashes the following commits:
a874047 [jackylk] removing the unused variable in PairRddFunctions.scala
3bf43c7 [likun] log the number of records has been written
Diffstat (limited to 'yarn/common')
0 files changed, 0 insertions, 0 deletions