aboutsummaryrefslogtreecommitdiff
path: root/assembly
diff options
context:
space:
mode:
authorReynold Xin <rxin@apache.org>2014-08-20 15:37:27 -0700
committerPatrick Wendell <pwendell@gmail.com>2014-08-20 16:18:32 -0700
commitdc05282bafce8e11de35d7d2f489a8b50a91661d (patch)
tree3a3f23e219e0a83c61a836557895a0ab4bff4072 /assembly
parent2c1683efeabe461744509548341b8f93d8b22558 (diff)
downloadspark-dc05282bafce8e11de35d7d2f489a8b50a91661d.tar.gz
spark-dc05282bafce8e11de35d7d2f489a8b50a91661d.tar.bz2
spark-dc05282bafce8e11de35d7d2f489a8b50a91661d.zip
[SPARK-2298] Encode stage attempt in SparkListener & UI.
Simple way to reproduce this in the UI: ```scala val f = new java.io.File("/tmp/test") f.delete() sc.parallelize(1 to 2, 2).map(x => (x,x )).repartition(3).mapPartitionsWithContext { case (context, iter) => if (context.partitionId == 0) { val f = new java.io.File("/tmp/test") if (!f.exists) { f.mkdir() System.exit(0); } } iter }.count() ``` Author: Reynold Xin <rxin@apache.org> Closes #1545 from rxin/stage-attempt and squashes the following commits: 3ee1d2a [Reynold Xin] - Rename attempt to retry in UI. - Properly report stage failure in FetchFailed. 40a6bd5 [Reynold Xin] Updated test suites. c414c36 [Reynold Xin] Fixed the hanging in JobCancellationSuite. b3e2eed [Reynold Xin] Oops previous code didn't compile. 0f36075 [Reynold Xin] Mark unknown stage attempt with id -1 and drop that in JobProgressListener. 6c08b07 [Reynold Xin] Addressed code review feedback. 4e5faa2 [Reynold Xin] [SPARK-2298] Encode stage attempt in SparkListener & UI.
Diffstat (limited to 'assembly')
0 files changed, 0 insertions, 0 deletions