diff options
author | Xiangrui Meng <meng@databricks.com> | 2014-04-11 12:06:13 -0700 |
---|---|---|
committer | Matei Zaharia <matei@databricks.com> | 2014-04-11 12:06:36 -0700 |
commit | e6128b50988da88cf6a01b42d8e535800080335f (patch) | |
tree | 1334000b3dd48487a7d4d989e178a1fa93827073 /.rat-excludes | |
parent | 170b09d943018cd62586e8f851c5d9dce665c767 (diff) | |
download | spark-e6128b50988da88cf6a01b42d8e535800080335f.tar.gz spark-e6128b50988da88cf6a01b42d8e535800080335f.tar.bz2 spark-e6128b50988da88cf6a01b42d8e535800080335f.zip |
[SPARK-1225, 1241] [MLLIB] Add AreaUnderCurve and BinaryClassificationMetrics
This PR implements a generic version of `AreaUnderCurve` using the `RDD.sliding` implementation from https://github.com/apache/spark/pull/136 . It also contains refactoring of https://github.com/apache/spark/pull/160 for binary classification evaluation.
Author: Xiangrui Meng <meng@databricks.com>
Closes #364 from mengxr/auc and squashes the following commits:
a05941d [Xiangrui Meng] replace TP/FP/TN/FN by their full names
3f42e98 [Xiangrui Meng] add (0, 0), (1, 1) to roc, and (0, 1) to pr
fb4b6d2 [Xiangrui Meng] rename Evaluator to Metrics and add more metrics
b1b7dab [Xiangrui Meng] fix code styles
9dc3518 [Xiangrui Meng] add tests for BinaryClassificationEvaluator
ca31da5 [Xiangrui Meng] remove PredictionAndResponse
3d71525 [Xiangrui Meng] move binary evalution classes to evaluation.binary
8f78958 [Xiangrui Meng] add PredictionAndResponse
dda82d5 [Xiangrui Meng] add confusion matrix
aa7e278 [Xiangrui Meng] add initial version of binary classification evaluator
221ebce [Xiangrui Meng] add a new test to sliding
a920865 [Xiangrui Meng] Merge branch 'sliding' into auc
a9b250a [Xiangrui Meng] move sliding to mllib
cab9a52 [Xiangrui Meng] use last for the last element
db6cb30 [Xiangrui Meng] remove unnecessary toSeq
9916202 [Xiangrui Meng] change RDD.sliding return type to RDD[Seq[T]]
284d991 [Xiangrui Meng] change SlidedRDD to SlidingRDD
c1c6c22 [Xiangrui Meng] add AreaUnderCurve
65461b2 [Xiangrui Meng] Merge branch 'sliding' into auc
5ee6001 [Xiangrui Meng] add TODO
d2a600d [Xiangrui Meng] add sliding to rdd
(cherry picked from commit f5ace8da34c58d1005c7c377cfe3df21102c1dd6)
Signed-off-by: Matei Zaharia <matei@databricks.com>
Diffstat (limited to '.rat-excludes')
0 files changed, 0 insertions, 0 deletions