diff options
| author | Matei Zaharia <matei@eecs.berkeley.edu> | 2011-07-14 12:40:56 -0400 |
|---|---|---|
| committer | Matei Zaharia <matei@eecs.berkeley.edu> | 2011-07-14 12:40:56 -0400 |
| commit | 969644df8eec13f4b89597a0682c8037949d855b (patch) | |
| tree | 2b2fa4d01130cd76759d68606d2b5ab669ca52be /bagel | |
| parent | 2604939f643bca125f5e2fb53e3221202996d41b (diff) | |
| download | spark-969644df8eec13f4b89597a0682c8037949d855b.tar.gz spark-969644df8eec13f4b89597a0682c8037949d855b.tar.bz2 spark-969644df8eec13f4b89597a0682c8037949d855b.zip | |
Cleaned up a few issues to do with default parallelism levels. Also
renamed HadoopFileWriter to HadoopWriter (since it's not only for files)
and fixed a bug for lookup().
Diffstat (limited to 'bagel')
| -rw-r--r-- | bagel/src/main/scala/spark/bagel/Bagel.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/bagel/src/main/scala/spark/bagel/Bagel.scala b/bagel/src/main/scala/spark/bagel/Bagel.scala index 08ff1d8a01..92d4132e68 100644 --- a/bagel/src/main/scala/spark/bagel/Bagel.scala +++ b/bagel/src/main/scala/spark/bagel/Bagel.scala @@ -14,7 +14,7 @@ object Bagel extends Logging { combiner: Combiner[M, C] = new DefaultCombiner[M], aggregator: Aggregator[V, A] = new NullAggregator[V], superstep: Int = 0, - numSplits: Int = sc.numCores + numSplits: Int = sc.defaultParallelism )( compute: (V, Option[C], A, Int) => (V, Iterable[M]) ): RDD[V] = { |