diff options
| author | Stephen Haberman <stephen@exigencecorp.com> | 2013-02-24 22:08:14 -0600 |
|---|---|---|
| committer | Stephen Haberman <stephen@exigencecorp.com> | 2013-02-24 22:08:14 -0600 |
| commit | 44032bc476be9f334d17db3b8963a8deb973123c (patch) | |
| tree | e1c24996382633675ef78d0a5bc39ec007982f02 /docs/tuning.md | |
| parent | 4281e579c236d0125f44f5ca1d999adb5f894c24 (diff) | |
| parent | 3b9f929467f3b14e780df459919a4d6c0c7ee772 (diff) | |
| download | spark-44032bc476be9f334d17db3b8963a8deb973123c.tar.gz spark-44032bc476be9f334d17db3b8963a8deb973123c.tar.bz2 spark-44032bc476be9f334d17db3b8963a8deb973123c.zip | |
Merge branch 'master' into bettersplits
Conflicts:
core/src/main/scala/spark/RDD.scala
core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala
core/src/test/scala/spark/ShuffleSuite.scala
Diffstat (limited to 'docs/tuning.md')
| -rw-r--r-- | docs/tuning.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/tuning.md b/docs/tuning.md index e9b4d6717c..843380b9a2 100644 --- a/docs/tuning.md +++ b/docs/tuning.md @@ -233,7 +233,7 @@ number of cores in your clusters. ## Broadcasting Large Variables -Using the [broadcast functionality](scala-programming-guide#broadcast-variables) +Using the [broadcast functionality](scala-programming-guide.html#broadcast-variables) available in `SparkContext` can greatly reduce the size of each serialized task, and the cost of launching a job over a cluster. If your tasks use any large object from the driver program inside of them (e.g. a static lookup table), consider turning it into a broadcast variable. |