blob: 4c8eec4312bb31d2e0786ab12e45b383b113bd4d (
plain) (
blame)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
|
# vcluster
Script to manage a local, docker-based, Apache Spark cluster.
## Requirements
- A copy of Spark's source code
- docker
## Installation
Download the script and put it in your PATH.
`curl https://raw.githubusercontent.com/jodersky/vcluster/master/vcluster -o ~/bin/vcluster && chmod 0755 ~/bin/vcluster`
## Usage
1. Create docker image from Spark's source
vcluster init <path to spark's source>
2. Spin up a "local cluster", consisting of several containers
vcluster start <number of workers, default 5>
3. Start spark-shell in a container
vcluster shell
4. Show the status of the cluster
vcluster list
5. Shut down the cluster
vcluster stop
|
