diff options
| author | Staffan Olsson <staffan@repos.se> | 2017-06-25 06:06:39 +0200 |
|---|---|---|
| committer | Staffan Olsson <staffan@repos.se> | 2017-06-25 06:06:39 +0200 |
| commit | c39b65c21d23d722892f90e9453b0a674cb01e1f (patch) | |
| tree | 9366c990beb00d03b0d34b7415053d5afda70df6 | |
| parent | 401d65e9a383b43148ae9053dae05f529c7df750 (diff) | |
| parent | a9b7a2220a6daaaa8a4e014734ab86384fb7d9de (diff) | |
| download | kubernetes-kafka-c39b65c21d23d722892f90e9453b0a674cb01e1f.tar.gz kubernetes-kafka-c39b65c21d23d722892f90e9453b0a674cb01e1f.tar.bz2 kubernetes-kafka-c39b65c21d23d722892f90e9453b0a674cb01e1f.zip | |
Merge branch 'zookeeper-update' into kafka-011
| -rw-r--r-- | README.md | 7 | ||||
| -rw-r--r-- | zookeeper/50zoo.yml | 2 |
2 files changed, 3 insertions, 6 deletions
@@ -24,18 +24,15 @@ kubectl -n kafka get pvc ## Set up Zookeeper -There is a Zookeeper+StatefulSet [blog post](http://blog.kubernetes.io/2016/12/statefulset-run-scale-stateful-applications-in-kubernetes.html) and [example](https://github.com/kubernetes/contrib/tree/master/statefulsets/zookeeper), -but it appears tuned for workloads heavier than Kafka topic metadata. - -The Kafka book (Definitive Guide, O'Reilly 2016) recommends that Kafka has its own Zookeeper cluster, +The Kafka book (Definitive Guide, O'Reilly 2016) recommends that Kafka has its own Zookeeper cluster with at least 5 instances, so we use the [official docker image](https://hub.docker.com/_/zookeeper/) but with a [startup script change to guess node id from hostname](https://github.com/solsson/zookeeper-docker/commit/df9474f858ad548be8a365cb000a4dd2d2e3a217). -Zookeeper runs as a [Deployment](http://kubernetes.io/docs/user-guide/deployments/) without persistent storage: ``` kubectl create -f ./zookeeper/ ``` +Despite being a StatefulSet, there is no persistent volume by default. If you lose your zookeeper cluster, kafka will be unaware that persisted topics exist. The data is still there, but you need to re-create topics. diff --git a/zookeeper/50zoo.yml b/zookeeper/50zoo.yml index 5cb7c02..3ac4ce9 100644 --- a/zookeeper/50zoo.yml +++ b/zookeeper/50zoo.yml @@ -14,7 +14,7 @@ spec: terminationGracePeriodSeconds: 10 containers: - name: zookeeper - image: solsson/zookeeper-statefulset:3.4.9@sha256:d32b44b32009a69b3450a5216f459e504f1041f587596895219fc04cf22f5546 + image: solsson/zookeeper-statefulset:3.4.10@sha256:0ad93c98d5165b4eb747c4b0dd04a7a448a5c4b4cbcaa4bffc15018b76b81bb5 env: - name: ZOO_SERVERS value: server.1=zoo-0.zoo:2888:3888:participant server.2=zoo-1.zoo:2888:3888:participant server.3=zoo-2.zoo:2888:3888:participant server.4=zoo-3.zoo:2888:3888:participant server.5=zoo-4.zoo:2888:3888:participant |