diff options
author | solsson <solsson@gmail.com> | 2017-11-09 14:50:36 +0100 |
---|---|---|
committer | GitHub <noreply@github.com> | 2017-11-09 14:50:36 +0100 |
commit | ece07d5a17013e30be6be89ee1fe29d2695ebe04 (patch) | |
tree | 52ca56be5e762f28f3b879be1406396521707346 | |
parent | 2e90c7e293190a1b64294e968e0e89c7811b960b (diff) | |
parent | 9c6f0e14c2dc271701a84e0230276badcd66a79d (diff) | |
download | kubernetes-kafka-ece07d5a17013e30be6be89ee1fe29d2695ebe04.tar.gz kubernetes-kafka-ece07d5a17013e30be6be89ee1fe29d2695ebe04.tar.bz2 kubernetes-kafka-ece07d5a17013e30be6be89ee1fe29d2695ebe04.zip |
Merge pull request #85 from Yolean/storage-classes-1.8
Use k8s 1.8 storage class syntax and set Retain by default
-rw-r--r-- | 50kafka.yml | 1 | ||||
-rw-r--r-- | README.md | 14 | ||||
-rw-r--r-- | configure/gke-storageclass-broker-pd.yml | 8 | ||||
-rw-r--r-- | configure/gke-storageclass-zookeeper-ssd.yml | 8 | ||||
-rw-r--r-- | configure/minikube-storageclass-broker.yml | 6 | ||||
-rw-r--r-- | configure/minikube-storageclass-zookeeper.yml | 6 | ||||
-rw-r--r-- | zookeeper/50pzoo.yml | 3 |
7 files changed, 37 insertions, 9 deletions
diff --git a/50kafka.yml b/50kafka.yml index e4451fd..0f0956e 100644 --- a/50kafka.yml +++ b/50kafka.yml @@ -79,6 +79,7 @@ spec: name: data spec: accessModes: [ "ReadWriteOnce" ] + storageClassName: kafka-broker resources: requests: storage: 200Gi @@ -30,6 +30,12 @@ The goal is to provide [Bootstrap servers](http://kafka.apache.org/documentation Zookeeper at `zookeeper.kafka.svc.cluster.local:2181`. +## Prepare storage classes + +For Minikube run `kubectl apply -f configure/minikube-storageclass-broker.yml; kubectl apply -f configure/minikube-storageclass-zookeeper.yml`. + +There's a similar setup for GKE, `configure/gke-*`. You might want to tweak it before creating. + ## Start Zookeeper The [Kafka book](https://www.confluent.io/resources/kafka-definitive-guide-preview-edition/) recommends that Kafka has its own Zookeeper cluster with at least 5 instances. @@ -64,14 +70,6 @@ For clusters that enfoce [RBAC](https://kubernetes.io/docs/admin/authorization/r kubectl apply -f rbac-namespace-default/ ``` -## Caution: `Delete` Reclaim Policy is default - -In production you likely want to [manually set Reclaim Policy](https://kubernetes.io/docs/tasks/administer-cluster/change-pv-reclaim-policy/), -or your data will be gone if the generated [volume claim](https://kubernetes.io/docs/concepts/storage/persistent-volumes/#persistentvolumeclaims)s are deleted. - -This can't be done [in manifests](https://github.com/Yolean/kubernetes-kafka/pull/50), -at least not [until Kubernetes 1.8](https://github.com/kubernetes/features/issues/352). - ## Tests Tests are based on the [kube-test](https://github.com/Yolean/kube-test) concept. diff --git a/configure/gke-storageclass-broker-pd.yml b/configure/gke-storageclass-broker-pd.yml new file mode 100644 index 0000000..dbb7203 --- /dev/null +++ b/configure/gke-storageclass-broker-pd.yml @@ -0,0 +1,8 @@ +kind: StorageClass +apiVersion: storage.k8s.io/v1 +metadata: + name: kafka-broker +provisioner: kubernetes.io/gce-pd +reclaimPolicy: Retain +parameters: + type: pd-standard diff --git a/configure/gke-storageclass-zookeeper-ssd.yml b/configure/gke-storageclass-zookeeper-ssd.yml new file mode 100644 index 0000000..5d6673a --- /dev/null +++ b/configure/gke-storageclass-zookeeper-ssd.yml @@ -0,0 +1,8 @@ +kind: StorageClass +apiVersion: storage.k8s.io/v1 +metadata: + name: kafka-zookeeper +provisioner: kubernetes.io/gce-pd +reclaimPolicy: Retain +parameters: + type: pd-ssd diff --git a/configure/minikube-storageclass-broker.yml b/configure/minikube-storageclass-broker.yml new file mode 100644 index 0000000..ae930b4 --- /dev/null +++ b/configure/minikube-storageclass-broker.yml @@ -0,0 +1,6 @@ +kind: StorageClass +apiVersion: storage.k8s.io/v1 +metadata: + name: kafka-broker +provisioner: k8s.io/minikube-hostpath +reclaimPolicy: Retain diff --git a/configure/minikube-storageclass-zookeeper.yml b/configure/minikube-storageclass-zookeeper.yml new file mode 100644 index 0000000..48c0f35 --- /dev/null +++ b/configure/minikube-storageclass-zookeeper.yml @@ -0,0 +1,6 @@ +kind: StorageClass +apiVersion: storage.k8s.io/v1 +metadata: + name: kafka-zookeeper +provisioner: k8s.io/minikube-hostpath +reclaimPolicy: Retain diff --git a/zookeeper/50pzoo.yml b/zookeeper/50pzoo.yml index 446748a..a166a91 100644 --- a/zookeeper/50pzoo.yml +++ b/zookeeper/50pzoo.yml @@ -63,6 +63,7 @@ spec: name: data spec: accessModes: [ "ReadWriteOnce" ] + storageClassName: kafka-zookeeper resources: requests: - storage: 10Gi + storage: 1Gi |