Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | solsson/kafka on debian restores installation path to /opt/kafka | Staffan Olsson | 2017-07-23 | 2 | -2/+2 |
| | |||||
* | Upgrades to current https://github.com/solsson/dockerfiles/pull/5 | Staffan Olsson | 2017-07-23 | 9 | -9/+9 |
| | |||||
* | Fixes posix compatibility for probes | Staffan Olsson | 2017-07-23 | 2 | -4/+4 |
| | |||||
* | Same startup as 51zoo | Staffan Olsson | 2017-06-28 | 1 | -2/+1 |
| | |||||
* | Applies the limit to persistent zookeeper pods too. They seem more prone to ↵ | Staffan Olsson | 2017-06-28 | 1 | -0/+2 |
| | | | | restarts than 51zoo. | ||||
* | shell script is now osx, but no longer gnu :) | Staffan Olsson | 2017-06-28 | 1 | -1/+1 |
| | |||||
* | Upgrades to latest build from https://github.com/solsson/dockerfiles/pull/4, ↵ | Staffan Olsson | 2017-06-28 | 8 | -8/+8 |
| | | | | with plain logging>=INFO config | ||||
* | Limiting metrics' JVM to match resource limits. Still getting OOMKilled ↵ | Staffan Olsson | 2017-06-28 | 2 | -2/+4 |
| | | | | though, but maybe half as often. | ||||
* | Raises memory limit for metrics; got 10 OOMKilled per pod in the last 3 hours | Staffan Olsson | 2017-06-27 | 3 | -3/+3 |
| | |||||
* | Reduces termination grace period for zookeeper because I fail to trigger ↵ | Staffan Olsson | 2017-06-27 | 2 | -2/+2 |
| | | | | termination by signal | ||||
* | Adds probes, but for Kafka I don't think it indicates readiness... | Staffan Olsson | 2017-06-27 | 3 | -0/+30 |
| | | | | | | | | | | | | | | | which might not matter because we no longer have a loadbalancing service. These probes won't catch all failure modes, but if they fail we're pretty sure the container is malfunctioning. I found some sources recommending ./bin/kafka-topics.sh for probes but to me it looks risky to introduce a dependency to some other service for such things. One such source is https://github.com/kubernetes/charts/pull/144 The zookeeper probe is from https://kubernetes.io/docs/tasks/configure-pod-container/configure-liveness-readiness-probes/ An issue is that zookeeper's logs are quite verbose for every probe. | ||||
* | Reverts to default termination period, and uses bash for "shell form"... | Staffan Olsson | 2017-06-27 | 3 | -6/+6 |
| | | | | | | | | as Alpine's /bin/busybox (ash) does not forward signals, according to https://pracucci.com/graceful-shutdown-of-kubernetes-pods.html The reason for the termination period change is that we haven't observed any termination behavior yet so we can't know how slow it might be. | ||||
* | Merge pull request #35 from Yolean/resource-limits | solsson | 2017-06-27 | 5 | -20/+74 |
|\ | | | | | Apply resource limits based on tests with little load | ||||
| * | Got quite repeatable OOMKilled on pzoo pods, so I figured it must be...resource-limits | Staffan Olsson | 2017-06-27 | 3 | -3/+3 |
| | | | | | | | | in metrics becuase nither zoo nor kafka has limits | ||||
| * | s | Staffan Olsson | 2017-06-27 | 1 | -3/+3 |
| | | |||||
| * | A monitoring-only pod uses 0m / ~32Mi resources | Staffan Olsson | 2017-06-27 | 4 | -6/+62 |
| | | |||||
| * | Removes volume claims documentation, as we've gone completely dynamic | Staffan Olsson | 2017-06-27 | 1 | -14/+0 |
| | | |||||
| * | Adds tentative resource requests, based on what idle pods use (though this ↵ | Staffan Olsson | 2017-06-27 | 3 | -0/+12 |
|/ | | | | includes monitoring) | ||||
* | Adds a test that produces a message that you can see in the logs of ↵ | Staffan Olsson | 2017-06-27 | 1 | -0/+24 |
| | | | | 21consumer-test1 | ||||
* | Adds utility to update the kafka image, which we keep the same to minimize ↵ | Staffan Olsson | 2017-06-27 | 5 | -8/+12 |
| | | | | pull waits | ||||
* | Uses dynamically provisioned volume for Kafka too. It has matured, ... | Staffan Olsson | 2017-06-27 | 4 | -106/+2 |
| | | | | | simplifies use of multi-zone clusters, works in Minikube, and volumes are deleted when the PV is deleted (by manual kubectl). | ||||
* | Merge pull request #33 from Yolean/zookeeper-data | solsson | 2017-06-27 | 6 | -16/+114 |
|\ | | | | | Persistent volumes for Zookeeper | ||||
| * | Forks can tweak storage classes, but here we want setup to be simple...zookeeper-data | Staffan Olsson | 2017-06-26 | 4 | -21/+1 |
| | | | | | | | | | | | | and with the mix of PV and emptyDir there's no reason to make PVs faster than host disks. Use 10GB as it is the minimum for standard disks on GKE. | ||||
| * | Merge pull request #34 from Yolean/zookeeper-availability-zones | solsson | 2017-06-26 | 5 | -8/+87 |
| |\ | | | | | | | Suggest a mix of persistent and ephemeral data to improve reliability across zones | ||||
| | * | A cluster in three availability zones now get one persistent zk each, and ↵zookeeper-availability-zones | Staffan Olsson | 2017-06-26 | 4 | -23/+15 |
| | | | | | | | | | | | | two that can move automatically at node failures | ||||
| | * | Creates identical definitions for a non-persistent zoo statefulset | Staffan Olsson | 2017-06-26 | 2 | -0/+85 |
| | | | |||||
| | * | Makes persistence a fundamental attribute of the statefulset | Staffan Olsson | 2017-06-26 | 3 | -6/+8 |
| |/ | |||||
| * | Enables metrics export to Prometheus, but they look very uninteresting. | Staffan Olsson | 2017-06-25 | 2 | -0/+18 |
| | | | | | | | | The selected config is from the jmx_exporter examples. | ||||
| * | Updates the readme | Staffan Olsson | 2017-06-25 | 3 | -7/+8 |
| | | |||||
| * | Verified the volume setup with Minikube | Staffan Olsson | 2017-06-25 | 1 | -0/+5 |
| | | |||||
| * | Uses a named storage class so you can select volume type specifically for zoo | Staffan Olsson | 2017-06-25 | 2 | -3/+18 |
| | | |||||
* | | Merge partial branch 'zookeeper-data', the switch to kafka image | Staffan Olsson | 2017-06-25 | 3 | -12/+43 |
|\| | |||||
| * | Uses the same data path convention as zookeeper, from Confluent Platform | Staffan Olsson | 2017-06-25 | 1 | -2/+2 |
| | | |||||
| * | Uses the kafka image as Zookeeper service... | Staffan Olsson | 2017-06-25 | 2 | -10/+41 |
|/ | | | | | | to reduce image download times and use a supported version. Initial config is from https://zookeeper.apache.org/doc/r3.4.10/zookeeperAdmin.html#sc_zkMulitServerSetup and the fixes for stateful set are from https://github.com/solsson/zookeeper-docker | ||||
* | Reindents yaml to match the rest of this repo, and most examples out there | Staffan Olsson | 2017-06-25 | 1 | -22/+22 |
| | |||||
* | Merge pull request #31 from Yolean/metrics-via-jmx | solsson | 2017-06-25 | 2 | -0/+18 |
|\ | | | | | Add metrics exporter for Prometheus | ||||
| * | Use a specific build, ↵metrics-via-jmx | Staffan Olsson | 2017-06-25 | 1 | -1/+1 |
| | | | | | | | | github.com/solsson/dockerfiles/commit/81e8e4c20be19835d4036db1c975ff17455fe7e7 | ||||
| * | Adds metrics exporter for Prometheus | Staffan Olsson | 2017-06-25 | 2 | -0/+18 |
|/ | |||||
* | Support for generic image results in a verbose startup command, make it git ↵ | Staffan Olsson | 2017-06-25 | 1 | -1/+6 |
| | | | | friendly | ||||
* | Merge branch 'log-dir-inside-volume' into kafka-011 | Staffan Olsson | 2017-06-25 | 1 | -1/+1 |
|\ | |||||
| * | Default log dir is /tmp/kafka-logs so it should be changed to be inside the ↵ | Staffan Olsson | 2017-06-25 | 1 | -1/+1 |
|/ | | | | persistent volume mount | ||||
* | Uses the new small image, with only selected jars from the build | Staffan Olsson | 2017-06-25 | 1 | -1/+1 |
| | |||||
* | Merge branch 'zookeeper-update' into kafka-011 | Staffan Olsson | 2017-06-25 | 2 | -6/+3 |
|\ | |||||
| * | Removes out-of-date zookeeper info | Staffan Olsson | 2017-06-25 | 1 | -5/+2 |
| | | |||||
| * | We do need the bind address sed. This image logs the at start, to reduce the ↵ | Staffan Olsson | 2017-06-25 | 1 | -1/+1 |
| | | | | | | | | element of surprise. | ||||
| * | Uses zookeeper without the bind address sed | Staffan Olsson | 2017-06-25 | 1 | -1/+1 |
| | | |||||
| * | Upgrades zookeeper to latest | Staffan Olsson | 2017-06-25 | 1 | -1/+1 |
|/ | |||||
* | Merge branch 'no-roundrobin-service' into kafka-011 | Staffan Olsson | 2017-06-25 | 6 | -16/+9 |
|\ | |||||
| * | Borrows string trick from https://github.com/kubernetes/charts/ | Staffan Olsson | 2017-06-25 | 1 | -1/+1 |
| | | |||||
| * | Reuses the statefulset's image in test pods, without tag duplication... | Staffan Olsson | 2017-06-25 | 4 | -4/+8 |
| | | | | | | | | Works when scheduled on the same node(s) |