Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Places the myid magic number where replicas are | Staffan Olsson | 2017-07-27 | 2 | -5/+5 |
| | |||||
* | Employs the init script concept for zookeeper too, reducing duplcation | Staffan Olsson | 2017-07-26 | 3 | -21/+39 |
| | |||||
* | With no bash tricks in command we can use the actual bin ... | Staffan Olsson | 2017-07-26 | 1 | -9/+10 |
| | | | | avoiding a layer of indirection and the associated gotchas with signals. | ||||
* | Moves broker.id config into init script | Staffan Olsson | 2017-07-26 | 2 | -5/+7 |
| | |||||
* | Demonstrates how an init script can be used to ... | Staffan Olsson | 2017-07-26 | 2 | -0/+11 |
| | | | | | modify config prior to kafka start. My aim with this is to get rid of the /bin/sh startup scripts and use bin + args directly. | ||||
* | Default shell on Debian shows the same symptom ... | Staffan Olsson | 2017-07-26 | 3 | -3/+3 |
| | | | | | | | | of not forwarding signals as Alpine did. Kafka logs say nothing, and after 30s the container is terminated. With /bin/bash instead the log indicates shutdown behavior. This reverts commit c188f43cb8a252cd685a4944d35577ebc17a3668. | ||||
* | With explicit log4j path we can change config mount ... | Staffan Olsson | 2017-07-26 | 1 | -3/+3 |
| | | | | | | to not mix with sample config. See https://github.com/solsson/dockerfiles/pull/10. | ||||
* | Tagged with the policy from https://github.com/solsson/dockerfiles/pull/11 | Staffan Olsson | 2017-07-26 | 8 | -8/+8 |
| | |||||
* | Clarifies a gotcha: to mount config with log4j.properties ... | Staffan Olsson | 2017-07-26 | 3 | -1/+7 |
| | | | | | | | you must use /opt/kafka/config, due to how log4j.properites (sometimes tools- or connect-) are resolved by the ./bin scripts. See https://github.com/solsson/dockerfiles/pull/10 | ||||
* | New build at commit 0314080 | Staffan Olsson | 2017-07-26 | 8 | -8/+8 |
| | |||||
* | New build with https://github.com/solsson/dockerfiles/pull/9 | Staffan Olsson | 2017-07-25 | 8 | -8/+8 |
| | |||||
* | I think time saved by auto-creating topics will be lost ... | Staffan Olsson | 2017-07-25 | 1 | -0/+1 |
| | | | | tenfold in confusion caused by typos etc | ||||
* | As recommended by ↵ | Staffan Olsson | 2017-07-25 | 1 | -0/+2 |
| | | | | https://www.confluent.io/blog/apache-kafka-for-service-architectures/ | ||||
* | Merge pull request #43 from Yolean/kafka-011-config-map | solsson | 2017-07-25 | 3 | -0/+248 |
|\ | | | | | Use config map for broker configuration | ||||
| * | With stock config we have to change zookeeper lookup from the default localhostkafka-011-config-map | Staffan Olsson | 2017-07-25 | 1 | -0/+1 |
| | | |||||
| * | Validates against a gotcha | Staffan Olsson | 2017-07-25 | 1 | -0/+2 |
| | | |||||
| * | Use config map's config instead of image's | Staffan Olsson | 2017-07-25 | 1 | -0/+6 |
| | | |||||
| * | Adds yaml with the default .properties from 0.11.0.0 | Staffan Olsson | 2017-07-23 | 1 | -0/+239 |
|/ | |||||
* | Default shell on debian should forward signals properly | Staffan Olsson | 2017-07-23 | 3 | -3/+3 |
| | |||||
* | solsson/kafka on debian restores installation path to /opt/kafka | Staffan Olsson | 2017-07-23 | 2 | -2/+2 |
| | |||||
* | Upgrades to current https://github.com/solsson/dockerfiles/pull/5 | Staffan Olsson | 2017-07-23 | 9 | -9/+9 |
| | |||||
* | Fixes posix compatibility for probes | Staffan Olsson | 2017-07-23 | 2 | -4/+4 |
| | |||||
* | Same startup as 51zoo | Staffan Olsson | 2017-06-28 | 1 | -2/+1 |
| | |||||
* | Applies the limit to persistent zookeeper pods too. They seem more prone to ↵ | Staffan Olsson | 2017-06-28 | 1 | -0/+2 |
| | | | | restarts than 51zoo. | ||||
* | shell script is now osx, but no longer gnu :) | Staffan Olsson | 2017-06-28 | 1 | -1/+1 |
| | |||||
* | Upgrades to latest build from https://github.com/solsson/dockerfiles/pull/4, ↵ | Staffan Olsson | 2017-06-28 | 8 | -8/+8 |
| | | | | with plain logging>=INFO config | ||||
* | Limiting metrics' JVM to match resource limits. Still getting OOMKilled ↵ | Staffan Olsson | 2017-06-28 | 2 | -2/+4 |
| | | | | though, but maybe half as often. | ||||
* | Raises memory limit for metrics; got 10 OOMKilled per pod in the last 3 hours | Staffan Olsson | 2017-06-27 | 3 | -3/+3 |
| | |||||
* | Reduces termination grace period for zookeeper because I fail to trigger ↵ | Staffan Olsson | 2017-06-27 | 2 | -2/+2 |
| | | | | termination by signal | ||||
* | Adds probes, but for Kafka I don't think it indicates readiness... | Staffan Olsson | 2017-06-27 | 3 | -0/+30 |
| | | | | | | | | | | | | | | | which might not matter because we no longer have a loadbalancing service. These probes won't catch all failure modes, but if they fail we're pretty sure the container is malfunctioning. I found some sources recommending ./bin/kafka-topics.sh for probes but to me it looks risky to introduce a dependency to some other service for such things. One such source is https://github.com/kubernetes/charts/pull/144 The zookeeper probe is from https://kubernetes.io/docs/tasks/configure-pod-container/configure-liveness-readiness-probes/ An issue is that zookeeper's logs are quite verbose for every probe. | ||||
* | Reverts to default termination period, and uses bash for "shell form"... | Staffan Olsson | 2017-06-27 | 3 | -6/+6 |
| | | | | | | | | as Alpine's /bin/busybox (ash) does not forward signals, according to https://pracucci.com/graceful-shutdown-of-kubernetes-pods.html The reason for the termination period change is that we haven't observed any termination behavior yet so we can't know how slow it might be. | ||||
* | Merge pull request #35 from Yolean/resource-limits | solsson | 2017-06-27 | 5 | -20/+74 |
|\ | | | | | Apply resource limits based on tests with little load | ||||
| * | Got quite repeatable OOMKilled on pzoo pods, so I figured it must be...resource-limits | Staffan Olsson | 2017-06-27 | 3 | -3/+3 |
| | | | | | | | | in metrics becuase nither zoo nor kafka has limits | ||||
| * | s | Staffan Olsson | 2017-06-27 | 1 | -3/+3 |
| | | |||||
| * | A monitoring-only pod uses 0m / ~32Mi resources | Staffan Olsson | 2017-06-27 | 4 | -6/+62 |
| | | |||||
| * | Removes volume claims documentation, as we've gone completely dynamic | Staffan Olsson | 2017-06-27 | 1 | -14/+0 |
| | | |||||
| * | Adds tentative resource requests, based on what idle pods use (though this ↵ | Staffan Olsson | 2017-06-27 | 3 | -0/+12 |
|/ | | | | includes monitoring) | ||||
* | Adds a test that produces a message that you can see in the logs of ↵ | Staffan Olsson | 2017-06-27 | 1 | -0/+24 |
| | | | | 21consumer-test1 | ||||
* | Adds utility to update the kafka image, which we keep the same to minimize ↵ | Staffan Olsson | 2017-06-27 | 5 | -8/+12 |
| | | | | pull waits | ||||
* | Uses dynamically provisioned volume for Kafka too. It has matured, ... | Staffan Olsson | 2017-06-27 | 4 | -106/+2 |
| | | | | | simplifies use of multi-zone clusters, works in Minikube, and volumes are deleted when the PV is deleted (by manual kubectl). | ||||
* | Merge pull request #33 from Yolean/zookeeper-data | solsson | 2017-06-27 | 6 | -16/+114 |
|\ | | | | | Persistent volumes for Zookeeper | ||||
| * | Forks can tweak storage classes, but here we want setup to be simple...zookeeper-data | Staffan Olsson | 2017-06-26 | 4 | -21/+1 |
| | | | | | | | | | | | | and with the mix of PV and emptyDir there's no reason to make PVs faster than host disks. Use 10GB as it is the minimum for standard disks on GKE. | ||||
| * | Merge pull request #34 from Yolean/zookeeper-availability-zones | solsson | 2017-06-26 | 5 | -8/+87 |
| |\ | | | | | | | Suggest a mix of persistent and ephemeral data to improve reliability across zones | ||||
| | * | A cluster in three availability zones now get one persistent zk each, and ↵zookeeper-availability-zones | Staffan Olsson | 2017-06-26 | 4 | -23/+15 |
| | | | | | | | | | | | | two that can move automatically at node failures | ||||
| | * | Creates identical definitions for a non-persistent zoo statefulset | Staffan Olsson | 2017-06-26 | 2 | -0/+85 |
| | | | |||||
| | * | Makes persistence a fundamental attribute of the statefulset | Staffan Olsson | 2017-06-26 | 3 | -6/+8 |
| |/ | |||||
| * | Enables metrics export to Prometheus, but they look very uninteresting. | Staffan Olsson | 2017-06-25 | 2 | -0/+18 |
| | | | | | | | | The selected config is from the jmx_exporter examples. | ||||
| * | Updates the readme | Staffan Olsson | 2017-06-25 | 3 | -7/+8 |
| | | |||||
| * | Verified the volume setup with Minikube | Staffan Olsson | 2017-06-25 | 1 | -0/+5 |
| | | |||||
| * | Uses a named storage class so you can select volume type specifically for zoo | Staffan Olsson | 2017-06-25 | 2 | -3/+18 |
| | |