| Commit message (Collapse) | Author | Age | Files | Lines | ||
|---|---|---|---|---|---|---|
| ... | ||||||
| | * | Belongs in the github.com/yolean/kubernetes-monitoring project | Staffan Olsson | 2017-07-27 | 1 | -35/+0 | |
| | | | ||||||
| | * | Unimportant | Staffan Olsson | 2017-07-27 | 1 | -1/+1 | |
| | | | ||||||
| | * | Merge pull request #46 from Yolean/switch-to-debian-image | solsson | 2017-07-27 | 11 | -40/+333 | |
| | |\ | | | | | | | Mount config and use debian based image | |||||
| | | * | Merge pull request #47 from Yolean/config-initswitch-to-debian-image | solsson | 2017-07-27 | 5 | -34/+70 | |
| | | |\ | | | | | | | | | Use init container for per-pod config | |||||
| | | | * | Stops logs from growing when zookeeper is idleconfig-init | Staffan Olsson | 2017-07-27 | 1 | -0/+4 | |
| | | | | | ||||||
| | | | * | Places the myid magic number where replicas are | Staffan Olsson | 2017-07-27 | 2 | -5/+5 | |
| | | | | | ||||||
| | | | * | Employs the init script concept for zookeeper too, reducing duplcation | Staffan Olsson | 2017-07-26 | 3 | -21/+39 | |
| | | | | | ||||||
| | | | * | With no bash tricks in command we can use the actual bin ... | Staffan Olsson | 2017-07-26 | 1 | -9/+10 | |
| | | | | | | | | | | | | | | | | | avoiding a layer of indirection and the associated gotchas with signals. | |||||
| | | | * | Moves broker.id config into init script | Staffan Olsson | 2017-07-26 | 2 | -5/+7 | |
| | | | | | ||||||
| | | | * | Demonstrates how an init script can be used to ... | Staffan Olsson | 2017-07-26 | 2 | -0/+11 | |
| | | | | | | | | | | | | | | | | | | | | | modify config prior to kafka start. My aim with this is to get rid of the /bin/sh startup scripts and use bin + args directly. | |||||
| | | | * | Default shell on Debian shows the same symptom ... | Staffan Olsson | 2017-07-26 | 3 | -3/+3 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | of not forwarding signals as Alpine did. Kafka logs say nothing, and after 30s the container is terminated. With /bin/bash instead the log indicates shutdown behavior. This reverts commit c188f43cb8a252cd685a4944d35577ebc17a3668. | |||||
| | | | * | With explicit log4j path we can change config mount ... | Staffan Olsson | 2017-07-26 | 1 | -3/+3 | |
| | | |/ | | | | | | | | | | | | | | | | to not mix with sample config. See https://github.com/solsson/dockerfiles/pull/10. | |||||
| | | * | Tagged with the policy from https://github.com/solsson/dockerfiles/pull/11 | Staffan Olsson | 2017-07-26 | 8 | -8/+8 | |
| | | | | ||||||
| | | * | Clarifies a gotcha: to mount config with log4j.properties ... | Staffan Olsson | 2017-07-26 | 3 | -1/+7 | |
| | | | | | | | | | | | | | | | | | | | | | | you must use /opt/kafka/config, due to how log4j.properites (sometimes tools- or connect-) are resolved by the ./bin scripts. See https://github.com/solsson/dockerfiles/pull/10 | |||||
| | | * | New build at commit 0314080 | Staffan Olsson | 2017-07-26 | 8 | -8/+8 | |
| | | | | ||||||
| | | * | New build with https://github.com/solsson/dockerfiles/pull/9 | Staffan Olsson | 2017-07-25 | 8 | -8/+8 | |
| | | | | ||||||
| | | * | I think time saved by auto-creating topics will be lost ... | Staffan Olsson | 2017-07-25 | 1 | -0/+1 | |
| | | | | | | | | | | | | | tenfold in confusion caused by typos etc | |||||
| | | * | As recommended by ↵ | Staffan Olsson | 2017-07-25 | 1 | -0/+2 | |
| | | | | | | | | | | | | | https://www.confluent.io/blog/apache-kafka-for-service-architectures/ | |||||
| | | * | Merge pull request #43 from Yolean/kafka-011-config-map | solsson | 2017-07-25 | 3 | -0/+248 | |
| | | |\ | | | | | | | | | Use config map for broker configuration | |||||
| | | | * | With stock config we have to change zookeeper lookup from the default localhostkafka-011-config-map | Staffan Olsson | 2017-07-25 | 1 | -0/+1 | |
| | | | | | ||||||
| | | | * | Validates against a gotcha | Staffan Olsson | 2017-07-25 | 1 | -0/+2 | |
| | | | | | ||||||
| | | | * | Use config map's config instead of image's | Staffan Olsson | 2017-07-25 | 1 | -0/+6 | |
| | | | | | ||||||
| | | | * | Adds yaml with the default .properties from 0.11.0.0 | Staffan Olsson | 2017-07-23 | 1 | -0/+239 | |
| | | |/ | ||||||
| | | * | Default shell on debian should forward signals properly | Staffan Olsson | 2017-07-23 | 3 | -3/+3 | |
| | | | | ||||||
| | | * | solsson/kafka on debian restores installation path to /opt/kafka | Staffan Olsson | 2017-07-23 | 2 | -2/+2 | |
| | | | | ||||||
| | | * | Upgrades to current https://github.com/solsson/dockerfiles/pull/5 | Staffan Olsson | 2017-07-23 | 9 | -9/+9 | |
| | | | | ||||||
| | | * | Fixes posix compatibility for probes | Staffan Olsson | 2017-07-23 | 2 | -4/+4 | |
| | |/ | ||||||
| | * | Same startup as 51zoo | Staffan Olsson | 2017-06-28 | 1 | -2/+1 | |
| | | | ||||||
| | * | Applies the limit to persistent zookeeper pods too. They seem more prone to ↵ | Staffan Olsson | 2017-06-28 | 1 | -0/+2 | |
| | | | | | | | | | restarts than 51zoo. | |||||
| | * | shell script is now osx, but no longer gnu :) | Staffan Olsson | 2017-06-28 | 1 | -1/+1 | |
| | | | ||||||
| | * | Upgrades to latest build from https://github.com/solsson/dockerfiles/pull/4, ↵ | Staffan Olsson | 2017-06-28 | 8 | -8/+8 | |
| | | | | | | | | | with plain logging>=INFO config | |||||
| | * | Limiting metrics' JVM to match resource limits. Still getting OOMKilled ↵ | Staffan Olsson | 2017-06-28 | 2 | -2/+4 | |
| | | | | | | | | | though, but maybe half as often. | |||||
| | * | Raises memory limit for metrics; got 10 OOMKilled per pod in the last 3 hours | Staffan Olsson | 2017-06-27 | 3 | -3/+3 | |
| | | | ||||||
| | * | Reduces termination grace period for zookeeper because I fail to trigger ↵ | Staffan Olsson | 2017-06-27 | 2 | -2/+2 | |
| | | | | | | | | | termination by signal | |||||
| | * | Adds probes, but for Kafka I don't think it indicates readiness... | Staffan Olsson | 2017-06-27 | 3 | -0/+30 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | which might not matter because we no longer have a loadbalancing service. These probes won't catch all failure modes, but if they fail we're pretty sure the container is malfunctioning. I found some sources recommending ./bin/kafka-topics.sh for probes but to me it looks risky to introduce a dependency to some other service for such things. One such source is https://github.com/kubernetes/charts/pull/144 The zookeeper probe is from https://kubernetes.io/docs/tasks/configure-pod-container/configure-liveness-readiness-probes/ An issue is that zookeeper's logs are quite verbose for every probe. | |||||
| | * | Reverts to default termination period, and uses bash for "shell form"... | Staffan Olsson | 2017-06-27 | 3 | -6/+6 | |
| | | | | | | | | | | | | | | | | | as Alpine's /bin/busybox (ash) does not forward signals, according to https://pracucci.com/graceful-shutdown-of-kubernetes-pods.html The reason for the termination period change is that we haven't observed any termination behavior yet so we can't know how slow it might be. | |||||
| | * | Merge pull request #35 from Yolean/resource-limits | solsson | 2017-06-27 | 5 | -20/+74 | |
| | |\ | | | | | | | Apply resource limits based on tests with little load | |||||
| | | * | Got quite repeatable OOMKilled on pzoo pods, so I figured it must be...resource-limits | Staffan Olsson | 2017-06-27 | 3 | -3/+3 | |
| | | | | | | | | | | | | | in metrics becuase nither zoo nor kafka has limits | |||||
| | | * | s | Staffan Olsson | 2017-06-27 | 1 | -3/+3 | |
| | | | | ||||||
| | | * | A monitoring-only pod uses 0m / ~32Mi resources | Staffan Olsson | 2017-06-27 | 4 | -6/+62 | |
| | | | | ||||||
| | | * | Removes volume claims documentation, as we've gone completely dynamic | Staffan Olsson | 2017-06-27 | 1 | -14/+0 | |
| | | | | ||||||
| | | * | Adds tentative resource requests, based on what idle pods use (though this ↵ | Staffan Olsson | 2017-06-27 | 3 | -0/+12 | |
| | |/ | | | | | | | includes monitoring) | |||||
| | * | Adds a test that produces a message that you can see in the logs of ↵ | Staffan Olsson | 2017-06-27 | 1 | -0/+24 | |
| | | | | | | | | | 21consumer-test1 | |||||
| | * | Adds utility to update the kafka image, which we keep the same to minimize ↵ | Staffan Olsson | 2017-06-27 | 5 | -8/+12 | |
| | | | | | | | | | pull waits | |||||
| | * | Uses dynamically provisioned volume for Kafka too. It has matured, ... | Staffan Olsson | 2017-06-27 | 4 | -106/+2 | |
| | | | | | | | | | | | simplifies use of multi-zone clusters, works in Minikube, and volumes are deleted when the PV is deleted (by manual kubectl). | |||||
| | * | Merge pull request #33 from Yolean/zookeeper-data | solsson | 2017-06-27 | 6 | -16/+114 | |
| | |\ | | | | | | | Persistent volumes for Zookeeper | |||||
| | | * | Forks can tweak storage classes, but here we want setup to be simple...zookeeper-data | Staffan Olsson | 2017-06-26 | 4 | -21/+1 | |
| | | | | | | | | | | | | | | | | | | | and with the mix of PV and emptyDir there's no reason to make PVs faster than host disks. Use 10GB as it is the minimum for standard disks on GKE. | |||||
| | | * | Merge pull request #34 from Yolean/zookeeper-availability-zones | solsson | 2017-06-26 | 5 | -8/+87 | |
| | | |\ | | | | | | | | | Suggest a mix of persistent and ephemeral data to improve reliability across zones | |||||
| | | | * | A cluster in three availability zones now get one persistent zk each, and ↵zookeeper-availability-zones | Staffan Olsson | 2017-06-26 | 4 | -23/+15 | |
| | | | | | | | | | | | | | | | | | two that can move automatically at node failures | |||||
| | | | * | Creates identical definitions for a non-persistent zoo statefulset | Staffan Olsson | 2017-06-26 | 2 | -0/+85 | |
| | | | | | ||||||
 |
index : kubernetes-kafka | |
| Kafka cluster as Kubernetes StatefulSet, plain manifests and config |
| aboutsummaryrefslogtreecommitdiff |