aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Merge pull request #47 from Yolean/config-initswitch-to-debian-imagesolsson2017-07-275-34/+70
|\ | | | | Use init container for per-pod config
| * Stops logs from growing when zookeeper is idleconfig-initStaffan Olsson2017-07-271-0/+4
| |
| * Places the myid magic number where replicas areStaffan Olsson2017-07-272-5/+5
| |
| * Employs the init script concept for zookeeper too, reducing duplcationStaffan Olsson2017-07-263-21/+39
| |
| * With no bash tricks in command we can use the actual bin ...Staffan Olsson2017-07-261-9/+10
| | | | | | | | avoiding a layer of indirection and the associated gotchas with signals.
| * Moves broker.id config into init scriptStaffan Olsson2017-07-262-5/+7
| |
| * Demonstrates how an init script can be used to ...Staffan Olsson2017-07-262-0/+11
| | | | | | | | | | modify config prior to kafka start. My aim with this is to get rid of the /bin/sh startup scripts and use bin + args directly.
| * Default shell on Debian shows the same symptom ...Staffan Olsson2017-07-263-3/+3
| | | | | | | | | | | | | | | | of not forwarding signals as Alpine did. Kafka logs say nothing, and after 30s the container is terminated. With /bin/bash instead the log indicates shutdown behavior. This reverts commit c188f43cb8a252cd685a4944d35577ebc17a3668.
| * With explicit log4j path we can change config mount ...Staffan Olsson2017-07-261-3/+3
|/ | | | | | to not mix with sample config. See https://github.com/solsson/dockerfiles/pull/10.
* Tagged with the policy from https://github.com/solsson/dockerfiles/pull/11Staffan Olsson2017-07-268-8/+8
|
* Clarifies a gotcha: to mount config with log4j.properties ...Staffan Olsson2017-07-263-1/+7
| | | | | | | you must use /opt/kafka/config, due to how log4j.properites (sometimes tools- or connect-) are resolved by the ./bin scripts. See https://github.com/solsson/dockerfiles/pull/10
* New build at commit 0314080Staffan Olsson2017-07-268-8/+8
|
* New build with https://github.com/solsson/dockerfiles/pull/9Staffan Olsson2017-07-258-8/+8
|
* I think time saved by auto-creating topics will be lost ...Staffan Olsson2017-07-251-0/+1
| | | | tenfold in confusion caused by typos etc
* As recommended by ↵Staffan Olsson2017-07-251-0/+2
| | | | https://www.confluent.io/blog/apache-kafka-for-service-architectures/
* Merge pull request #43 from Yolean/kafka-011-config-mapsolsson2017-07-253-0/+248
|\ | | | | Use config map for broker configuration
| * With stock config we have to change zookeeper lookup from the default localhostkafka-011-config-mapStaffan Olsson2017-07-251-0/+1
| |
| * Validates against a gotchaStaffan Olsson2017-07-251-0/+2
| |
| * Use config map's config instead of image'sStaffan Olsson2017-07-251-0/+6
| |
| * Adds yaml with the default .properties from 0.11.0.0Staffan Olsson2017-07-231-0/+239
|/
* Default shell on debian should forward signals properlyStaffan Olsson2017-07-233-3/+3
|
* solsson/kafka on debian restores installation path to /opt/kafkaStaffan Olsson2017-07-232-2/+2
|
* Upgrades to current https://github.com/solsson/dockerfiles/pull/5Staffan Olsson2017-07-239-9/+9
|
* Fixes posix compatibility for probesStaffan Olsson2017-07-232-4/+4
|
* Same startup as 51zooStaffan Olsson2017-06-281-2/+1
|
* Applies the limit to persistent zookeeper pods too. They seem more prone to ↵Staffan Olsson2017-06-281-0/+2
| | | | restarts than 51zoo.
* shell script is now osx, but no longer gnu :)Staffan Olsson2017-06-281-1/+1
|
* Upgrades to latest build from https://github.com/solsson/dockerfiles/pull/4, ↵Staffan Olsson2017-06-288-8/+8
| | | | with plain logging>=INFO config
* Limiting metrics' JVM to match resource limits. Still getting OOMKilled ↵Staffan Olsson2017-06-282-2/+4
| | | | though, but maybe half as often.
* Raises memory limit for metrics; got 10 OOMKilled per pod in the last 3 hoursStaffan Olsson2017-06-273-3/+3
|
* Reduces termination grace period for zookeeper because I fail to trigger ↵Staffan Olsson2017-06-272-2/+2
| | | | termination by signal
* Adds probes, but for Kafka I don't think it indicates readiness...Staffan Olsson2017-06-273-0/+30
| | | | | | | | | | | | | | | which might not matter because we no longer have a loadbalancing service. These probes won't catch all failure modes, but if they fail we're pretty sure the container is malfunctioning. I found some sources recommending ./bin/kafka-topics.sh for probes but to me it looks risky to introduce a dependency to some other service for such things. One such source is https://github.com/kubernetes/charts/pull/144 The zookeeper probe is from https://kubernetes.io/docs/tasks/configure-pod-container/configure-liveness-readiness-probes/ An issue is that zookeeper's logs are quite verbose for every probe.
* Reverts to default termination period, and uses bash for "shell form"...Staffan Olsson2017-06-273-6/+6
| | | | | | | | as Alpine's /bin/busybox (ash) does not forward signals, according to https://pracucci.com/graceful-shutdown-of-kubernetes-pods.html The reason for the termination period change is that we haven't observed any termination behavior yet so we can't know how slow it might be.
* Merge pull request #35 from Yolean/resource-limitssolsson2017-06-275-20/+74
|\ | | | | Apply resource limits based on tests with little load
| * Got quite repeatable OOMKilled on pzoo pods, so I figured it must be...resource-limitsStaffan Olsson2017-06-273-3/+3
| | | | | | | | in metrics becuase nither zoo nor kafka has limits
| * sStaffan Olsson2017-06-271-3/+3
| |
| * A monitoring-only pod uses 0m / ~32Mi resourcesStaffan Olsson2017-06-274-6/+62
| |
| * Removes volume claims documentation, as we've gone completely dynamicStaffan Olsson2017-06-271-14/+0
| |
| * Adds tentative resource requests, based on what idle pods use (though this ↵Staffan Olsson2017-06-273-0/+12
|/ | | | includes monitoring)
* Adds a test that produces a message that you can see in the logs of ↵Staffan Olsson2017-06-271-0/+24
| | | | 21consumer-test1
* Adds utility to update the kafka image, which we keep the same to minimize ↵Staffan Olsson2017-06-275-8/+12
| | | | pull waits
* Uses dynamically provisioned volume for Kafka too. It has matured, ...Staffan Olsson2017-06-274-106/+2
| | | | | simplifies use of multi-zone clusters, works in Minikube, and volumes are deleted when the PV is deleted (by manual kubectl).
* Merge pull request #33 from Yolean/zookeeper-datasolsson2017-06-276-16/+114
|\ | | | | Persistent volumes for Zookeeper
| * Forks can tweak storage classes, but here we want setup to be simple...zookeeper-dataStaffan Olsson2017-06-264-21/+1
| | | | | | | | | | | | and with the mix of PV and emptyDir there's no reason to make PVs faster than host disks. Use 10GB as it is the minimum for standard disks on GKE.
| * Merge pull request #34 from Yolean/zookeeper-availability-zonessolsson2017-06-265-8/+87
| |\ | | | | | | Suggest a mix of persistent and ephemeral data to improve reliability across zones
| | * A cluster in three availability zones now get one persistent zk each, and ↵zookeeper-availability-zonesStaffan Olsson2017-06-264-23/+15
| | | | | | | | | | | | two that can move automatically at node failures
| | * Creates identical definitions for a non-persistent zoo statefulsetStaffan Olsson2017-06-262-0/+85
| | |
| | * Makes persistence a fundamental attribute of the statefulsetStaffan Olsson2017-06-263-6/+8
| |/
| * Enables metrics export to Prometheus, but they look very uninteresting.Staffan Olsson2017-06-252-0/+18
| | | | | | | | The selected config is from the jmx_exporter examples.
| * Updates the readmeStaffan Olsson2017-06-253-7/+8
| |
generated by cgit v1.2.3 (git 2.39.1) at 2024-05-16 08:58:11 +0000