aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* With stock config we have to change zookeeper lookup from the default localhostkafka-011-config-mapStaffan Olsson2017-07-251-0/+1
|
* Validates against a gotchaStaffan Olsson2017-07-251-0/+2
|
* Use config map's config instead of image'sStaffan Olsson2017-07-251-0/+6
|
* Adds yaml with the default .properties from 0.11.0.0Staffan Olsson2017-07-231-0/+239
|
* Default shell on debian should forward signals properlyStaffan Olsson2017-07-233-3/+3
|
* solsson/kafka on debian restores installation path to /opt/kafkaStaffan Olsson2017-07-232-2/+2
|
* Upgrades to current https://github.com/solsson/dockerfiles/pull/5Staffan Olsson2017-07-239-9/+9
|
* Fixes posix compatibility for probesStaffan Olsson2017-07-232-4/+4
|
* Same startup as 51zooStaffan Olsson2017-06-281-2/+1
|
* Applies the limit to persistent zookeeper pods too. They seem more prone to ↵Staffan Olsson2017-06-281-0/+2
| | | | restarts than 51zoo.
* shell script is now osx, but no longer gnu :)Staffan Olsson2017-06-281-1/+1
|
* Upgrades to latest build from https://github.com/solsson/dockerfiles/pull/4, ↵Staffan Olsson2017-06-288-8/+8
| | | | with plain logging>=INFO config
* Limiting metrics' JVM to match resource limits. Still getting OOMKilled ↵Staffan Olsson2017-06-282-2/+4
| | | | though, but maybe half as often.
* Raises memory limit for metrics; got 10 OOMKilled per pod in the last 3 hoursStaffan Olsson2017-06-273-3/+3
|
* Reduces termination grace period for zookeeper because I fail to trigger ↵Staffan Olsson2017-06-272-2/+2
| | | | termination by signal
* Adds probes, but for Kafka I don't think it indicates readiness...Staffan Olsson2017-06-273-0/+30
| | | | | | | | | | | | | | | which might not matter because we no longer have a loadbalancing service. These probes won't catch all failure modes, but if they fail we're pretty sure the container is malfunctioning. I found some sources recommending ./bin/kafka-topics.sh for probes but to me it looks risky to introduce a dependency to some other service for such things. One such source is https://github.com/kubernetes/charts/pull/144 The zookeeper probe is from https://kubernetes.io/docs/tasks/configure-pod-container/configure-liveness-readiness-probes/ An issue is that zookeeper's logs are quite verbose for every probe.
* Reverts to default termination period, and uses bash for "shell form"...Staffan Olsson2017-06-273-6/+6
| | | | | | | | as Alpine's /bin/busybox (ash) does not forward signals, according to https://pracucci.com/graceful-shutdown-of-kubernetes-pods.html The reason for the termination period change is that we haven't observed any termination behavior yet so we can't know how slow it might be.
* Merge pull request #35 from Yolean/resource-limitssolsson2017-06-275-20/+74
|\ | | | | Apply resource limits based on tests with little load
| * Got quite repeatable OOMKilled on pzoo pods, so I figured it must be...resource-limitsStaffan Olsson2017-06-273-3/+3
| | | | | | | | in metrics becuase nither zoo nor kafka has limits
| * sStaffan Olsson2017-06-271-3/+3
| |
| * A monitoring-only pod uses 0m / ~32Mi resourcesStaffan Olsson2017-06-274-6/+62
| |
| * Removes volume claims documentation, as we've gone completely dynamicStaffan Olsson2017-06-271-14/+0
| |
| * Adds tentative resource requests, based on what idle pods use (though this ↵Staffan Olsson2017-06-273-0/+12
|/ | | | includes monitoring)
* Adds a test that produces a message that you can see in the logs of ↵Staffan Olsson2017-06-271-0/+24
| | | | 21consumer-test1
* Adds utility to update the kafka image, which we keep the same to minimize ↵Staffan Olsson2017-06-275-8/+12
| | | | pull waits
* Uses dynamically provisioned volume for Kafka too. It has matured, ...Staffan Olsson2017-06-274-106/+2
| | | | | simplifies use of multi-zone clusters, works in Minikube, and volumes are deleted when the PV is deleted (by manual kubectl).
* Merge pull request #33 from Yolean/zookeeper-datasolsson2017-06-276-16/+114
|\ | | | | Persistent volumes for Zookeeper
| * Forks can tweak storage classes, but here we want setup to be simple...zookeeper-dataStaffan Olsson2017-06-264-21/+1
| | | | | | | | | | | | and with the mix of PV and emptyDir there's no reason to make PVs faster than host disks. Use 10GB as it is the minimum for standard disks on GKE.
| * Merge pull request #34 from Yolean/zookeeper-availability-zonessolsson2017-06-265-8/+87
| |\ | | | | | | Suggest a mix of persistent and ephemeral data to improve reliability across zones
| | * A cluster in three availability zones now get one persistent zk each, and ↵zookeeper-availability-zonesStaffan Olsson2017-06-264-23/+15
| | | | | | | | | | | | two that can move automatically at node failures
| | * Creates identical definitions for a non-persistent zoo statefulsetStaffan Olsson2017-06-262-0/+85
| | |
| | * Makes persistence a fundamental attribute of the statefulsetStaffan Olsson2017-06-263-6/+8
| |/
| * Enables metrics export to Prometheus, but they look very uninteresting.Staffan Olsson2017-06-252-0/+18
| | | | | | | | The selected config is from the jmx_exporter examples.
| * Updates the readmeStaffan Olsson2017-06-253-7/+8
| |
| * Verified the volume setup with MinikubeStaffan Olsson2017-06-251-0/+5
| |
| * Uses a named storage class so you can select volume type specifically for zooStaffan Olsson2017-06-252-3/+18
| |
* | Merge partial branch 'zookeeper-data', the switch to kafka imageStaffan Olsson2017-06-253-12/+43
|\|
| * Uses the same data path convention as zookeeper, from Confluent PlatformStaffan Olsson2017-06-251-2/+2
| |
| * Uses the kafka image as Zookeeper service...Staffan Olsson2017-06-252-10/+41
|/ | | | | | to reduce image download times and use a supported version. Initial config is from https://zookeeper.apache.org/doc/r3.4.10/zookeeperAdmin.html#sc_zkMulitServerSetup and the fixes for stateful set are from https://github.com/solsson/zookeeper-docker
* Reindents yaml to match the rest of this repo, and most examples out thereStaffan Olsson2017-06-251-22/+22
|
* Merge pull request #31 from Yolean/metrics-via-jmxsolsson2017-06-252-0/+18
|\ | | | | Add metrics exporter for Prometheus
| * Use a specific build, ↵metrics-via-jmxStaffan Olsson2017-06-251-1/+1
| | | | | | | | github.com/solsson/dockerfiles/commit/81e8e4c20be19835d4036db1c975ff17455fe7e7
| * Adds metrics exporter for PrometheusStaffan Olsson2017-06-252-0/+18
|/
* Support for generic image results in a verbose startup command, make it git ↵Staffan Olsson2017-06-251-1/+6
| | | | friendly
* Merge branch 'log-dir-inside-volume' into kafka-011Staffan Olsson2017-06-251-1/+1
|\
| * Default log dir is /tmp/kafka-logs so it should be changed to be inside the ↵Staffan Olsson2017-06-251-1/+1
|/ | | | persistent volume mount
* Uses the new small image, with only selected jars from the buildStaffan Olsson2017-06-251-1/+1
|
* Merge branch 'zookeeper-update' into kafka-011Staffan Olsson2017-06-252-6/+3
|\
| * Removes out-of-date zookeeper infoStaffan Olsson2017-06-251-5/+2
| |
| * We do need the bind address sed. This image logs the at start, to reduce the ↵Staffan Olsson2017-06-251-1/+1
| | | | | | | | element of surprise.
generated by cgit v1.2.3 (git 2.39.1) at 2024-05-15 11:48:02 +0000