aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Got quite repeatable OOMKilled on pzoo pods, so I figured it must be...resource-limitsStaffan Olsson2017-06-273-3/+3
| | | | in metrics becuase nither zoo nor kafka has limits
* sStaffan Olsson2017-06-271-3/+3
|
* A monitoring-only pod uses 0m / ~32Mi resourcesStaffan Olsson2017-06-274-6/+62
|
* Removes volume claims documentation, as we've gone completely dynamicStaffan Olsson2017-06-271-14/+0
|
* Adds tentative resource requests, based on what idle pods use (though this ↵Staffan Olsson2017-06-273-0/+12
| | | | includes monitoring)
* Adds a test that produces a message that you can see in the logs of ↵Staffan Olsson2017-06-271-0/+24
| | | | 21consumer-test1
* Adds utility to update the kafka image, which we keep the same to minimize ↵Staffan Olsson2017-06-275-8/+12
| | | | pull waits
* Uses dynamically provisioned volume for Kafka too. It has matured, ...Staffan Olsson2017-06-274-106/+2
| | | | | simplifies use of multi-zone clusters, works in Minikube, and volumes are deleted when the PV is deleted (by manual kubectl).
* Merge pull request #33 from Yolean/zookeeper-datasolsson2017-06-276-16/+114
|\ | | | | Persistent volumes for Zookeeper
| * Forks can tweak storage classes, but here we want setup to be simple...zookeeper-dataStaffan Olsson2017-06-264-21/+1
| | | | | | | | | | | | and with the mix of PV and emptyDir there's no reason to make PVs faster than host disks. Use 10GB as it is the minimum for standard disks on GKE.
| * Merge pull request #34 from Yolean/zookeeper-availability-zonessolsson2017-06-265-8/+87
| |\ | | | | | | Suggest a mix of persistent and ephemeral data to improve reliability across zones
| | * A cluster in three availability zones now get one persistent zk each, and ↵zookeeper-availability-zonesStaffan Olsson2017-06-264-23/+15
| | | | | | | | | | | | two that can move automatically at node failures
| | * Creates identical definitions for a non-persistent zoo statefulsetStaffan Olsson2017-06-262-0/+85
| | |
| | * Makes persistence a fundamental attribute of the statefulsetStaffan Olsson2017-06-263-6/+8
| |/
| * Enables metrics export to Prometheus, but they look very uninteresting.Staffan Olsson2017-06-252-0/+18
| | | | | | | | The selected config is from the jmx_exporter examples.
| * Updates the readmeStaffan Olsson2017-06-253-7/+8
| |
| * Verified the volume setup with MinikubeStaffan Olsson2017-06-251-0/+5
| |
| * Uses a named storage class so you can select volume type specifically for zooStaffan Olsson2017-06-252-3/+18
| |
* | Merge partial branch 'zookeeper-data', the switch to kafka imageStaffan Olsson2017-06-253-12/+43
|\|
| * Uses the same data path convention as zookeeper, from Confluent PlatformStaffan Olsson2017-06-251-2/+2
| |
| * Uses the kafka image as Zookeeper service...Staffan Olsson2017-06-252-10/+41
|/ | | | | | to reduce image download times and use a supported version. Initial config is from https://zookeeper.apache.org/doc/r3.4.10/zookeeperAdmin.html#sc_zkMulitServerSetup and the fixes for stateful set are from https://github.com/solsson/zookeeper-docker
* Reindents yaml to match the rest of this repo, and most examples out thereStaffan Olsson2017-06-251-22/+22
|
* Merge pull request #31 from Yolean/metrics-via-jmxsolsson2017-06-252-0/+18
|\ | | | | Add metrics exporter for Prometheus
| * Use a specific build, ↵metrics-via-jmxStaffan Olsson2017-06-251-1/+1
| | | | | | | | github.com/solsson/dockerfiles/commit/81e8e4c20be19835d4036db1c975ff17455fe7e7
| * Adds metrics exporter for PrometheusStaffan Olsson2017-06-252-0/+18
|/
* Support for generic image results in a verbose startup command, make it git ↵Staffan Olsson2017-06-251-1/+6
| | | | friendly
* Merge branch 'log-dir-inside-volume' into kafka-011Staffan Olsson2017-06-251-1/+1
|\
| * Default log dir is /tmp/kafka-logs so it should be changed to be inside the ↵Staffan Olsson2017-06-251-1/+1
|/ | | | persistent volume mount
* Uses the new small image, with only selected jars from the buildStaffan Olsson2017-06-251-1/+1
|
* Merge branch 'zookeeper-update' into kafka-011Staffan Olsson2017-06-252-6/+3
|\
| * Removes out-of-date zookeeper infoStaffan Olsson2017-06-251-5/+2
| |
| * We do need the bind address sed. This image logs the at start, to reduce the ↵Staffan Olsson2017-06-251-1/+1
| | | | | | | | element of surprise.
| * Uses zookeeper without the bind address sedStaffan Olsson2017-06-251-1/+1
| |
| * Upgrades zookeeper to latestStaffan Olsson2017-06-251-1/+1
|/
* Merge branch 'no-roundrobin-service' into kafka-011Staffan Olsson2017-06-256-16/+9
|\
| * Borrows string trick from https://github.com/kubernetes/charts/Staffan Olsson2017-06-251-1/+1
| |
| * Reuses the statefulset's image in test pods, without tag duplication...Staffan Olsson2017-06-254-4/+8
| | | | | | | | Works when scheduled on the same node(s)
| * Modern kafka clients use a bootstrap servers list to connect...Staffan Olsson2017-06-231-11/+0
|/ | | | | | | which should be resolvable to individual brokers. Thus we should avoid the gotcha with a regular kubernetes service that you need to replicate everything to every broker (#21). See 20dns.yml for how to resolve brokers.
* Upgrade to development build of the latest 0.11 RCStaffan Olsson2017-06-231-1/+1
|
* Merge branch 'use-generic-kafka-image' into kafka-011Staffan Olsson2017-06-233-145/+2
|\
| * Use a generic kafka image and explicitly override "eligible for deletion"Staffan Olsson2017-06-233-145/+2
|/
* 0.10.2 adds to the confusion about consumer args, #21kafka-0.10.2.0Staffan Olsson2017-06-231-2/+2
|
* Makes PV match PVC, avoiding small initial storage becase resize is ↵Staffan Olsson2017-06-233-5/+5
| | | | difficult in GKE
* Adds namespace to kubectl commands, matching that in yamlsStaffan Olsson2017-06-231-3/+3
|
* Upgrades Scala to latest, supported as of Kafka 0.10.2Staffan Olsson2017-06-231-2/+2
|
* Upgrades Kafka to latest releaseStaffan Olsson2017-06-231-1/+1
|
* Uses latest jre imageStaffan Olsson2017-06-231-1/+1
|
* Adds Apache 2.0 license fileStaffan Olsson2017-03-071-0/+177
|
* Merge pull request #19 from Yolean/kafka-0.10.1.1solsson2017-02-143-3/+3
|\ | | | | Bump Kafka to 0.10.1.1
| * Uses the latest docker hub buildkafka-0.10.1.1Staffan Olsson2017-02-142-2/+2
| |