aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Adds a servicelinkedin-kafka-monitorStaffan Olsson2017-11-291-0/+12
|
* Adds linkedin/kafka-monitor, no need for a serviceStaffan Olsson2017-11-101-0/+23
| | | | | | Instead you need some kind of metrics export. Currently I only get a lot of `records-produced-total` but no latencies etc.
* Merge pull request #96 from Yolean/enable-broker-jmxsolsson2017-11-101-0/+4
|\ | | | | Enable broker JMX_PORT 5555
| * Exposes JMX for brokers, to typical monitoring setupsenable-broker-jmxStaffan Olsson2017-11-091-0/+4
| | | | | | | | | | | | | | Already included in #49, but here we don't add any export container to the pod. Can be utilized by kafka-manager (#83) - just tick the JMX box when adding a cluster - to see bytes in/out rates.
* | Merge pull request #94 from Yolean/restore-ondelete-behaviorv3.0.1solsson2017-11-093-0/+6
|\ \ | |/ |/| Disables RollingUpdate, i.e. reverts to pre-1.7 behavior
| * Sets OnDelete explicitly, as RollingUpdate is a new defaultrestore-ondelete-behaviorStaffan Olsson2017-11-093-0/+6
|/ | | | | | | | Due to the use of config map for most of the conifg, RollingUpdate will be surprising, while still not preventing running pods that don't have the applied configuration. An automation effort would be required for proper RollingUpdate behavior.
* Merge pull request #90 from Yolean/1.8-manifestsv3.0.0solsson2017-11-0914-65/+27
|\ | | | | Updates manifests to beta2 workload API, k8s 1.8
| * Fixes a test issue at start and at consumer error1.8-manifestsStaffan Olsson2017-11-091-0/+2
| |
| * Improves placement of temporary noticeStaffan Olsson2017-11-091-4/+2
| |
| * Makes kafka a feature folder too, consistent with the restStaffan Olsson2017-11-099-7/+7
| |
| * Leaving the addon concept in favor of opt-in folder applyStaffan Olsson2017-11-091-51/+0
| |
| * Updates RBAC to 1.8Staffan Olsson2017-11-091-2/+2
| |
| * Updates deployment to beta2 workload API, k8s 1.8Staffan Olsson2017-11-091-1/+1
| |
| * Updates statefulset to beta2 workload API, k8s 1.8Staffan Olsson2017-11-093-3/+16
|/
* Merge pull request #79 from Yolean/bootstrap-testsolsson2017-11-095-216/+348
|\ | | | | Update tests to act as long-running consumers
| * Adapts readme to 56aad28bootstrap-testStaffan Olsson2017-11-091-1/+1
| |
| * Use the bootstrap service (#52) for repeated bootstrapsStaffan Olsson2017-11-091-1/+1
| | | | | | | | The test should still pass if any single broker is down.
| * Naming fixStaffan Olsson2017-11-091-3/+3
| |
| * Switches to ReplicaSet from Deployment, because configmap ...Staffan Olsson2017-11-092-6/+2
| | | | | | | | | | resources as scripts void the Deployment behavior anyway. And besides, there's no need to manage these tests like production resources.
| * Identifies topic jobs, and the resulting pods, by nameStaffan Olsson2017-11-092-2/+2
| |
| * Avoids overlap in matchLabels between test deploymentsStaffan Olsson2017-11-092-4/+4
| |
| * Renames test to focues on the type of client usedStaffan Olsson2017-11-091-8/+8
| |
| * Merge branch 'bootstrap-test-console-too' into bootstrap-testStaffan Olsson2017-11-093-119/+174
| |\
| | * Kafkacat support for -k has been merged nowStaffan Olsson2017-11-091-3/+3
| | |
| | * kafkacat based on same image as solsson/kafka:1.0.0Staffan Olsson2017-11-091-1/+1
| | |
| | * Fixed key option changed in the kafkacat PRStaffan Olsson2017-11-091-1/+1
| | |
| | * Adds a key to each message, while testing ...Staffan Olsson2017-11-091-4/+4
| | | | | | | | | | | | for regressions with https://github.com/solsson/kafkacat/tree/fixedkey
| | * Converts (console-) produce-consume test to online ...Staffan Olsson2017-11-092-113/+168
| |/ | | | | | | | | | | | | style like kafkacat, but without the timestamp diff feature because I couldn't get message timestamp out of the console consumer. Also I had to increase PC_WAIT.
| * TODO I guess labels must be unique for each test now?Staffan Olsson2017-11-091-2/+6
| |
| * Return to grouping the tests in a namespace, ...Staffan Olsson2017-11-091-3/+3
| | | | | | | | if you haven't created it, you probably don't want the tests.
| * Divides a couple of librdkafka timoeuts by 100Staffan Olsson2017-11-091-2/+3
| |
| * Don't fail the test if bootstrap fails ...Staffan Olsson2017-11-091-9/+15
| | | | | | | | but only if producers and consumers (which must maintain a broker list) fail
| * Logs broker connect/disconnect stateStaffan Olsson2017-11-091-10/+35
| |
| * More ideasStaffan Olsson2017-11-091-18/+42
| |
| * not workingStaffan Olsson2017-11-091-2/+17
| |
| * Converted to latest Yolean/kube-test boilerplateStaffan Olsson2017-11-091-22/+28
| |
* | Merge pull request #81 from Yolean/kafka-readiness-tcpsolsson2017-11-091-5/+3
|\ \ | | | | | | Use Kubernetes native TCP readiness probe for kafka
| * | Actually, for readiness not liveness, let's go offline fast ...kafka-readiness-tcpStaffan Olsson2017-11-071-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | and trust alarms on Under-replicated Partitions to let us know when something is really wrong. Do clients actually care about Readiness? The bootstrap service (https://github.com/Yolean/kubernetes-kafka/pull/52) will definitely care, which is good. The `broker` service, that the StatefulSet manifest depends on (https://github.com/Yolean/kubernetes-kafka/blob/v2.1.0/50kafka.yml#L7) for naming, is without `publishNotReadyAddresses`. Clients will bootstrap, get the individual DNS names of brokers, resolve those addresses and connect directly to pods.
| * | Timeout was 1s with the old /bin/sh exec, now it's interval -1 sStaffan Olsson2017-11-071-1/+1
| | |
| * | More lightweight kafka probe, essentially the same thingStaffan Olsson2017-10-161-5/+3
| | |
* | | Merge pull request #85 from Yolean/storage-classes-1.8solsson2017-11-097-9/+37
|\ \ \ | | | | | | | | Use k8s 1.8 storage class syntax and set Retain by default
| * | | I don't know if Retain makes any difference in minikube,storage-classes-1.8Staffan Olsson2017-11-092-0/+2
| | | | | | | | | | | | | | | | but it's a sensible recommendation for storage classes.
| * | | The configure/ folder is meant as a collection of examples,Staffan Olsson2017-11-093-1/+1
| | | | | | | | | | | | | | | | for the choices you'll have to make for any kafka cluster.
| * | | Uses the new storage class field, requires 1.8Staffan Olsson2017-11-095-12/+4
| | | |
| * | | Suggests a single configuration/, as a collection of examplesStaffan Olsson2017-11-093-1/+1
| | | |
| * | | Adds storage class for kafka brokersStaffan Olsson2017-11-093-0/+14
| | | |
| * | | Adds storage class for Zookeeper, with sample manifestsStaffan Olsson2017-11-094-1/+21
|/ / / | | | | | | | | | This reverts commit efb1019fd9881f316e0ee355cbafc26e3d146be2.
* | | Merge pull request #83 from Yolean/yahoo-kafka-managersolsson2017-11-092-0/+38
|\ \ \ | |_|/ |/| | Adds yahoo/kafka-manger
| * | Adds Yahoo/kafka-manger, all defaults, and you need to "Add cluster"yahoo-kafka-managerStaffan Olsson2017-10-212-0/+38
| |/
* | Merge pull request #52 from Yolean/addon-bootstrap-servicesolsson2017-11-071-0/+11
|\ \ | | | | | | Addon: bootstrap.kafka service with current brokers as endpoint