aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Deprecates our own statefulset pod label kafka-broker-idyolean-topic-managementStaffan Olsson2017-12-142-0/+3
|
* I find it scary when broker start logs:Staffan Olsson2017-12-141-0/+1
| | | | | | | log.dir = /tmp/kafka-logs log.dirs = /var/lib/kafka/data/topics but this is the lesser of two evils compared to duplicate values
* Merge branch 'topic-config-together' into yolean-topic-managementStaffan Olsson2017-12-132-60/+21
|\
| * Now was a good time to get rid of the last --overrideStaffan Olsson2017-12-132-3/+1
| | | | | | | | as we now encourage close scrutiny of the config file.
| * Moves the essential data path config to theStaffan Olsson2017-12-132-3/+1
| | | | | | | | config location suggested by Kafka's sample conf.
| * Permanent retention is a friendlier default,Staffan Olsson2017-12-132-3/+1
| | | | | | | | | | | | | | and easy to reconfigure per topic as they grow. We already had that, but this branch cares about grouping such conf. It also encourages topic defaults geared towards persistent data.
| * Places the values that are most likely to need attention at the topStaffan Olsson2017-12-131-52/+19
|/
* Gathers the config that has to do with topic creationStaffan Olsson2017-12-132-2/+3
| | | | | | | in one place. These values are critical to maintain for those, like us, who make use of auto create topics for production data. Also a step towards #72 and #77.
* Enables auto create topics because there's use cases for addingStaffan Olsson2017-12-131-1/+1
| | | | | | | topics at runtime, such as splitting a stream based on some business enum. Producers and Kafka Streams apps would otherwise need to set up an AdminClient to do that. This reverts commit: 0681cc515fa1c505b905ef60c7d3132e8d7510af
* Lets clusters define their preferred (prod) replication factorStaffan Olsson2017-12-011-0/+3
| | | | | so that we can omit replication-factor when creating topics, as we benefit from reusing such commands or definitions across dev-qa-prod.
* Removes some "platform" ideas from readme as they need real PRsStaffan Olsson2017-12-011-2/+0
| | | | | | | | | | | | | | | rather than a couple of sentences. In response to #103. Regarding Kafka Streams I no longer think we need examples, because any dockerized streams application can run as a deployment. An example of Kafka Connect would be useful, in particular the combination of a custom image (or one with stock connectors) and a Connect cluster manifest. This is tracked in #69, but not the relation to https://github.com/solsson/dockerfiles/tree/master/connect-* KSQL (#68) is highly interesting.
* Merge pull request #96 from Yolean/enable-broker-jmxsolsson2017-11-101-0/+4
|\ | | | | Enable broker JMX_PORT 5555
| * Exposes JMX for brokers, to typical monitoring setupsenable-broker-jmxStaffan Olsson2017-11-091-0/+4
| | | | | | | | | | | | | | Already included in #49, but here we don't add any export container to the pod. Can be utilized by kafka-manager (#83) - just tick the JMX box when adding a cluster - to see bytes in/out rates.
* | Merge pull request #94 from Yolean/restore-ondelete-behaviorv3.0.1solsson2017-11-093-0/+6
|\ \ | |/ |/| Disables RollingUpdate, i.e. reverts to pre-1.7 behavior
| * Sets OnDelete explicitly, as RollingUpdate is a new defaultrestore-ondelete-behaviorStaffan Olsson2017-11-093-0/+6
|/ | | | | | | | Due to the use of config map for most of the conifg, RollingUpdate will be surprising, while still not preventing running pods that don't have the applied configuration. An automation effort would be required for proper RollingUpdate behavior.
* Merge pull request #90 from Yolean/1.8-manifestsv3.0.0solsson2017-11-0914-65/+27
|\ | | | | Updates manifests to beta2 workload API, k8s 1.8
| * Fixes a test issue at start and at consumer error1.8-manifestsStaffan Olsson2017-11-091-0/+2
| |
| * Improves placement of temporary noticeStaffan Olsson2017-11-091-4/+2
| |
| * Makes kafka a feature folder too, consistent with the restStaffan Olsson2017-11-099-7/+7
| |
| * Leaving the addon concept in favor of opt-in folder applyStaffan Olsson2017-11-091-51/+0
| |
| * Updates RBAC to 1.8Staffan Olsson2017-11-091-2/+2
| |
| * Updates deployment to beta2 workload API, k8s 1.8Staffan Olsson2017-11-091-1/+1
| |
| * Updates statefulset to beta2 workload API, k8s 1.8Staffan Olsson2017-11-093-3/+16
|/
* Merge pull request #79 from Yolean/bootstrap-testsolsson2017-11-095-216/+348
|\ | | | | Update tests to act as long-running consumers
| * Adapts readme to 56aad28bootstrap-testStaffan Olsson2017-11-091-1/+1
| |
| * Use the bootstrap service (#52) for repeated bootstrapsStaffan Olsson2017-11-091-1/+1
| | | | | | | | The test should still pass if any single broker is down.
| * Naming fixStaffan Olsson2017-11-091-3/+3
| |
| * Switches to ReplicaSet from Deployment, because configmap ...Staffan Olsson2017-11-092-6/+2
| | | | | | | | | | resources as scripts void the Deployment behavior anyway. And besides, there's no need to manage these tests like production resources.
| * Identifies topic jobs, and the resulting pods, by nameStaffan Olsson2017-11-092-2/+2
| |
| * Avoids overlap in matchLabels between test deploymentsStaffan Olsson2017-11-092-4/+4
| |
| * Renames test to focues on the type of client usedStaffan Olsson2017-11-091-8/+8
| |
| * Merge branch 'bootstrap-test-console-too' into bootstrap-testStaffan Olsson2017-11-093-119/+174
| |\
| | * Kafkacat support for -k has been merged nowStaffan Olsson2017-11-091-3/+3
| | |
| | * kafkacat based on same image as solsson/kafka:1.0.0Staffan Olsson2017-11-091-1/+1
| | |
| | * Fixed key option changed in the kafkacat PRStaffan Olsson2017-11-091-1/+1
| | |
| | * Adds a key to each message, while testing ...Staffan Olsson2017-11-091-4/+4
| | | | | | | | | | | | for regressions with https://github.com/solsson/kafkacat/tree/fixedkey
| | * Converts (console-) produce-consume test to online ...Staffan Olsson2017-11-092-113/+168
| |/ | | | | | | | | | | | | style like kafkacat, but without the timestamp diff feature because I couldn't get message timestamp out of the console consumer. Also I had to increase PC_WAIT.
| * TODO I guess labels must be unique for each test now?Staffan Olsson2017-11-091-2/+6
| |
| * Return to grouping the tests in a namespace, ...Staffan Olsson2017-11-091-3/+3
| | | | | | | | if you haven't created it, you probably don't want the tests.
| * Divides a couple of librdkafka timoeuts by 100Staffan Olsson2017-11-091-2/+3
| |
| * Don't fail the test if bootstrap fails ...Staffan Olsson2017-11-091-9/+15
| | | | | | | | but only if producers and consumers (which must maintain a broker list) fail
| * Logs broker connect/disconnect stateStaffan Olsson2017-11-091-10/+35
| |
| * More ideasStaffan Olsson2017-11-091-18/+42
| |
| * not workingStaffan Olsson2017-11-091-2/+17
| |
| * Converted to latest Yolean/kube-test boilerplateStaffan Olsson2017-11-091-22/+28
| |
* | Merge pull request #81 from Yolean/kafka-readiness-tcpsolsson2017-11-091-5/+3
|\ \ | | | | | | Use Kubernetes native TCP readiness probe for kafka
| * | Actually, for readiness not liveness, let's go offline fast ...kafka-readiness-tcpStaffan Olsson2017-11-071-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | and trust alarms on Under-replicated Partitions to let us know when something is really wrong. Do clients actually care about Readiness? The bootstrap service (https://github.com/Yolean/kubernetes-kafka/pull/52) will definitely care, which is good. The `broker` service, that the StatefulSet manifest depends on (https://github.com/Yolean/kubernetes-kafka/blob/v2.1.0/50kafka.yml#L7) for naming, is without `publishNotReadyAddresses`. Clients will bootstrap, get the individual DNS names of brokers, resolve those addresses and connect directly to pods.
| * | Timeout was 1s with the old /bin/sh exec, now it's interval -1 sStaffan Olsson2017-11-071-1/+1
| | |
| * | More lightweight kafka probe, essentially the same thingStaffan Olsson2017-10-161-5/+3
| | |
* | | Merge pull request #85 from Yolean/storage-classes-1.8solsson2017-11-097-9/+37
|\ \ \ | | | | | | | | Use k8s 1.8 storage class syntax and set Retain by default
generated by cgit v1.2.3 (git 2.39.1) at 2024-05-10 20:28:27 +0000