aboutsummaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
* Removes outdated comment; these tests can't grow more complexStaffan Olsson2018-02-021-6/+0
|
* Adds a console based way to check for topics configured with 1 replicaStaffan Olsson2018-02-021-0/+98
|
* Updates the basic kafkacat test to use a consumer group of size 1Staffan Olsson2018-02-021-1/+4
|
* These properties have good defaults, 3 and 2 respectively,Staffan Olsson2018-02-021-2/+2
| | | | | which match the default.replication.factor and min.insync.replicas that we've changed to now.
* Merge branch 'use-default-replication-factor' into fix-offset-topic-replicationStaffan Olsson2018-02-012-4/+0
|\
| * Uses brokers' default replication factor for explicit topic creationuse-default-replication-factorStaffan Olsson2018-01-222-4/+0
| |
* | Reverts previous commit and uses the documented default insteadStaffan Olsson2018-02-011-2/+1
| |
* | Should be larger than or equal min.insync.replicasStaffan Olsson2018-02-011-0/+1
| |
* | Moves outside host details to annotations,outside-host-as-annotationStaffan Olsson2018-01-281-1/+5
|/ | | | | as DNS names may exceed the 63 char limit on label values and they're not too useful for pod matching in services etc.
* Sets all labels at the end of the init script,broker-init-pod-lablerStaffan Olsson2018-01-081-5/+8
| | | | | | to speed up a bit and reduce the risk that it interferes with actual config. Also if the init script goes crash looping you won't get warnings about labels already being set.
* Sets other useful labels, for #78 and #56Staffan Olsson2018-01-081-2/+5
|
* Revert "Deprecates our own statefulset pod label kafka-broker-id"Staffan Olsson2018-01-081-1/+0
| | | | This reverts commit 096e3bdfba31d2918520011886a6a0d1f1b08c84.
* cleanup: Minor cleanupsSteve Coffman2018-01-053-6/+5
|
* Deprecates our own statefulset pod label kafka-broker-idyolean-topic-managementStaffan Olsson2017-12-141-0/+1
|
* I find it scary when broker start logs:Staffan Olsson2017-12-141-0/+1
| | | | | | | log.dir = /tmp/kafka-logs log.dirs = /var/lib/kafka/data/topics but this is the lesser of two evils compared to duplicate values
* Now was a good time to get rid of the last --overrideStaffan Olsson2017-12-132-3/+1
| | | | as we now encourage close scrutiny of the config file.
* Moves the essential data path config to theStaffan Olsson2017-12-132-3/+1
| | | | config location suggested by Kafka's sample conf.
* Permanent retention is a friendlier default,Staffan Olsson2017-12-132-3/+1
| | | | | | | and easy to reconfigure per topic as they grow. We already had that, but this branch cares about grouping such conf. It also encourages topic defaults geared towards persistent data.
* Places the values that are most likely to need attention at the topStaffan Olsson2017-12-131-52/+19
|
* Gathers the config that has to do with topic creationStaffan Olsson2017-12-132-2/+3
| | | | | | | in one place. These values are critical to maintain for those, like us, who make use of auto create topics for production data. Also a step towards #72 and #77.
* Enables auto create topics because there's use cases for addingStaffan Olsson2017-12-131-1/+1
| | | | | | | topics at runtime, such as splitting a stream based on some business enum. Producers and Kafka Streams apps would otherwise need to set up an AdminClient to do that. This reverts commit: 0681cc515fa1c505b905ef60c7d3132e8d7510af
* Lets clusters define their preferred (prod) replication factorStaffan Olsson2017-12-011-0/+3
| | | | | so that we can omit replication-factor when creating topics, as we benefit from reusing such commands or definitions across dev-qa-prod.
* Merge pull request #96 from Yolean/enable-broker-jmxsolsson2017-11-101-0/+4
|\ | | | | Enable broker JMX_PORT 5555
| * Exposes JMX for brokers, to typical monitoring setupsenable-broker-jmxStaffan Olsson2017-11-091-0/+4
| | | | | | | | | | | | | | Already included in #49, but here we don't add any export container to the pod. Can be utilized by kafka-manager (#83) - just tick the JMX box when adding a cluster - to see bytes in/out rates.
* | Sets OnDelete explicitly, as RollingUpdate is a new defaultrestore-ondelete-behaviorStaffan Olsson2017-11-091-0/+2
|/ | | | | | | | Due to the use of config map for most of the conifg, RollingUpdate will be surprising, while still not preventing running pods that don't have the applied configuration. An automation effort would be required for proper RollingUpdate behavior.
* Fixes a test issue at start and at consumer error1.8-manifestsStaffan Olsson2017-11-091-0/+2
|
* Makes kafka a feature folder too, consistent with the restStaffan Olsson2017-11-098-0/+741