Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Merge pull request #140 from Yolean/fix-offset-topic-replication | solsson | 2018-02-03 | 4 | -11/+106 |
|\ | | | | | Set internal replication factors to match default and min.insync.replicas | ||||
| * | Bumps kafka-manager to 1.3.3.16fix-offset-topic-replication | Staffan Olsson | 2018-02-02 | 1 | -1/+1 |
| | | |||||
| * | Removes outdated comment; these tests can't grow more complex | Staffan Olsson | 2018-02-02 | 1 | -6/+0 |
| | | |||||
| * | Adds a console based way to check for topics configured with 1 replica | Staffan Olsson | 2018-02-02 | 1 | -0/+98 |
| | | |||||
| * | Updates the basic kafkacat test to use a consumer group of size 1 | Staffan Olsson | 2018-02-02 | 1 | -1/+4 |
| | | |||||
| * | These properties have good defaults, 3 and 2 respectively, | Staffan Olsson | 2018-02-02 | 1 | -2/+2 |
| | | | | | | | | | | which match the default.replication.factor and min.insync.replicas that we've changed to now. | ||||
| * | Merge branch 'use-default-replication-factor' into fix-offset-topic-replication | Staffan Olsson | 2018-02-01 | 2 | -4/+0 |
| |\ | |||||
| * | | Reverts previous commit and uses the documented default instead | Staffan Olsson | 2018-02-01 | 1 | -2/+1 |
| | | | |||||
| * | | Should be larger than or equal min.insync.replicas | Staffan Olsson | 2018-02-01 | 1 | -0/+1 |
| | | | |||||
* | | | Merge pull request #95 from Yolean/ops-jobs | solsson | 2018-02-03 | 5 | -0/+217 |
|\ \ \ | | | | | | | | | Add Jobs and tests for common maintenance operations | ||||
| * | | | Text fixops-jobs | Staffan Olsson | 2018-02-02 | 1 | -2/+2 |
| | | | | |||||
| * | | | Merge branch 'increase-replication-factor' into ops-jobs | Staffan Olsson | 2018-02-02 | 2 | -0/+75 |
| |\ \ \ | | | | | | | | | | | | | | | | motivated by https://github.com/Yolean/kubernetes-kafka/pull/140 | ||||
| | * | | | Explains why this operation is here | Staffan Olsson | 2018-02-02 | 1 | -0/+10 |
| | | | | | |||||
| | * | | | Clarifies output a bit more | Staffan Olsson | 2018-02-02 | 1 | -1/+2 |
| | | | | | |||||
| | * | | | Got weird overlapping output | Staffan Olsson | 2018-02-02 | 1 | -0/+1 |
| | | | | | |||||
| | * | | | Adds the necessary json mod to require more replicas, | Staffan Olsson | 2018-02-02 | 1 | -5/+17 |
| | | | | | | | | | | | | | | | | | | | | which seems to be equivalent to setting replication.factor 3 at topic create. | ||||
| | * | | | Starts from the reassign-partitions job | Staffan Olsson | 2018-02-02 | 1 | -0/+51 |
| |/ / / | |||||
| * | | | The first two tasks under Partition Management in the Kafka book | Staffan Olsson | 2017-11-10 | 1 | -0/+22 |
| | | | | |||||
| * | | | Adds a job that can actually fix under-replication ... | Staffan Olsson | 2017-11-10 | 1 | -0/+51 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | as long as you have one up-to-date replica. The use case is broker outages that are longer than mere re-scheduling, such as zone outage in a multi-zone cluster. | ||||
| * | | | But note that this job won't actually trigger replication ... | Staffan Olsson | 2017-11-10 | 1 | -0/+0 |
| | | | | | | | | | | | | | | | | of under-replicated topics if a broker is down | ||||
| * | | | Fixes container log to show unreplicated partitions (if there are any) | Staffan Olsson | 2017-11-10 | 1 | -3/+9 |
| | | | | |||||
| * | | | Adds job to simplify replica election | Staffan Olsson | 2017-11-09 | 2 | -4/+21 |
| | | | | |||||
| * | | | Adds test that goes unready when there's not enough replicas of >0 topics | Staffan Olsson | 2017-11-09 | 1 | -0/+46 |
| | | | | |||||
* | | | | Merge pull request #128 from Yolean/metrics-jmx-for-brokers | solsson | 2018-02-03 | 2 | -0/+87 |
|\ \ \ \ | | | | | | | | | | | Add Kafka Prometheus metrics export | ||||
| * | | | | There's only values in this metric typemetrics-jmx-for-brokers | Staffan Olsson | 2018-02-03 | 1 | -1/+1 |
| | | | | | |||||
| * | | | | At first i suspected that order matters, but this also works | Staffan Olsson | 2018-02-03 | 1 | -2/+2 |
| | | | | | |||||
| * | | | | ”In a production Kafka cluster, an offline partition | Staffan Olsson | 2018-02-03 | 1 | -1/+2 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | may be impacting the producer clients, losing messages or causing back-pressure in the application. This is most often a “site down” type of problem and will need to be addressed immediately.” Excerpt from: Neha Narkhede, Gwen Shapira, and Todd Palino. ”Kafka: The Definitive Guide”. We now export kafka_controller_kafkacontroller_value{name="OfflinePartitionsCount",} and friends. See #140 for why. | ||||
| * | | | | It was the liveness probe that killed the metrics container, | Staffan Olsson | 2018-01-29 | 1 | -2/+2 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | and we might not need liveness if we have alerts for stale metrics. This reverts commit f1e6e96231465775ffa0ded5b745774182fec5ff. | ||||
| * | | | | Removes liveness probes, to focus on memory limits, | Staffan Olsson | 2018-01-19 | 1 | -5/+0 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | and rely on metric staleness alerts instead for exporter liveness. This reverts commit 74a5177270301f3cbe0342657d8bcf70d1ae76ed. | ||||
| * | | | | With 120M you get OOMKilled even on brokers with modest metrics volumes | Staffan Olsson | 2018-01-19 | 1 | -2/+2 |
| | | | | | | | | | | | | | | | | | | | | This reverts commit 66255af447373f9b14e338a4b819dddad483a257. | ||||
| * | | | | With kubectl patch, this folder kan be scoped as Prometheus support | Staffan Olsson | 2018-01-19 | 2 | -1/+1 |
| | | | | | |||||
| * | | | | On start the metrics pod gesses that it has ~45% | Staffan Olsson | 2018-01-19 | 1 | -2/+2 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | of the memory limit as "Max. Heap Size (Estimated)" Reducing limits as experiment for #112. | ||||
| * | | | | Evaluates JVM memory limit awareness | Staffan Olsson | 2018-01-19 | 1 | -2/+4 |
| | | | | | | | | | | | | | | | | | | | | | | | | | Interesting input for #112, for use with broker and zk pods in addition to KAFKA_HEAP_OPTS. | ||||
| * | | | | This is an optional feature, but belongs to the broker pods, | Staffan Olsson | 2018-01-19 | 1 | -0/+2 |
| | | | | | | | | | | | | | | | | | | | | so let's evaluate kubectl patch to add it | ||||
| * | | | | Adds liveness probe from the metrics-improve-scrape-times branch | Staffan Olsson | 2018-01-19 | 1 | -0/+5 |
| | | | | | |||||
| * | | | | Upgrades jmx exporter to 0.2.0 | Staffan Olsson | 2018-01-19 | 1 | -1/+1 |
| | | | | | |||||
| * | | | | The metrics part of #49 | Staffan Olsson | 2018-01-19 | 1 | -0/+38 |
| | | | | | |||||
| * | | | | Current config from the metrics-improve-scrape-times branch, | Staffan Olsson | 2018-01-19 | 1 | -0/+44 |
| | | | | | | | | | | | | | | | | | | | | see https://github.com/Yolean/kubernetes-kafka/pull/49 | ||||
* | | | | | Merge pull request #135 from Yolean/use-default-replication-factor | solsson | 2018-02-01 | 2 | -4/+0 |
|\ \ \ \ \ | |_|_|/ / |/| | | / | | |_|/ | |/| | | Update test topic replication factor | ||||
| * | | | Uses brokers' default replication factor for explicit topic creationuse-default-replication-factor | Staffan Olsson | 2018-01-22 | 2 | -4/+0 |
| |/ / | |||||
* | | | Merge pull request #138 from deadmoose/patch-1 | solsson | 2018-02-01 | 1 | -1/+1 |
|\ \ \ | | | | | | | | | Speeling | ||||
| * | | | Speeling | David Hoover | 2018-01-31 | 1 | -1/+1 |
|/ / / | |||||
* | | | Merge pull request #125 from Yolean/linkedin-burrow | solsson | 2018-01-31 | 3 | -0/+114 |
|\ \ \ | | | | | | | | | Add Burrow for consumer lag monitoring | ||||
| * | | | Upgrades to current Burrow master, a91cf4dlinkedin-burrow | Staffan Olsson | 2018-01-31 | 1 | -1/+1 |
| | | | | |||||
| * | | | Applies the fix for v3 API so now we export five metrics | Staffan Olsson | 2018-01-19 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | https://github.com/jirwin/burrow_exporter/pull/9 | ||||
| * | | | Adds a frontend container. No need to scale it indivudually. | Staffan Olsson | 2018-01-19 | 2 | -4/+29 |
| | | | | |||||
| * | | | Lets us see all consumers, for now | Staffan Olsson | 2018-01-19 | 1 | -2/+2 |
| | | | | |||||
| * | | | Adds a service. Ordering is ok with plain file names here. | Staffan Olsson | 2018-01-19 | 3 | -0/+12 |
| | | | | |||||
| * | | | The build from search-and-replace in github.com/jirwin/burrow_exporter/pull/9 | Staffan Olsson | 2018-01-17 | 1 | -1/+1 |
| | | | | |||||
| * | | | Adds prometheus exporter, but sadly incompatible with current Burrow | Staffan Olsson | 2018-01-17 | 1 | -0/+14 |
| | | | | | | | | | | | | | | | | https://github.com/jirwin/burrow_exporter/issues/8 |