aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
| * bash -e is important, in combination with curl -f, so ...Staffan Olsson2017-10-261-12/+2
| | | | | | | | | | we don't send error messages to the topic (even if it's json -- format is different and it's pretty printed)
| * Argh, curl will pretty print the json ...Staffan Olsson2017-10-261-1/+11
| | | | | | | | and kafkacat will produce each line separately
| * Makes things a bit less obscure if for example RBAC failsStaffan Olsson2017-10-261-2/+12
| |
| * Use an image with new kafkacat and curl versionsStaffan Olsson2017-10-261-1/+1
| |
| * Not a proper test yet, but the PR documents how to use it to see eventsStaffan Olsson2017-08-051-7/+2
| |
| * Moves the example comsumer to the test namespaceStaffan Olsson2017-08-051-5/+4
| |
| * Adds RBAC policy for curl, default service accountStaffan Olsson2017-08-051-0/+30
| |
| * Latest build suppors snappy compressionStaffan Olsson2017-08-052-2/+2
| |
| * Works with my current kafka image, and the test consumer still sees JSONStaffan Olsson2017-08-051-1/+1
| |
| * Testing compression but solsson/kafka:0.11.0.0 throws ...Staffan Olsson2017-08-051-0/+1
| | | | | | | | | | | | | | | | | | Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy at org.xerial.snappy.SnappyInputStream.readFully(SnappyInputStream.java:145) at org.xerial.snappy.SnappyInputStream.readHeader(SnappyInputStream.java:99) at org.xerial.snappy.SnappyInputStream.<init>(SnappyInputStream.java:59) at org.apache.kafka.common.record.CompressionType$3.wrapForInput(CompressionType.java:82) ... 40 more
| * Produces proper json. Let's see when curl gives up and the container restarts.Staffan Olsson2017-08-051-2/+1
| |
| * Quite interesting way to test a command from yaml - see it in logsStaffan Olsson2017-08-051-1/+3
| |
| * wipStaffan Olsson2017-08-051-5/+6
| |
| * Produces and reads eventsStaffan Olsson2017-08-053-2/+72
| |
| * Creates a pod for expermentation with kubectl and kafkacatStaffan Olsson2017-08-051-0/+27
| |
* | Merge pull request #107 from Yolean/yolean-topic-managementsolsson2017-12-183-56/+25
|\ \ | | | | | | Embrace auto.topic.create; trust defaults for production topics
| * | Deprecates our own statefulset pod label kafka-broker-idyolean-topic-managementStaffan Olsson2017-12-142-0/+3
| | |
| * | I find it scary when broker start logs:Staffan Olsson2017-12-141-0/+1
| | | | | | | | | | | | | | | | | | | | | log.dir = /tmp/kafka-logs log.dirs = /var/lib/kafka/data/topics but this is the lesser of two evils compared to duplicate values
| * | Merge branch 'topic-config-together' into yolean-topic-managementStaffan Olsson2017-12-132-60/+21
| |\ \
| | * | Now was a good time to get rid of the last --overrideStaffan Olsson2017-12-132-3/+1
| | | | | | | | | | | | | | | | as we now encourage close scrutiny of the config file.
| | * | Moves the essential data path config to theStaffan Olsson2017-12-132-3/+1
| | | | | | | | | | | | | | | | config location suggested by Kafka's sample conf.
| | * | Permanent retention is a friendlier default,Staffan Olsson2017-12-132-3/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | and easy to reconfigure per topic as they grow. We already had that, but this branch cares about grouping such conf. It also encourages topic defaults geared towards persistent data.
| | * | Places the values that are most likely to need attention at the topStaffan Olsson2017-12-131-52/+19
| |/ /
| * | Gathers the config that has to do with topic creationStaffan Olsson2017-12-132-2/+3
| | | | | | | | | | | | | | | | | | | | | in one place. These values are critical to maintain for those, like us, who make use of auto create topics for production data. Also a step towards #72 and #77.
| * | Enables auto create topics because there's use cases for addingStaffan Olsson2017-12-131-1/+1
| | | | | | | | | | | | | | | | | | | | | topics at runtime, such as splitting a stream based on some business enum. Producers and Kafka Streams apps would otherwise need to set up an AdminClient to do that. This reverts commit: 0681cc515fa1c505b905ef60c7d3132e8d7510af
| * | Lets clusters define their preferred (prod) replication factorStaffan Olsson2017-12-011-0/+3
| | | | | | | | | | | | | | | so that we can omit replication-factor when creating topics, as we benefit from reusing such commands or definitions across dev-qa-prod.
* | | Merge pull request #104 from StevenACoffman/ADD_AWSsolsson2017-12-082-0/+20
|\ \ \ | |/ / |/| | ADD_AWS: Add AWS storage classes
| * | ADD_AWS: Add AWS storage classSteve Coffman2017-12-082-0/+20
|/ /
* | Removes some "platform" ideas from readme as they need real PRsStaffan Olsson2017-12-011-2/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | rather than a couple of sentences. In response to #103. Regarding Kafka Streams I no longer think we need examples, because any dockerized streams application can run as a deployment. An example of Kafka Connect would be useful, in particular the combination of a custom image (or one with stock connectors) and a Connect cluster manifest. This is tracked in #69, but not the relation to https://github.com/solsson/dockerfiles/tree/master/connect-* KSQL (#68) is highly interesting.
* | Merge pull request #96 from Yolean/enable-broker-jmxsolsson2017-11-101-0/+4
|\ \ | | | | | | Enable broker JMX_PORT 5555
| * | Exposes JMX for brokers, to typical monitoring setupsenable-broker-jmxStaffan Olsson2017-11-091-0/+4
| | | | | | | | | | | | | | | | | | | | | Already included in #49, but here we don't add any export container to the pod. Can be utilized by kafka-manager (#83) - just tick the JMX box when adding a cluster - to see bytes in/out rates.
* | | Merge pull request #94 from Yolean/restore-ondelete-behaviorv3.0.1solsson2017-11-093-0/+6
|\ \ \ | |/ / |/| | Disables RollingUpdate, i.e. reverts to pre-1.7 behavior
| * | Sets OnDelete explicitly, as RollingUpdate is a new defaultrestore-ondelete-behaviorStaffan Olsson2017-11-093-0/+6
|/ / | | | | | | | | | | | | | | Due to the use of config map for most of the conifg, RollingUpdate will be surprising, while still not preventing running pods that don't have the applied configuration. An automation effort would be required for proper RollingUpdate behavior.
* | Merge pull request #90 from Yolean/1.8-manifestsv3.0.0solsson2017-11-0914-65/+27
|\ \ | | | | | | Updates manifests to beta2 workload API, k8s 1.8
| * | Fixes a test issue at start and at consumer error1.8-manifestsStaffan Olsson2017-11-091-0/+2
| | |
| * | Improves placement of temporary noticeStaffan Olsson2017-11-091-4/+2
| | |
| * | Makes kafka a feature folder too, consistent with the restStaffan Olsson2017-11-099-7/+7
| | |
| * | Leaving the addon concept in favor of opt-in folder applyStaffan Olsson2017-11-091-51/+0
| | |
| * | Updates RBAC to 1.8Staffan Olsson2017-11-091-2/+2
| | |
| * | Updates deployment to beta2 workload API, k8s 1.8Staffan Olsson2017-11-091-1/+1
| | |
| * | Updates statefulset to beta2 workload API, k8s 1.8Staffan Olsson2017-11-093-3/+16
|/ /
* | Merge pull request #79 from Yolean/bootstrap-testsolsson2017-11-095-216/+348
|\ \ | | | | | | Update tests to act as long-running consumers
| * | Adapts readme to 56aad28bootstrap-testStaffan Olsson2017-11-091-1/+1
| | |
| * | Use the bootstrap service (#52) for repeated bootstrapsStaffan Olsson2017-11-091-1/+1
| | | | | | | | | | | | The test should still pass if any single broker is down.
| * | Naming fixStaffan Olsson2017-11-091-3/+3
| | |
| * | Switches to ReplicaSet from Deployment, because configmap ...Staffan Olsson2017-11-092-6/+2
| | | | | | | | | | | | | | | resources as scripts void the Deployment behavior anyway. And besides, there's no need to manage these tests like production resources.
| * | Identifies topic jobs, and the resulting pods, by nameStaffan Olsson2017-11-092-2/+2
| | |
| * | Avoids overlap in matchLabels between test deploymentsStaffan Olsson2017-11-092-4/+4
| | |
| * | Renames test to focues on the type of client usedStaffan Olsson2017-11-091-8/+8
| | |
| * | Merge branch 'bootstrap-test-console-too' into bootstrap-testStaffan Olsson2017-11-093-119/+174
| |\ \