Go to file
R. Tyler Croy 148359d816
Pretty much any node is going to have Java, because Jenkins, duh
2016-08-03 21:22:45 -07:00
gradle Introduce codenarc and make the project adhere to some coding standards 2015-09-01 15:50:31 -07:00
src refactor the BrokerTreeWatcher 2015-11-10 22:42:07 +01:00
.gitignore Ignore intellij files 2015-08-14 09:57:34 -07:00
.travis.yml Add a new bintray API key for publishing releases 2015-11-07 12:46:19 -08:00
HACKING.adoc Bump the minor version for release, updating the group too 2015-11-07 12:39:25 -08:00
Jenkinsfile Pretty much any node is going to have Java, because Jenkins, duh 2016-08-03 21:22:45 -07:00
LICENSE.md Bump the minor version for release, updating the group too 2015-11-07 12:39:25 -08:00
README.adoc Correct link to download button 2015-11-07 13:18:31 -08:00
build.gradle Bump version to release some of mkristian's refactorings 2015-12-26 15:19:42 -08:00
docker-compose.yml Add a docker-compose.yml for locally testing verspaetung 2015-11-07 13:11:38 -08:00
gradle.properties Introduce codenarc and make the project adhere to some coding standards 2015-09-01 15:50:31 -07:00
gradlew Initial commit 2015-01-09 15:40:46 -08:00
gradlew.bat Initial commit 2015-01-09 15:40:46 -08:00

README.adoc

<html lang="en"> <head> </head>

Build Status

download

Verspätung is a small utility which aims to help identify delay of Kafka consumers.

Verspätung monitors the topics and their latest offsets by talking to Kafka, it will also keep track of how far along consumers are by monitoring the offsets that they have committed to Zookeeper. Using both of these pieces of information, Verspätung computs the delta for each of the consumer groups and reports it to statsd.

Using

% java -jar verspaetung-*-all.jar --help
usage: verspaetung
 -d,--delay <DELAY>          Seconds to delay between reporting metrics to
                             the metrics receiver (defaults: 5s)
 -H,--statsd-host <STATSD>   Hostname for a statsd instance (defaults to
                             localhost)
 -n,--dry-run                Disable reporting to a statsd host
 -p,--statsd-port <PORT>     Port for the statsd instance (defaults to
                             8125)
    --prefix <PREFIX>        Prefix all metrics with PREFIX before they're
                             reported (e.g. PREFIX.verspaetung.mytopic)
 -s,--storm                  Watch Storm KafkaSpout offsets (under
                             /kafka_spout)
 -x,--exclude <EXCLUDES>     Regular expression for consumer groups to
                             exclude from reporting (can be declared
                             multiple times)
 -z,--zookeeper <HOSTS>      Comma separated list of Zookeeper hosts (e.g.
                             localhost:2181)

Running Verspätung is rather easy, by default the daemon will monitor the standard Kafka high-level consumer offset path of /consumers and start reporting deltas automatically.

</html>