2015-11-07 20:21:41 +00:00
|
|
|
image:https://travis-ci.org/reiseburo/verspaetung.svg?branch=master["Build Status", link="https://travis-ci.org/reiseburo/verspaetung"]
|
2015-01-09 23:40:46 +00:00
|
|
|
|
2015-11-07 21:18:31 +00:00
|
|
|
image::https://api.bintray.com/packages/reiseburo/apps/verspaetung/images/download.svg[link="https://bintray.com/reiseburo/apps/verspaetung/_latestVersion"]
|
2015-01-19 19:54:28 +00:00
|
|
|
|
2015-07-04 22:02:35 +00:00
|
|
|
Verspätung is a small utility which aims to help identify delay of link:http://kafka.apache.org[Kafka] consumers.
|
2015-01-28 11:20:10 +00:00
|
|
|
|
2015-01-09 23:40:46 +00:00
|
|
|
|
|
|
|
Verspätung monitors the topics and their latest offsets by talking to Kafka, it
|
|
|
|
will also keep track of how far along consumers are by monitoring the offsets
|
|
|
|
that they have committed to Zookeeper. Using both of these pieces of
|
|
|
|
information, Verspätung computs the delta for each of the consumer groups and
|
|
|
|
reports it to statsd.
|
|
|
|
|
2015-07-04 22:02:35 +00:00
|
|
|
=== Using
|
2015-01-28 11:33:52 +00:00
|
|
|
|
2015-07-04 21:12:27 +00:00
|
|
|
% java -jar verspaetung-*-all.jar --help
|
|
|
|
usage: verspaetung
|
2015-09-02 00:43:35 +00:00
|
|
|
-d,--delay <DELAY> Seconds to delay between reporting metrics to
|
|
|
|
the metrics receiver (defaults: 5s)
|
2015-07-04 21:12:27 +00:00
|
|
|
-H,--statsd-host <STATSD> Hostname for a statsd instance (defaults to
|
|
|
|
localhost)
|
|
|
|
-n,--dry-run Disable reporting to a statsd host
|
|
|
|
-p,--statsd-port <PORT> Port for the statsd instance (defaults to
|
|
|
|
8125)
|
2015-09-02 00:43:35 +00:00
|
|
|
--prefix <PREFIX> Prefix all metrics with PREFIX before they're
|
|
|
|
reported (e.g. PREFIX.verspaetung.mytopic)
|
2015-07-04 21:12:27 +00:00
|
|
|
-s,--storm Watch Storm KafkaSpout offsets (under
|
|
|
|
/kafka_spout)
|
2015-09-02 00:43:35 +00:00
|
|
|
-x,--exclude <EXCLUDES> Regular expression for consumer groups to
|
|
|
|
exclude from reporting (can be declared
|
|
|
|
multiple times)
|
2015-07-04 21:12:27 +00:00
|
|
|
-z,--zookeeper <HOSTS> Comma separated list of Zookeeper hosts (e.g.
|
|
|
|
localhost:2181)
|
|
|
|
|
|
|
|
Running Verspätung is rather easy, by default the daemon will monitor the
|
|
|
|
standard Kafka high-level consumer offset path of `/consumers` and start
|
|
|
|
reporting deltas automatically.
|
2015-01-09 23:40:46 +00:00
|
|
|
|