reiseburo
/
hermann
mirror of https://github.com/reiseburo/hermann
1
0
Fork 0
Code Issues Releases Wiki Activity
304 Commits 9 Branches 20 Tags 604 KiB
Commit Graph

92 Commits

Author SHA1 Message Date
Julien Feltesse 587f3be16e depend on concurrent-ruby ~> 1.0.0 2016-02-24 18:19:06 +09:00
R. Tyler Croy e9d301be3d
Remove hermann_jars.rb to gem installation to generate it properly 
Fixes #124
 2015-09-23 07:52:21 -07:00
R. Tyler Croy 4dd732dc63
Bump the version for a minor release 2015-09-22 12:08:28 -07:00
R. Tyler Croy 5c20c6c5ba
Another minor version bump to clean our dependency range up 2015-09-22 12:00:04 -07:00
R. Tyler Croy 9f1e16071f
Bump the minor for some new functionality, at least on MRI 2015-09-22 12:00:04 -07:00
jakesandlund c29bb5e4d0 Move to_java into java_producer to make push_single signature match MRI 2015-09-16 15:54:42 +00:00
cory and jakesandlund e8703e1df4 Add support for passing partition_key in MRI 2015-09-14 16:11:43 +00:00
R. Tyler Croy 60bc473fdd Merge pull request #118 from zendesk/namespace 
REFACTOR ONLY: Namespace cleanup
 2015-06-27 11:04:23 -07:00
Ben Osheroff 9edc4b9301 move hermann_lib -> hermann_rdkafka / Hermann::Provider::RDKafka 2015-06-23 09:01:31 -07:00
R. Tyler Croy c6fe9838d7 Merge pull request #116 from rtyler/jar-dep-change 
Change jar-dependencies to work with current jbundler installs
 2015-06-18 18:15:51 -07:00
R. Tyler Croy 45fe45cb96
Remove the exclusion syntax from the kafka jar-dependency which breaks in the latest jbundler 
The version of jar-dependencies we were testing against was yanked and with
jbundler and jar-dependencies (0.7.[3-4] and 0.1.10 respectively) I cannot get
Hermann to successfully install with jbundler
 2015-06-18 17:11:36 -07:00
R. Tyler Croy 6fb9e064b4
Up the minor version for a manual deployment 2015-06-15 06:19:30 -07:00
Ben Osheroff 3f0da9e0cd stop using named params in Partition#consumer 2015-06-13 14:12:57 -07:00
Ben Osheroff c2540a8410 update api to have #topic(topic) as well as #topics 
also add Partition#consumer to instantiate a coonsumer object on the
particular partition
 2015-06-11 15:29:02 -07:00
Ben Osheroff 7edd297071 add Broker#to_s 2015-06-11 15:25:01 -07:00
Ben Osheroff e7e1a2a7ac raise default timeout and make it configurable 2015-05-19 13:51:59 -07:00
Ben Osheroff 314ea3d8f8 fetching an empty topic doesn't work 2015-05-19 13:44:57 -07:00
Ben Osheroff 326b428b34 slap a friendlier face on the returned metadata interface 2015-05-19 13:34:39 -07:00
Ben Osheroff 7779654f36 Merge remote-tracking branch 'upstream/master' into metadata 2015-05-19 11:38:08 -07:00
Ben Osheroff 5942e1810b fix bug, constantize TIMEOUT_MS, add README.md info 2015-05-19 11:33:13 -07:00
Ben Osheroff e38b626b71 Add metadata API to Hermann::Discovery module 2015-05-19 11:13:27 -07:00
R. Tyler Croy 3fda5ec3f3 Rework the dependencies and some of the code to support retro rubies better 2015-05-07 13:18:41 -07:00
Ben Osheroff 8832ad28fd update rdoc section with :offset documentation 2015-04-28 11:52:16 -07:00
Ben Osheroff 8e89b75801 add a type to the invalid offset error 2015-04-28 11:50:28 -07:00
Ben Osheroff 752123b83e allow choosing of an inital offset in the MRI consumer 2015-04-28 10:17:09 -07:00
Ben Osheroff 71c21d327e delete options in Consumer#initialize before passing along 2015-04-27 10:12:31 -07:00
Ben Osheroff 6db14ceeb7 version 0.23.0 2015-04-27 09:54:02 -07:00
Ben Osheroff 3792ee206b unify jruby/mri Consumer#initialize 
While we do require different options between jruby & mri, there is a
common "topic" option.  The rest we pass in the options hash.
 2015-04-27 09:32:16 -07:00
R. Tyler Croy f3f23965bd Bump a minor version for an API addition 2015-04-06 17:42:49 -07:00
Lee Butterman f059643efc Add support for a partition key for producers. 
Fixes lookout/Hermann#88
 2015-04-06 17:35:38 -07:00
jway 96c0a74bf5 0.20.4 add large file support, fix bug passing options 2015-04-04 11:47:29 -07:00
Dirk Koehler 3b03658220 Bring back Jarfile and remove curator from dependency 2015-03-27 17:25:31 -07:00
Dirk Koehler 70f52204c7 Upgrade version to 0.20.3 2015-03-26 23:06:15 -07:00
Dirk Koehler 163c9d70c6 Cleanup jar dependencies 
- move Jarfile dependency into gemspec
- upgrade curator to 2.7.1
- fix tests
- remove transient dependencies
 2015-03-26 22:58:13 -07:00
R. Tyler Croy 5f783476f8 Bump to 0.20.2 for release 2015-02-23 15:03:07 -08:00
Marc Seeger b7c35cb78c Fix MRI documentation in consumer.rb 2014-12-14 21:06:11 -05:00
R. Tyler Croy aeaec0269c Merge pull request #76 from rtyler/issues/75-native-zookeeper 
Implement a Java-native Zookeeper interface with Curator
 2014-11-21 21:01:24 -08:00
R. Tyler Croy 495ac2687a Refactor out the block support from #each_brokers and bring back `timeout` for the ZkGemImpl 
[1] pry(main)> d = Hermann::Discovery::Zookeeper.new('zk0.REDACTED.com:2181')
    => #<Hermann::Discovery::Zookeeper:0x57186526
     @impl=
      #<Hermann::Discovery::Zookeeper::CuratorImpl:0x391d1e33
       @curator=
        #<Java::OrgApacheCuratorFrameworkImps::CuratorFrameworkImpl:0x5287ba5f>>,
     @zookeepers="zk0.REDACTED.com:2181">
    [2] pry(main)> d.get_brokers
    log4j:WARN No appenders could be found for logger (org.apache.curator.framework.imps.CuratorFrameworkImpl).
    log4j:WARN Please initialize the log4j system properly.
    log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
    => ["kafka0.REDACTED.com:6667",
     "kafka1.REDACTED.com:6667"]
    [3] pry(main)>

    [1] pry(main)> d = Hermann::Discovery::Zookeeper.new('zk0.REDACTED.com:2181')
    => #<Hermann::Discovery::Zookeeper:0x7b6141f0
     @impl=
      #<Hermann::Discovery::Zookeeper::ZkGemImpl:0x4fb64a52
       @zookeepers="zk0.REDACTED.com:2181">,
     @zookeepers="zk0.REDACTED.com:2181">
    [2] pry(main)> d.get_brokers
    log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper).
    log4j:WARN Please initialize the log4j system properly.
    log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
    => ["kafka0.REDACTED.com:6667",
     "kafka1.REDACTED.com:6667"]
    [3] pry(main)>
 2014-11-21 20:39:11 -08:00
R. Tyler Croy 136e0ace47 Add suppot for optionally using Curator if it's on the classpath for broker discovery 
This change makes the loading of the 'zk' gem optional and implicit, as well as
the reliance on Curator being available in the JRuby runtime's classpath.

If neither Zookeeper client implementation are available, an exception will be
raised when attmepting to use Zookeeper-based discovery

Fixes #75
 2014-11-21 18:06:56 -08:00
R. Tyler Croy 8ed1ba91ba Merge pull request #74 from lookout/add-errors 
include errors file
 2014-11-17 17:09:47 -08:00
jway b4699845c5 include errors file 2014-11-17 17:01:44 -08:00
jway 6300705af9 fixup exception handling in consumer 2014-11-13 16:23:40 -08:00
R. Tyler Croy c6ab5e760c Force a more recent version of log4j as a jar dependency 
The log4j has distributed some bad packages in the past but this release looks
safe to include
 2014-11-12 08:53:44 -08:00
R. Tyler Croy d89d17119b Jump up to 0.20 2014-10-31 12:25:46 -07:00
R. Tyler Croy 0f7714175b Correct test failures with the API changes to Hermann exceptions and some underlying expectations 2014-10-31 12:02:17 -07:00
R. Tyler Croy f2ceab296c Properly marshal bytes in and out of the Kafka client library 
The primary issue with marshalling bytes back and forth previously was the use
of the StringEncoder class. By default the Kafka client library uses the
DefaultEncoder which is a no-op and simply allwos byte arrays through
 2014-10-31 11:32:49 -07:00
R. Tyler Croy 61c0426cbe Catch all Java related exceptions and raise them up out of Hermann::Producer#push_single 2014-10-31 11:24:11 -07:00
R. Tyler Croy 3c9c234c43 Update the Hermann::Discovery::Zookeeper API to return an Array of brokers more suitable for Hermann::Producer 2014-10-30 10:05:34 -07:00
jway 132dbb94a9 pass string to JavaProducer 2014-10-29 16:59:34 -07:00
R. Tyler Croy c3f5744568 Bump the version for 0.19 milestone 2014-10-28 20:50:13 -07:00