rtyler
/
Hermann
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
291 Commits 5 Branches 21 Tags 551 KiB
Commit Graph

291 Commits

Author SHA1 Message Date
jway 96c0a74bf5 0.20.4 add large file support, fix bug passing options 2015-04-04 11:47:29 -07:00
R. Tyler Croy 17a4dba8d2 Merge pull request #86 from phrinx/master 
Cleanup jar dependencies
 2015-03-28 09:59:12 -07:00
Dirk Koehler 3b03658220 Bring back Jarfile and remove curator from dependency 2015-03-27 17:25:31 -07:00
Dirk Koehler 70f52204c7 Upgrade version to 0.20.3 2015-03-26 23:06:15 -07:00
Dirk Koehler 163c9d70c6 Cleanup jar dependencies 
- move Jarfile dependency into gemspec
- upgrade curator to 2.7.1
- fix tests
- remove transient dependencies
 2015-03-26 22:58:13 -07:00
R. Tyler Croy 5f783476f8 Bump to 0.20.2 for release 2015-02-23 15:03:07 -08:00
R. Tyler Croy 9dd7152d44 Merge pull request #77 from rb2k/patch-1 
Fix MRI documentation in consumer.rb
 2014-12-15 08:34:39 -08:00
Marc Seeger b7c35cb78c Fix MRI documentation in consumer.rb 2014-12-14 21:06:11 -05:00
R. Tyler Croy 4661aa75b6 I don't consider this alpha stage anymore 2014-12-14 10:27:43 -08:00
R. Tyler Croy aeaec0269c Merge pull request #76 from rtyler/issues/75-native-zookeeper 
Implement a Java-native Zookeeper interface with Curator
 2014-11-21 21:01:24 -08:00
R. Tyler Croy 495ac2687a Refactor out the block support from #each_brokers and bring back `timeout` for the ZkGemImpl 
[1] pry(main)> d = Hermann::Discovery::Zookeeper.new('zk0.REDACTED.com:2181')
    => #<Hermann::Discovery::Zookeeper:0x57186526
     @impl=
      #<Hermann::Discovery::Zookeeper::CuratorImpl:0x391d1e33
       @curator=
        #<Java::OrgApacheCuratorFrameworkImps::CuratorFrameworkImpl:0x5287ba5f>>,
     @zookeepers="zk0.REDACTED.com:2181">
    [2] pry(main)> d.get_brokers
    log4j:WARN No appenders could be found for logger (org.apache.curator.framework.imps.CuratorFrameworkImpl).
    log4j:WARN Please initialize the log4j system properly.
    log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
    => ["kafka0.REDACTED.com:6667",
     "kafka1.REDACTED.com:6667"]
    [3] pry(main)>

    [1] pry(main)> d = Hermann::Discovery::Zookeeper.new('zk0.REDACTED.com:2181')
    => #<Hermann::Discovery::Zookeeper:0x7b6141f0
     @impl=
      #<Hermann::Discovery::Zookeeper::ZkGemImpl:0x4fb64a52
       @zookeepers="zk0.REDACTED.com:2181">,
     @zookeepers="zk0.REDACTED.com:2181">
    [2] pry(main)> d.get_brokers
    log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper).
    log4j:WARN Please initialize the log4j system properly.
    log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
    => ["kafka0.REDACTED.com:6667",
     "kafka1.REDACTED.com:6667"]
    [3] pry(main)>
 2014-11-21 20:39:11 -08:00
R. Tyler Croy 136e0ace47 Add suppot for optionally using Curator if it's on the classpath for broker discovery 
This change makes the loading of the 'zk' gem optional and implicit, as well as
the reliance on Curator being available in the JRuby runtime's classpath.

If neither Zookeeper client implementation are available, an exception will be
raised when attmepting to use Zookeeper-based discovery

Fixes #75
 2014-11-21 18:06:56 -08:00
R. Tyler Croy c46156a7d1 Move the `zk` gem from a explicit gem dependency to an implicit dependency 
This will give us some optionality on how we want to reach out and contact
Zookeeper across multiple environments. See #75
 2014-11-21 15:16:01 -08:00
R. Tyler Croy 8ed1ba91ba Merge pull request #74 from lookout/add-errors 
include errors file
 2014-11-17 17:09:47 -08:00
jway b4699845c5 include errors file 2014-11-17 17:01:44 -08:00
R. Tyler Croy 7fe085a0c0 Merge pull request #73 from lookout/fix-execeptioning 
fixup exception handling in consumer
 2014-11-14 07:53:55 -08:00
jway 6300705af9 fixup exception handling in consumer 2014-11-13 16:23:40 -08:00
james 4ef0bb0498 Merge pull request #71 from rtyler/log4j-upgrade 
Force a more recent version of log4j as a jar dependency
 2014-11-12 09:19:18 -08:00
R. Tyler Croy c6ab5e760c Force a more recent version of log4j as a jar dependency 
The log4j has distributed some bad packages in the past but this release looks
safe to include
 2014-11-12 08:53:44 -08:00
R. Tyler Croy d89d17119b Jump up to 0.20 2014-10-31 12:25:46 -07:00
R. Tyler Croy 3783b6deb8 Merge pull request #70 from rtyler/proto-test 
Add a repro case and fix for binary data through Hermann
 2014-10-31 12:11:28 -07:00
R. Tyler Croy 0f7714175b Correct test failures with the API changes to Hermann exceptions and some underlying expectations 2014-10-31 12:02:17 -07:00
R. Tyler Croy f2ceab296c Properly marshal bytes in and out of the Kafka client library 
The primary issue with marshalling bytes back and forth previously was the use
of the StringEncoder class. By default the Kafka client library uses the
DefaultEncoder which is a no-op and simply allwos byte arrays through
 2014-10-31 11:32:49 -07:00
R. Tyler Croy 61c0426cbe Catch all Java related exceptions and raise them up out of Hermann::Producer#push_single 2014-10-31 11:24:11 -07:00
R. Tyler Croy 228358edc1 Add a failing integration test for pumping protobufs through Hermann 2014-10-30 10:46:18 -07:00
R. Tyler Croy 7f4de34be0 Refactor the Hermann::Producer Java-based integration test to respect integration.yml 
I've also refactored/cleaned it up a bit to make sure it runs properly on my machine
 2014-10-30 10:46:18 -07:00
james 18b49cee98 Update README.md 2014-10-30 10:13:35 -07:00
james 4ceff1705b Update README.md 2014-10-30 10:12:05 -07:00
R. Tyler Croy 3c9c234c43 Update the Hermann::Discovery::Zookeeper API to return an Array of brokers more suitable for Hermann::Producer 2014-10-30 10:05:34 -07:00
james fb24605d5b Update README.md 2014-10-30 10:02:49 -07:00
R. Tyler Croy 8400cfdc15 Add support for spec:integration to ignore MRI and Java cases off their respective platforms 2014-10-30 09:47:11 -07:00
R. Tyler Croy 3b3b100c0d Add protobuffy as a development dep 2014-10-29 20:53:03 -07:00
R. Tyler Croy 3264ce1b23 Merge pull request #69 from lookout/fix-producer 
Pass string to JavaProducer
 2014-10-29 19:05:23 -07:00
jway 132dbb94a9 pass string to JavaProducer 2014-10-29 16:59:34 -07:00
R. Tyler Croy c3f5744568 Bump the version for 0.19 milestone 2014-10-28 20:50:13 -07:00
R. Tyler Croy d2ef453494 Tick the underlying librdkafka reactor on each subsequent Hermann::Producer#push call 
References #48
 2014-10-28 20:47:25 -07:00
R. Tyler Croy 4ea21d5add Account for a subtle internal API change between the C and Java Producers 2014-10-28 18:18:05 -07:00
R. Tyler Croy 433b739e45 Add a small note about consumer thread-safety 2014-10-28 18:14:43 -07:00
R. Tyler Croy 6cbceead8b Wrap the brokers array in a threadsafe array 
References #50
 2014-10-28 18:13:20 -07:00
R. Tyler Croy 7e8fbca79e Add thread_safe for handling the @children inside of Hermann::Producer 
This isn't comprehensive, still debating a comprehensive approach to #50 that
I'm happy with

References #50
 2014-10-28 18:00:29 -07:00
R. Tyler Croy 0cd921298e Merge pull request #67 from lookout/fix_integration 
Fix integration tests
 2014-10-28 12:32:20 -07:00
jway 69202c21b2 allow integration test to run only in jruby 2014-10-28 11:14:14 -07:00
jway b48698035b update integration example with zookeepers 2014-10-28 08:35:33 -07:00
R. Tyler Croy 0526361011 Merge pull request #63 from lookout/add_shutdown 
add shutdown
 2014-10-28 08:25:19 -07:00
jway 9acce0a64b add shutdown 
* producer/consumer integration tests
 2014-10-27 21:16:17 -07:00
R. Tyler Croy 1f52bad871 Merge pull request #62 from lookout/consume_topic 
Allow passing topic into consume method
 2014-10-27 14:04:10 -07:00
R. Tyler Croy f0b019ed69 Update the C provider to accept a topic into the consume method 
Note: this doesn't actually do anything just yet
 2014-10-27 09:42:01 -07:00
jway 5e0079ce05 allow passing topic into consume method 2014-10-25 09:12:47 -07:00
R. Tyler Croy 0cc02f40b7 Merge pull request #61 from rtyler/issues/58-java-exception 
Wrap calls to the underlying Java producer with Ruby-based exceptions
 2014-10-24 12:32:06 -07:00
R. Tyler Croy 8c01040f5d Wrap calls to the underlying Java producer with some Ruby-based exception handling 
Fixes #58
 2014-10-24 11:47:51 -07:00