Ben Osheroff
784a7f3afe
1.9.3 compatibility
2015-04-27 12:32:58 -07:00
R. Tyler Croy
dd25bc9586
Merge pull request #94 from zendesk/unify_initialize
...
Unify Consumer#initialize
2015-04-27 11:16:26 -07:00
Ben Osheroff
71c21d327e
delete options in Consumer#initialize before passing along
2015-04-27 10:12:31 -07:00
Ben Osheroff
6db14ceeb7
version 0.23.0
2015-04-27 09:54:02 -07:00
Ben Osheroff
18c73f3f82
update README.md with new consumer info
2015-04-27 09:37:53 -07:00
Ben Osheroff
3792ee206b
unify jruby/mri Consumer#initialize
...
While we do require different options between jruby & mri, there is a
common "topic" option. The rest we pass in the options hash.
2015-04-27 09:32:16 -07:00
Ben Osheroff
d579f2f8ec
use rb_thread_call_without_gvl
...
this allows threaded code on modern (>=2.0) rubies working. Also,
switch to the single-message form of the rd_kafka call -- the callback
form isn't safe to run without the GVL held, as it enters the ruby
interpreter in rb_yield().
2015-04-21 14:02:48 -07:00
R. Tyler Croy
0690634e4c
Reference the appropriate gemspec for releasing
2015-04-09 11:35:48 -07:00
R. Tyler Croy
e99c657144
Add suppor for auto-releasing to rubygems.org from travis
2015-04-08 12:55:19 -07:00
R. Tyler Croy
f3f23965bd
Bump a minor version for an API addition
2015-04-06 17:42:49 -07:00
R. Tyler Croy
9514a82a9d
Merge pull request #89 from lsb/master
...
Add support for a partition key for producers
2015-04-06 17:41:47 -07:00
Lee Butterman
f059643efc
Add support for a partition key for producers.
...
Fixes lookout/Hermann#88
2015-04-06 17:35:38 -07:00
R. Tyler Croy
911b527b55
Merge pull request #90 from lookout/add-large-file
...
Add large file support
2015-04-04 12:38:47 -07:00
jway
96c0a74bf5
0.20.4 add large file support, fix bug passing options
2015-04-04 11:47:29 -07:00
R. Tyler Croy
17a4dba8d2
Merge pull request #86 from phrinx/master
...
Cleanup jar dependencies
2015-03-28 09:59:12 -07:00
Dirk Koehler
3b03658220
Bring back Jarfile and remove curator from dependency
2015-03-27 17:25:31 -07:00
Dirk Koehler
70f52204c7
Upgrade version to 0.20.3
2015-03-26 23:06:15 -07:00
Dirk Koehler
163c9d70c6
Cleanup jar dependencies
...
- move Jarfile dependency into gemspec
- upgrade curator to 2.7.1
- fix tests
- remove transient dependencies
2015-03-26 22:58:13 -07:00
R. Tyler Croy
5f783476f8
Bump to 0.20.2 for release
2015-02-23 15:03:07 -08:00
R. Tyler Croy
9dd7152d44
Merge pull request #77 from rb2k/patch-1
...
Fix MRI documentation in consumer.rb
2014-12-15 08:34:39 -08:00
Marc Seeger
b7c35cb78c
Fix MRI documentation in consumer.rb
2014-12-14 21:06:11 -05:00
R. Tyler Croy
4661aa75b6
I don't consider this alpha stage anymore
2014-12-14 10:27:43 -08:00
R. Tyler Croy
aeaec0269c
Merge pull request #76 from rtyler/issues/75-native-zookeeper
...
Implement a Java-native Zookeeper interface with Curator
2014-11-21 21:01:24 -08:00
R. Tyler Croy
495ac2687a
Refactor out the block support from #each_brokers and bring back `timeout` for the ZkGemImpl
...
[1] pry(main)> d = Hermann::Discovery::Zookeeper.new('zk0.REDACTED.com:2181')
=> #<Hermann::Discovery::Zookeeper:0x57186526
@impl=
#<Hermann::Discovery::Zookeeper::CuratorImpl:0x391d1e33
@curator=
#<Java::OrgApacheCuratorFrameworkImps::CuratorFrameworkImpl:0x5287ba5f>>,
@zookeepers="zk0.REDACTED.com:2181">
[2] pry(main)> d.get_brokers
log4j:WARN No appenders could be found for logger (org.apache.curator.framework.imps.CuratorFrameworkImpl).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
=> ["kafka0.REDACTED.com:6667",
"kafka1.REDACTED.com:6667"]
[3] pry(main)>
[1] pry(main)> d = Hermann::Discovery::Zookeeper.new('zk0.REDACTED.com:2181')
=> #<Hermann::Discovery::Zookeeper:0x7b6141f0
@impl=
#<Hermann::Discovery::Zookeeper::ZkGemImpl:0x4fb64a52
@zookeepers="zk0.REDACTED.com:2181">,
@zookeepers="zk0.REDACTED.com:2181">
[2] pry(main)> d.get_brokers
log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
=> ["kafka0.REDACTED.com:6667",
"kafka1.REDACTED.com:6667"]
[3] pry(main)>
2014-11-21 20:39:11 -08:00
R. Tyler Croy
136e0ace47
Add suppot for optionally using Curator if it's on the classpath for broker discovery
...
This change makes the loading of the 'zk' gem optional and implicit, as well as
the reliance on Curator being available in the JRuby runtime's classpath.
If neither Zookeeper client implementation are available, an exception will be
raised when attmepting to use Zookeeper-based discovery
Fixes #75
2014-11-21 18:06:56 -08:00
R. Tyler Croy
c46156a7d1
Move the `zk` gem from a explicit gem dependency to an implicit dependency
...
This will give us some optionality on how we want to reach out and contact
Zookeeper across multiple environments. See #75
2014-11-21 15:16:01 -08:00
R. Tyler Croy
8ed1ba91ba
Merge pull request #74 from lookout/add-errors
...
include errors file
2014-11-17 17:09:47 -08:00
jway
b4699845c5
include errors file
2014-11-17 17:01:44 -08:00
R. Tyler Croy
7fe085a0c0
Merge pull request #73 from lookout/fix-execeptioning
...
fixup exception handling in consumer
2014-11-14 07:53:55 -08:00
jway
6300705af9
fixup exception handling in consumer
2014-11-13 16:23:40 -08:00
james
4ef0bb0498
Merge pull request #71 from rtyler/log4j-upgrade
...
Force a more recent version of log4j as a jar dependency
2014-11-12 09:19:18 -08:00
R. Tyler Croy
c6ab5e760c
Force a more recent version of log4j as a jar dependency
...
The log4j has distributed some bad packages in the past but this release looks
safe to include
2014-11-12 08:53:44 -08:00
R. Tyler Croy
d89d17119b
Jump up to 0.20
2014-10-31 12:25:46 -07:00
R. Tyler Croy
3783b6deb8
Merge pull request #70 from rtyler/proto-test
...
Add a repro case and fix for binary data through Hermann
2014-10-31 12:11:28 -07:00
R. Tyler Croy
0f7714175b
Correct test failures with the API changes to Hermann exceptions and some underlying expectations
2014-10-31 12:02:17 -07:00
R. Tyler Croy
f2ceab296c
Properly marshal bytes in and out of the Kafka client library
...
The primary issue with marshalling bytes back and forth previously was the use
of the StringEncoder class. By default the Kafka client library uses the
DefaultEncoder which is a no-op and simply allwos byte arrays through
2014-10-31 11:32:49 -07:00
R. Tyler Croy
61c0426cbe
Catch all Java related exceptions and raise them up out of Hermann::Producer#push_single
2014-10-31 11:24:11 -07:00
R. Tyler Croy
228358edc1
Add a failing integration test for pumping protobufs through Hermann
2014-10-30 10:46:18 -07:00
R. Tyler Croy
7f4de34be0
Refactor the Hermann::Producer Java-based integration test to respect integration.yml
...
I've also refactored/cleaned it up a bit to make sure it runs properly on my machine
2014-10-30 10:46:18 -07:00
james
18b49cee98
Update README.md
2014-10-30 10:13:35 -07:00
james
4ceff1705b
Update README.md
2014-10-30 10:12:05 -07:00
R. Tyler Croy
3c9c234c43
Update the Hermann::Discovery::Zookeeper API to return an Array of brokers more suitable for Hermann::Producer
2014-10-30 10:05:34 -07:00
james
fb24605d5b
Update README.md
2014-10-30 10:02:49 -07:00
R. Tyler Croy
8400cfdc15
Add support for spec:integration to ignore MRI and Java cases off their respective platforms
2014-10-30 09:47:11 -07:00
R. Tyler Croy
3b3b100c0d
Add protobuffy as a development dep
2014-10-29 20:53:03 -07:00
R. Tyler Croy
3264ce1b23
Merge pull request #69 from lookout/fix-producer
...
Pass string to JavaProducer
2014-10-29 19:05:23 -07:00
jway
132dbb94a9
pass string to JavaProducer
2014-10-29 16:59:34 -07:00
R. Tyler Croy
c3f5744568
Bump the version for 0.19 milestone
2014-10-28 20:50:13 -07:00
R. Tyler Croy
d2ef453494
Tick the underlying librdkafka reactor on each subsequent Hermann::Producer#push call
...
References #48
2014-10-28 20:47:25 -07:00
R. Tyler Croy
4ea21d5add
Account for a subtle internal API change between the C and Java Producers
2014-10-28 18:18:05 -07:00