Commit Graph

20 Commits

Author SHA1 Message Date
R. Tyler Croy dfbb26399d
Experimenting with observing ChildData and turning into a stream of Brokers 2015-09-04 15:24:35 -07:00
R. Tyler Croy f1a539541d
Convert PathCacheObservable experiment to use code refactored into rx-curator 2015-09-04 13:20:19 -07:00
R. Tyler Croy f46fb4f0f4
Pull in rx-curator for some experimentation 2015-09-04 12:48:33 -07:00
R. Tyler Croy 4eee010938
Add a simple PathChildrenCache experiment trying to tie Curator into RxJava
Running this against a running Kafka results in:

    9:14:42 AM: Executing external task 'runExperiment -t -PexperimentClass=rx.curator.PathCacheObservable'...
    :compileJava UP-TO-DATE
    :compileGroovy UP-TO-DATE
    :processResources UP-TO-DATE
    :classes UP-TO-DATE
    :compileExperimentsJava UP-TO-DATE
    :compileExperimentsGroovy
    :processExperimentsResources UP-TO-DATE
    :experimentsClasses
    :compileTestJava UP-TO-DATE
    :compileTestGroovy UP-TO-DATE
    :processTestResources UP-TO-DATE
    :testClasses UP-TO-DATE
    :test UP-TO-DATE
    :runExperiment
    Starting PatchCacheObservable experiment
    log4j:WARN No appenders could be found for logger (org.apache.curator.framework.imps.CuratorFrameworkImpl).
    log4j:WARN Please initialize the log4j system properly.
    log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
    Starting dataset: []
    heard PathChildrenCacheEvent{type=CHILD_ADDED, data=ChildData{path='/brokers/topics', stat=4294967331,4294967331,1412043135590,1412043135590,0,27,0,0,0,27,824641831943
    , data=null}} from org.apache.curator.framework.imps.CuratorFrameworkImpl@5eb30746
    received: PathChildrenCacheEvent{type=CHILD_ADDED, data=ChildData{path='/brokers/topics', stat=4294967331,4294967331,1412043135590,1412043135590,0,27,0,0,0,27,824641831943
    , data=null}}
    heard PathChildrenCacheEvent{type=CHILD_ADDED, data=ChildData{path='/brokers/ids', stat=4294967330,4294967330,1412043135586,1412043135586,0,135,0,0,0,3,824659713847
    , data=null}} from org.apache.curator.framework.imps.CuratorFrameworkImpl@5eb30746
    received: PathChildrenCacheEvent{type=CHILD_ADDED, data=ChildData{path='/brokers/ids', stat=4294967330,4294967330,1412043135586,1412043135586,0,135,0,0,0,3,824659713847
    , data=null}}
    heard PathChildrenCacheEvent{type=INITIALIZED, data=null} from org.apache.curator.framework.imps.CuratorFrameworkImpl@5eb30746
    complete
    Final data: [ChildData{path='/brokers/ids', stat=4294967330,4294967330,1412043135586,1412043135586,0,135,0,0,0,3,824659713847
    , data=null}, ChildData{path='/brokers/topics', stat=4294967331,4294967331,1412043135590,1412043135590,0,27,0,0,0,27,824641831943
    , data=null}]

    BUILD SUCCESSFUL

    Total time: 9.821 secs

This doesn't really result in much interesting other than the events being sent
along to the subscriber properly, which I suppose is neat
2015-09-04 09:15:42 -07:00
R. Tyler Croy 65a6a19b6d
Add support for running arbitrary experiments with our classpath 2015-09-04 09:15:20 -07:00
R. Tyler Croy 7e2d1691ca
Checkpoint some experimenting with a BrokerMonitor
Still figuring out how to map the PathCache concept from Curator into RxJava
observables
2015-09-04 08:01:12 -07:00
R. Tyler Croy f4e96ebace
Mark psuedo-code as java 2015-09-03 15:53:40 -07:00
R. Tyler Croy 36654bd721
Sketching out some more example prototypes 2015-09-03 15:51:53 -07:00
R. Tyler Croy 450d0bd0c9
Add kafka clients as a build dep 2015-09-03 14:47:23 -07:00
R. Tyler Croy aeead3c2d3
Sketch out a discovery-less API 2015-09-03 14:47:23 -07:00
R. Tyler Croy b251f98600
Add a travis.yml so Travis doesn't think this is a ruby project
lolwut
2015-09-03 14:47:23 -07:00
R. Tyler Croy 5ae49a3332 Clean up some JSON 2015-09-03 14:24:48 -07:00
R. Tyler Croy a21e86544e
Add a HACKING document with some notes about Kafka 0.8's ZK layout 2015-09-03 14:22:30 -07:00
R. Tyler Croy 07fa6dcfad
Rephrase my prototype API 2015-09-03 13:21:19 -07:00
R. Tyler Croy 5ecbc06923
Braindump some thoughts on an rxjava observable API 2015-09-03 07:32:24 -07:00
R. Tyler Croy 0819fc3857
Add brokerId to the Broker pojo 2015-09-02 12:39:49 -07:00
R. Tyler Croy a42c0fa3dd
Add a simple README for now 2015-09-02 11:52:08 -07:00
R. Tyler Croy 3f6601b18c
Add a Broker pojo 2015-09-02 11:48:03 -07:00
R. Tyler Croy d6aac679b5
Borrow TopicPartition from Verspaetung
See https://github.com/lookout/verspaetung
2015-09-02 11:26:38 -07:00
R. Tyler Croy 6a0dc264d4
initial commit 2015-09-02 11:13:48 -07:00