Commit Graph

7 Commits

Author SHA1 Message Date
R Tyler Croy 3386acc3b6 Tinkering with wiring through the events into a processing/matching loop
This will help filter out events which are not important
2021-04-21 11:05:19 -07:00
R Tyler Croy 95109ae12d Add some properly structured test data and a destination audit_log delta table 2021-04-21 10:30:35 -07:00
R Tyler Croy 4fe1319e27 Working on the means of actually configuring the desired behavior 2021-04-17 15:37:47 -07:00
R Tyler Croy 922a08efdc Returning to schema inference work 2021-04-17 14:41:18 -07:00
R Tyler Croy a795083129 Checkpointing some work on the lambda side of things, processing inbound events
At this point I'm still spending a lot of time reading through some
kafka-delta-ingest and arrow code to figure out exactly how I want to do schema
inference and writes.
2021-04-14 22:21:09 -07:00
R Tyler Croy bf1fb592e3 Set up the right dependencies and bring the bits of a lambda_runtime example in 2021-04-14 20:11:07 -07:00
R Tyler Croy 316c79fe1c Initial commit 2021-04-14 20:00:27 -07:00