R Tyler Croy
2f5f68b35c
Load environment variables optionally from .env
...
This is most helpful for local testing 😸
2021-06-12 09:48:34 -07:00
R Tyler Croy
c20997b197
Sketching out the design and implementation of Delta S3 Loader
...
There is still more to think about but this is a reasonable checkpoint to commit
and push for others to look at.
2021-06-11 11:50:22 -07:00
R Tyler Croy
fb0582e4ca
Make lambda an optional build target
...
This will help for use-cases where running AWS Lambda is cost-prohibitive
because the volume of inbound events is so high
2021-05-21 19:40:59 -07:00
R Tyler Croy
4fe1319e27
Working on the means of actually configuring the desired behavior
2021-04-17 15:37:47 -07:00
R Tyler Croy
a795083129
Checkpointing some work on the lambda side of things, processing inbound events
...
At this point I'm still spending a lot of time reading through some
kafka-delta-ingest and arrow code to figure out exactly how I want to do schema
inference and writes.
2021-04-14 22:21:09 -07:00
R Tyler Croy
bf1fb592e3
Set up the right dependencies and bring the bits of a lambda_runtime example in
2021-04-14 20:11:07 -07:00
R Tyler Croy