rtyler
/
delta-s3-loader
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
An AWS Lambda for automatically loading JSON files as they're created into Delta tables
3 Commits 1 Branch 0 Tags 92 KiB
Rust 100%
Go to file
R Tyler Croy a795083129 Checkpointing some work on the lambda side of things, processing inbound events 
At this point I'm still spending a lot of time reading through some
kafka-delta-ingest and arrow code to figure out exactly how I want to do schema
inference and writes.
 		2021-04-14 22:21:09 -07:00
src Checkpointing some work on the lambda side of things, processing inbound events 2021-04-14 22:21:09 -07:00
.gitignore Initial commit 2021-04-14 20:00:27 -07:00
Cargo.lock Checkpointing some work on the lambda side of things, processing inbound events 2021-04-14 22:21:09 -07:00
Cargo.toml Checkpointing some work on the lambda side of things, processing inbound events 2021-04-14 22:21:09 -07:00
LICENSE.txt Initial commit 2021-04-14 20:00:27 -07:00
README.adoc Initial commit 2021-04-14 20:00:27 -07:00

README.adoc

<html lang="en"> <head> </head>

Delta S3 Loader

This AWS Lambda serves a singular purpose: bring JSON files from an S3 bucket into Delta Lake. This can be highly useful for legacy or external processes which rely on uploading JSON to an S3 bucket and cannot be properly updated to write directly to Delta Lake.

Last updated 2024-05-10 08:38:06 UTC
</html>