rtyler
/
delta-s3-loader
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
An AWS Lambda for automatically loading JSON files as they're created into Delta tables
11 Commits 1 Branch 0 Tags 92 KiB
Rust 100%
Go to file
R Tyler Croy 88264d83c9 Update the README to make it clear that this isn't going to be lambda only 2021-06-10 10:59:15 -07:00
data Add some properly structured test data and a destination audit_log delta table 2021-04-21 10:30:35 -07:00
src Make lambda an optional build target 2021-05-21 19:40:59 -07:00
.gitignore Update the README to make it clear that this isn't going to be lambda only 2021-06-10 10:59:15 -07:00
Cargo.lock Make lambda an optional build target 2021-05-21 19:40:59 -07:00
Cargo.toml Make lambda an optional build target 2021-05-21 19:40:59 -07:00
LICENSE.txt
…
README.adoc Update the README to make it clear that this isn't going to be lambda only 2021-06-10 10:59:15 -07:00
config.yml Tinkering with wiring through the events into a processing/matching loop 2021-04-21 11:05:19 -07:00

README.adoc

<html lang="en"> <head> </head>

Delta S3 Loader

Delta S3 Loader is a project to quickly and cheaply bring JSON files added to S3 buckets into Delta Lake. This can be highly useful for legacy or external processes which rely on uploading JSON to an S3 bucket and cannot be properly updated to write directly to Delta Lake.

Delta S3 Loader can be built into a stnadalone binary or an AWS Lambda.

Last updated 2024-05-09 21:37:54 UTC
</html>