2021-04-15 03:00:27 +00:00
|
|
|
= Delta S3 Loader
|
|
|
|
|
|
|
|
|
|
This link:https://aws.amazon.com/lambda/[AWS Lambda] serves a singular purpose:
|
|
|
|
|
bring JSON files from an S3 bucket into Delta Lake. This can be highly useful
|
|
|
|
|
for legacy or external processes which rely on uploading JSON to an S3 bucket
|
|
|
|
|
and cannot be properly updated to write directly to link:https://delta.io[Delta
|
|
|
|
|
Lake].
|
|
|
|
|
|
|
|
|
|
|
2021-04-17 21:41:18 +00:00
|
|
|
|
|
|
|
|
== Related work
|
|
|
|
|
|
|
|
|
|
link:https://docs.databricks.com/spark/latest/structured-streaming/auto-loader.html[S3 Auto-loader]
|
|
|
|
|
|
