From 88264d83c9a462ce13c803bb64d8b62d39accfca Mon Sep 17 00:00:00 2001 From: "R. Tyler Croy" Date: Thu, 10 Jun 2021 10:59:15 -0700 Subject: [PATCH] Update the README to make it clear that this isn't going to be lambda only --- .gitignore | 1 + README.adoc | 14 ++++++++------ 2 files changed, 9 insertions(+), 6 deletions(-) diff --git a/.gitignore b/.gitignore index ea8c4bf..e9868bd 100644 --- a/.gitignore +++ b/.gitignore @@ -1 +1,2 @@ /target +*.swp diff --git a/README.adoc b/README.adoc index 7da36f3..8818fd8 100644 --- a/README.adoc +++ b/README.adoc @@ -1,14 +1,16 @@ = Delta S3 Loader -This link:https://aws.amazon.com/lambda/[AWS Lambda] serves a singular purpose: -bring JSON files from an S3 bucket into Delta Lake. This can be highly useful -for legacy or external processes which rely on uploading JSON to an S3 bucket -and cannot be properly updated to write directly to link:https://delta.io[Delta -Lake]. +Delta S3 Loader is a project to quickly and cheaply bring JSON files added to +S3 buckets into Delta Lake. This can be highly useful for legacy or external +processes which rely on uploading JSON to an S3 bucket and cannot be properly +updated to write directly to link:https://delta.io[Delta Lake]. + +Delta S3 Loader can be built into a stnadalone binary or an +link:https://aws.amazon.com/lambda/[AWS Lambda]. == Related work -link:https://docs.databricks.com/spark/latest/structured-streaming/auto-loader.html[S3 Auto-loader] +link:https://docs.databricks.com/spark/latest/structured-streaming/auto-loader.html[S3 Auto-loader in Apache Spark]