This replaces the old "overwrite_schema" parameter with a
schema_write_mode parameter that basically allows to distinguish between
overwrite/merge/none
Fixes#1386
# Description
As requested by @ion-elgreco in #2229 , we should fix the formatter
versions
# Related Issue(s)
<!---
For example:
- closes#106
--->
# Documentation
<!---
Share links to useful documentation
--->
Adds a docs page on the Delta Lake best practices.
This is a first pass and I think this should evolve over time.
This is some of the most important content for our users IMO.
# Description
First/naive implementation of `replaceWhere` for `write`. Code compiles
and there is a test to verify the outcome. I would appreciate any
feedback on improving the structure/implementation. For example, I
copied the part of code from `delete` operation because there is no way
to call that code in `delete` directly from `write` - should I look into
extracting that code from `delete` to somewhere central?
Seems to also works with partitions columns.
# Related Issue(s)
https://github.com/delta-io/delta-rs/issues/1957
# Documentation
Added a section in docs
---------
Signed-off-by: Nikolay Ulmasov <ulmasov@hotmail.com>
Co-authored-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
# Description
Add page describing how Delta Lake is great for small data too.
# Related Issue(s)
n/a
# Documentation
This PR introduces a new docs page.
# Description
Adds the dynamo docs into our new docs, within the python
write_deltalake I am pointing to the guide since it's quite extensive
and only for S3 users.
@rtyler @dispanser
@nkarpov and I collaborated on this Delta Lake transactions post.
It's meant to give the basics on how transactions work and why they're a
huge advantage of Delta Lakes.
@rtyler is giving a talk on transactions/concurrency soon. We're trying
to set the stage with some foundational content first.
---------
Co-authored-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
# Description
Currently Usage/Overview points as `usage/index.md` and therefore it
does not appear in the left-hand-side menu (it is hidden behind the
`Usage` header of the sub-menu. Renaming the files fixes that
Signed-off-by: Nikolay Ulmasov <ulmasov@hotmail.com>
- Adds transparent logo (we need a higher quality one), I've pinged
@fvaleye on Slack to check whether he has one.
- Add dark mode toggle
- Boost some search results since it was prioritizing the guides over
the API reference
# Description
I have made a bunch of improvements to fix the overall structure due to
example sections not being consistent. I've also enabled some extra
features. Fixed also the issue of some classes/functions not being shown
properly.
# Description
Updated the docs home page to include more information about the
project.
Also added a pandas integration page. Lots more integration pages to
come soon hopefully!
# Description
Adds docs on how to append, overwrite, delete rows, and Z Order Delta
tables.
Will add much more detailed pages in the future. Just getting the
high-level skeleton of the docs developed.
# Description
Completed the outstanding tasks in #1708
Also changed theme from readthedocs to mkdocs - both are built-in but
latter looks sleeker
# Related Issue(s)
closes#1708
---------
Co-authored-by: Robert Pack <42610831+roeap@users.noreply.github.com>
Co-authored-by: R. Tyler Croy <rtyler@brokenco.de>
* Update ADLSGen2-HOWTO.md
I had a hard time figuring out how to connect to a delta table that is stored in ADLS Gen2 and only found a way by digging into the source code. I would like to save other people the same trouble by adding this to the docs.
* altered prefix for azure
Avril Aysha
Stephen Carman
Alessandro Rinaldi
LauH1987
vladislav doster
gautham acharya
Adrian Ehrsam
Adrian Ehrsam
Matthew Powers
Niko
Richard Pelgrim
Ion Koutsouris
Will Jones
Robert Pack
dgcaron
Thomas Vollmer