rmoff 🏃🏻 🍺 🥓 · @rmoff
1153 followers · 800 posts · Server data-folks.masto.host
✍🏻 Final part of my blog series on Write-Audit-Publish (WAP), in which I show in detail how to implement it using #apacheSpark, @deltalakeoss, #Minio, and @lakeFS
---
📝part 1: 🙋🏻What is WAP? https://lakefs.io/blog/data-engineering-patterns-write-audit-publish/?utm_campaign=Social%20media%20activity&utm_source=Mastodon&utm_medium=social&utm_content=blog_rm-wap1
📝part 2: 🛠️ Comparing how different tools implement WAP https://lakefs.io/blog/how-to-implement-write-audit-publish/?utm_campaign=Social%20media%20activity&utm_source=Mastodon&utm_medium=social&utm_content=blog_rm-wap2
#ApacheSpark #minio #writeauditpublish #dataengineering #datadon #opensource
rmoff 🏃🏻 🍺 🥓 · @rmoff
1151 followers · 797 posts · Server data-folks.masto.host
🔧🔨 How to Implement Write-Audit-Publish (WAP) - an exploration of how WAP can be done on @apacheicebergdevs, #apacheHudi, @deltalakeoss, @lakeFS , or #projectNessie
🙋🏻 What is WAP?
👉🏻 Check out yesterday's blog: https://lakefs.io/blog/data-engineering-patterns-write-audit-publish/?utm_campaign=Social%20media%20activity&utm_source=Mastodon&utm_medium=social&utm_content=blog_rm-wap1
#apachehudi #projectnessie #dataengineering #data #writeauditpublish #datadon
rmoff 🏃🏻 🍺 🥓 · @rmoff
1150 followers · 793 posts · Server data-folks.masto.host
✍🏻First in a three-part blog series: Data Engineering Patterns: Write-Audit-Publish (WAP)
#dataengineering #data #writeauditpublish #datadon