Looking to streamline your data pipelines? 💡
In this tutorial, Marija Selakovic, CrateDB's Developer Advocate, shows you how to streamline data ingestion, transformation, and loading (ETL) processes with just a few lines of Python code 📊

Check out the tutorial here: 👉 https://hubs.ly/Q020TZs50

#db #data #database #CrateDB #Prefect #DataPipelines #Python #ETL

Two months into the new position and new stack. Findings:
1. #Redshift’s performance is slightly better than what it was in 2021. Still not worth the money.
2. #Prefect is the worst orchestrator one can choose for #DataEngineering purposes. It’s horrible operation-wise and lacks in terms of fundamental pillars of data engineering; example: “context/logical date” (in #Airflow speak) is absent, which means you’re limited to dumb “full refresh” jobs

Does anyone here have experience with #Prefect? What's the best way to automate blocks? can you do it via #terraform? #ml #mlengineering

It takes adding just two lines to a Docker image to bake your Prefect flow code in for a Kubernetes job. See my new post in the Prefect + K8s series to learn more. 🚀

https://medium.com/the-prefect-blog/e2223ce34ba7

#Prefect #docker #kubernetes #python

👋 Looking to coordinate your dataflow with Prefect and K8s? I just published a second article in my series that shows three ways you can customize Kubernetes Job blocks for your deployments. Check it out if you’re into that kind of thing! 🎉

https://medium.com/the-prefect-blog/how-to-use-kubernetes-with-prefect-part-2-2e98cdb91c7e

#data #kubernetes #prefect

@mark @zach @jayatid -What is the best way to get part time projects using MDS (#dbt, #Airbyte, #Prefect, #Snowflake etc). My Past was more in Azure stack. Now moving to MDS. I would like to work with experts to learn more as well help them .

#Introduction Hi #data folks - I'm Jill, a community leader who has been working in the #data community since 2014.

I'm currently the head of #Community & #DevRel at #Fivetran. Current projects include #dbt, #Airflow, #Prefect, #Dagster #Terraform. I'm also on the board of our #MentalHealth & #Neurodiversity ERG.

I love connecting with our users, so please reach out if you have feedback or ideas to share.

Here to help & connect - no vendor plugs!