🌪️ Just published my first blog post on Apache Airflow: a zero-to-one introduction to this tool. It details how to get it up and running using Docker 🐳, guides you through creating and scheduling simple pipelines 📊, and shows how to keep an eye on them with the Airflow UI.

https://www.franciscoyira.com/post/data-pipelines-cloud-intro-airflow-docker/
#ApacheAirflow #DataScience

I find #scopecreep to be a real problem with #selfGuidedLearning, particularly online. Do others find the same and, if so, how do you deal with it?

As an example, I sat down to dig into #ApacheSuperset but that led to #ApacheAirflow, which lead to the Astronomer.io service, which led to #ApacheFlink. By the end of the day I’d had a great overview of some really neat stuff but was not better positioned to be productive in Superset than I was at the start of the day.

Tech news digest from Alex, July’23

#apacheairflow #dbt #aws #snowflake

https://agordienko.medium.com/tech-news-digest-from-alex-july23-19950d00b22a

Do you know how to harness the power of Apache Airflow with CrateDB?

Learn it step-by-step in this first article of its series by Niklas Schmidtmer and Marija Selaković from CrateDB's Customer Engineering team 👩🏻‍💻👨🏼‍💻

Read it here 👇🏼
https://hubs.ly/Q01QFZcL0

#apacheairflow #queries #astronomer #cratedb #cloud #db #database

➡️ Hear about #ApacheAirflow, what it is & how it helps with orchestrating data pipelines.

➡️ Learn what are some of the tradeoffs of using Apache Airflow, and what are some new capabilities that teams can use.

#InfoQ video by Ricardo Sueiras: http://bit.ly/3ZqmdJd

#HybridCloud #DataPipelines #Deployment

A great introduction to #apacheairflow with an interesting (quickly and easily transposable) use case.

How to Orchestrate an ETL Data Pipeline with Apache Airflow: https://www.freecodecamp.org/news/orchestrate-an-etl-data-pipeline-with-apache-airflow/

The Bay Area Apache Airflow Meetup is meeting in San Francisco on Tuesday, February 28, 2023 https://www.meetup.com/bay-area-apache-airflow-incubating-meetup/events/291521444/ #ApacheAirflow #opensource

We’ve just released #ApacheAirflow #HelmChart 1.8.0 ✨

📦 ArtifactHub: https://artifacthub.io/packages/helm/apache-airflow/airflow
📚 Docs: https://airflow.apache.org/docs/helm-chart/1.8.0/
🚀 Quick Start Installation Guide: https://airflow.apache.org/docs/helm-chart/1.8.0/quick-start.html
🛠️ Release Notes: https://airflow.apache.org/docs/helm-chart/1.8.0/release_notes.html

We’ve just released #ApacheAirflow 2.5.1 🎉
📦 PyPI: https://pypi.org/project/apache-airflow/2.5.1/
📚 Docs: https://airflow.apache.org/docs/apache-airflow/2.5.1/
🛠️ Release Notes: https://airflow.apache.org/docs/apache-airflow/2.5.1/release_notes.html
🐳 Docker Image: `docker pull apache/airflow:2.5.1`
🚏 Constraints: https://github.com/apache/airflow/tree/constraints-2.5.1

Thanks to all the contributors who made this possible.

#Diary #Work
Recovering step by step, so could spend a day working without much distraction.

On the other hand, I have a complicated thing to deploy and struggle to find a root cause why my new DAG is killing a #ApacheAirflow scheduler every time it's imported.

📢FREE eBook📢

Looking for a platform you can use to design, implement, monitor, and maintain your pipelines?

Look no further than Apache Airflow!

Find everything you need to get started with Apache Airflow in this free PDF eBook by Bas Harenslak and Julian de Ruiter, courtesy of Astronomer: http://mng.bz/nJZd

#datapipelines #datascience #apacheairflow #data

ok #apacheairflow install failed. Need to #RTFM better I suspect

Just installing #apacheairflow for some experimentation. I know, late to the party.

Hey Mastodon! I created a "content directory" for all my content across Linkedin, Twitter, and YouTube.

I spent about 60 hours engineering this over the last 2 weeks.

You can see my content split into categories like #dataengineering #apachespark, #apacheairflow, etc.

I'll be adding a search function soon too so you can find exactly what you're looking for from the mountain of content I've created over the last two years!

Check it out here!

https://www.eczachly.com/about

Hey Mastodon! I created a "content directory" for all my content across Linkedin, Twitter, and YouTube.

I spent about 60 hours engineering this over the last 2 weeks.

You can see my content split into categories like #dataengineering #apachespark, #apacheairflow, etc.

I'll be adding a search function soon too so you can find exactly what you're looking for from the mountain of content I've created over the last two years!

Check it out here!

https://www.eczachly.com/about