🔮 Even though I like to talk about the new entrants into the data orchestration space dagster and prefect a lot, Airflow is still and might still keep on being the winner in this category.
HomeToGo has a huge data operation running, being the largest vacation rental engine in the world. This article explains the journey part of the journey, not the pretty end result which I really enjoy.
I like the focus the team puts on developer experience by providing good tools to do local development, in their case inside a decent docker image.
“make it runnable super easily.”
Keep that in mind, and take a look at your local data development environment.