View profile

Data is Expensive; Dbt Refactoring; Data Mesh Platform Architecture; ThDPTh #46

Three Data Point Thursday
Data is Expensive; Dbt Refactoring; Data Mesh Platform Architecture; ThDPTh #46
By Sven Balnojan  • Issue #50 • View online
This week I just started to prepare a workshop on refactoring in the data space, something that seems to be really hard for people.
Just then I stumbled over the “Dbt Labs Refactoring Guide” which surprised me with one thing: It’s missing the essential first step to refactoring.
Read about it below…
I’m Sven, I collect “Data Points” to help understand & shape the future, one powered by data.

Svens Thoughts
If you only have 30 seconds to spare, here is what I would consider actionable insights for investors, data leaders, and data company founders.
- The future of data tooling marketing might look very different than it currently does. Instead of big X technologies, we might see more miniX technologies that allow easy combination into small components.
- The future of building data applications might look different than it currently does. Instead of having big centralized pots of things, like ELT tools, data lakes, serving layers, we might end up with what the software engineering side already successfully uses, cuts alongside business lines, separate “pots” for e.g. the marketing data applications, and so on.
- Testing is still completely underrated in the data world. Still, almost all data developers shy away from testing first, and developing second. Even the Dbt refactoring guide forgets to mention the word “test” which should be the very first one.
- Platforms with heterogeneous user sets in cross-section need a lot more modularization than others. When taking a look at the common logical architecture of data mesh platforms, we will realize that it’s pretty modularized. But that fact doesn’t come from the specifics of a data platform but rather from the fact that it mediates at the very least between three parties.
🎄 Thanks!
Thanks for reading this far! I’d also love it if you shared this newsletter with people whom you think might be interested in it.
Data will power every piece of our existence in the near future. I collect “Data Points” to help understand & shape this future.
If you want to support this, please share it on Twitter, LinkedIn, or Facebook.
And of course, leave feedback if you have a strong opinion about the newsletter! So?
P.S.: I share things that matter, not the most recent ones. I share books, research papers, and tools. I try to provide a simple way of understanding all these things. I tend to be opinionated. You can always hit the unsubscribe button!
Did you enjoy this issue?
Sven Balnojan

Data; Business Intelligence; Machine Learning, Artificial Intelligence; Everything about what powers our future.

In order to unsubscribe, click here.
If you were forwarded this newsletter and you like it, you can subscribe here.
Powered by Revue