Data Mesh vs Data Fabric: Lessons From Implementing Both in Real Organizations
I have been in data engineering long enough to remember when Hadoop was going to solve everything. Then Spark. Then the cloud data warehouse. Now it is Data Mesh and Data Fabric, and if you read the vendor literature, you might conclude that both will solve everything and are also slightly incompatible with each other.
I have implemented Data Mesh principles in two large organizations and worked alongside a Data Fabric initiative in a third. Here is what I actually think, stripped of the marketing language.
What Data Mesh asks you to change
Data Mesh is primarily an organizational pattern, not a technology pattern. The core ask is: stop centralizing all data engineering in one team and instead distribute data ownership to the domain teams who understand and produce the data. The central data team becomes a platform team that builds the self-service infrastructure domain teams use, rather than a...
Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE
