Atomic Talk Title: Shift Left Data Quality with Data Mesh Principles.

Data mesh is a socio-technical approach to managing analytical data at scale. It is rooted in 4 principles that facilitate each other. Domain-driven decentralized ownership of data to increase proximity between data producers and data consumers, data as a product to delight customers, a self-serve platform to unleash the economies of scale, and federated computational governance to ensure interoperability and global standards.
Oftentimes the rate of adoption of data systems is low due to a lack of trust. This lack of trust is due to the lack of trust in the underlying data. I can’t trust the insights produced by the system unless I trust the data on which it is built. We have seen in large organizations the centralized data teams to whom the product teams throw their data over a wall. The central team does not understand that domain data! The data quality rules are associated with that data.
This is particularly toxic as the cost of ensuring data integrity increases as it moves more and more right towards consumption.
In this talk, I will outline this paradigm of data mesh and how it enables us to shift data quality left.

Talk Takeaways

• Data quality is best addressed at the source.
• Success of data initiatives at large organizations is a function of data quality.