4 Things I Learned Building a Data Platform using Medallion Architecture in the Last 4 Years

Lessons learned from a data platform in a production environment

This month, I celebrated four years of working on a big data platform that uses the medallion architecture for data organization. All my previous experiences were linked to different data organization approaches. Therefore, considering this milestone, I decided to share some lessons I’ve learned along the way, which I believe may be helpful to others working with a similar approach.

First… some context: What is the medallion architecture?

In summary, it is a design pattern in the data domain meant for…