Andrew Jones · @andrewrjones
29 followers · 29 posts · Server data-folks.masto.host
What do software engineers think about data contracts? 🤔
When talking about data contracts, we naturally focus on the benefits for our data teams and improving data quality.
But at GoCardless there is more to it than that! The way we have implemented data contracts has led to it becoming a valuable and much relied upon tool for our software engineers.
Here are 3 things our software engineers 𝒍𝒐𝒗𝒆 about data contracts! ♥️
#datacontracts #softwareengineering
Mikiko · @mikiko
211 followers · 88 posts · Server data-folks.masto.host
Key takeaways from #chadsanderson ’s Data Quality talk #datacontracts #dataengineering #dataops
#chadsanderson #datacontracts #dataengineering #dataops
Mikiko · @mikiko
211 followers · 86 posts · Server data-folks.masto.host
Andrew Jones · @andrewrjones
28 followers · 21 posts · Server data-folks.masto.host
In a couple of weeks I'll be at the Data & AI Meetup in London about how we're driving data culture change with #DataContracts. Do come say hi if you're around!
I'm also really looking forward to the other talk, which is about #ExplainableAI.
More details and signup here 👉 https://www.meetup.com/data-ai-london/events/289808126/
All Hail the Data · @dataengineeringdude
9 followers · 3 posts · Server data-folks.masto.hostI'm not convinced Data Contract's are for every data team. Especially small startups, probably over engineering in many cases. Although I can see it's uses at scale. #data #dataengineering #datacontracts
#data #dataengineering #datacontracts
Hassaan Akbar · @hassaan
2 followers · 8 posts · Server data-folks.masto.host
What happens when data producers are responsible to fix the data issues?
#datamesh #data #datacontracts
Ananth Packkildurai · @ananth
872 followers · 122 posts · Server data-folks.masto.host
Neelesh Salian · @neelesh_salian
126 followers · 83 posts · Server data-folks.masto.hostHot Take: Data Quality is collaborative. Quality for thee isn't quality for me.
Contracts and schema validation should be decided as producer, and consumer as data pipelines are built.
The trick is to de-dup the checks and only check for the parameters that the upstream source hasn't ensured. Or modify the checks if your (downstream) source has different requirements.
#schema #datacontracts #contracts #metadata #data
Abi Aryan :verified: · @goabiaryan
777 followers · 171 posts · Server mstdn.socialAlso
#datacontracts
#TrustworthyAI
#ethicalai
#monitoring
#logging
#spark
#ApacheSpark
#apachecassandra
#ApacheKafka
#DataLake
#datalakes
#datawarehousing
#datawarehouses
#datawarehouses #datawarehousing #datalakes #DataLake #ApacheKafka #apachecassandra #ApacheSpark #spark #logging #monitoring #ethicalai #TrustworthyAI #datacontracts
Abi :coffefied: · @goabiaryan
44 followers · 232 posts · Server mstdn.socialAlso
#datacontracts
#TrustworthyAI
#ethicalai
#monitoring
#logging
#spark
#ApacheSpark
#apachecassandra
#ApacheKafka
#DataLake
#datalakes
#datawarehousing
#datawarehouses
#datawarehouses #datawarehousing #datalakes #DataLake #ApacheKafka #apachecassandra #ApacheSpark #spark #logging #monitoring #ethicalai #TrustworthyAI #datacontracts