Hi,

I spotted this article on The Journal:

UK air traffic services says fault was caused by flight data it received

https://jrnl.ie/6154515

It is another example of an #IQTrainWreck (based on what’s reported).

Raises questions about:

1) #DataQuality controls at input
2) #DataQuality controls on import/ingestion
3)Exception handling processes.
4)Recovery processes

However, in a high risk environment doing a “stop everything” action when unexpected happens is disruptive but necessary.

🧮 Kids were undercounted in the 2020 Census.

Here's a chance to help the U.S. Census Bureau improve the count in 2030:
https://www.federalregister.gov/documents/2023/08/25/2023-18341/2030-census-advisory-committee

#2020Census #2030Census #Data #DataQuality #Statistics #Children #Youth @demography @sociology @edutooters

✅ ❌ Data have the power to change lives—but not all data are good data, and bad data are getting more attention than ever.

Do you know the difference? Check out our 5 criteria for the good stuff: http://bit.ly/3QDXuR4

#misinformation #disinformation #dataquality #data #statistics #zombiestatistics

PipeRider Community Office Hours is happening next week

August 23rd, 2023
4:30PM PST / 07:30PM EST (US)

Topics:

- How to share you Data Impact Reports using PipeRider Cloud

- Deep linking from Pull Request Impact Summaries into PipeRider Reports and vice versa

- Features and improvements coming in PipeRider 0.32.0

Register:

https://us02web.zoom.us/meeting/register/tZctd-mrqjguGd2nMLzyrxcyxPNZqP-dwylm

All are free to join!

#PipeRider #OpenSource #DataQuality #DataImpact #dbt

@bigiain @alfora @futurebird @MostlyHarmless
#DataQuality ftw!

@chrisgervais #DataQuality

https://www.independent.ie/business/personal-finance/i-cant-afford-this-and-i-wont-stand-for-it-new-bank-blunder-will-cost-homeowners-up-to-600-more-a-month-on-their-mortgages/a826147046.html
#DataQuality issues impact on people. This is another #IQTrainwreck from Ulster Bank but highlights how small data quality issues can have significant impacts on people.

A Decade After A Disastrous Launch, Is Apple Maps Finally Good?
--
https://www.theguardian.com/travel/2023/aug/09/apple-maps-cycling-transport-google <-- shared media article
--
#GIS #spatial #mapping #cartography #onlinemapping #dataquality #AppleMaps #quality #improvement #navigation #spatialdata #datacollection #updates #realtime #gischat #Apple
@apple

Dealing with data quality challenges can be like navigating a maze! 🤔 From measurement error to outliers and missing values, we explore it all in my recent article. Learn effective strategies to handle these obstacles and level up your data analysis game. 🚀 #DataQuality #DataAnalysis

https://youtu.be/YA-sYkO39Qk

Somewhat hilariously, and tellingly, the best ratings in the category go to organisations that are definitely NOT trade unions…

But seriously, #TrustPilot: what responsibility do you take for your awful #dataQuality?

If you aggregate and publish these reviews, do you bear no responsibility for their content?

Precision, bias, accuracy—these measures shape the quality of our data! 📐🎯 Dive into my latest article to understand how these concepts influence data analysis. Let's ensure our measurements are precise, unbiased, and accurate! 🎉 #DataScience #DataQuality #DataAnalysis

https://towardsdatascience.com/assessing-the-quality-of-data-e5e996a1681b

#SymLink: The article emphasizes the importance of data-centric AI in achieving higher accuracy and extracting valuable insights, emphasizing the need to improve data quality and management while utilizing tools and automation to streamline the process. #DataCentricAI #AI #DataQuality #DataManagement
https://highfens.com/2023/06/23/discover-the-importance-of-data-centric-ai/

AWS’ Entity Resolution service to help enterprises improve data quality

Check it out! 👇
https://www.infoworld.com/article/3703190/aws-entity-resolution-service-to-help-enterprises-improve-data-quality.html#tk.rss_all

#MachineLearning #DataManagement #DataQuality

AWS’ Entity Resolution service to help enterprises improve data quality - Amazon Web Services (AWS) has released a new service, AWS Entity Resolution, to help e... - https://www.infoworld.com/article/3703190/aws-entity-resolution-service-to-help-enterprises-improve-data-quality.html#tk.rss_all #machinelearning #datamanagement #dataquality

Q. What's the best thing about open-source software?

A. You can modify it and add your own features❤️

That's exactly what Alex, a senior data engineer at domain.com.au, did with PipeRider.

Alex added features specific to his data migration use-case of comparing two datasets on the row-level, with tolerance

https://www.youtube.com/watch?v=SSoFyWTAYGw

#OpenSource #DataQuality #DataReliability #DataLineage #DataOps #DataTools #DataViz

Always a kick to open a book written by one of the pioneers in your field (who is now a mentor and friend for over 20 years) to find your name listed in the “dramatis personae” #DataQuality

Data should be a first-class citizen in the cloud

Check it out! 👇
https://www.infoworld.com/article/3702108/data-should-be-a-first-class-citizen-in-the-cloud.html#tk.rss_all

#DataQuality #DataIntegration #DataManagement #DataGovernance #CloudComputing

Data should be a first-class citizen in the cloud - “It’s all about the data!” has been the battle cry for traditional systems architects ... - https://www.infoworld.com/article/3702108/data-should-be-a-first-class-citizen-in-the-cloud.html#tk.rss_all #dataintegration #cloudcomputing #datagovernance #datamanagement #dataquality

The lineage graph in dbt docs is great, but it’s static and represents only one state of your data.

Lineage Diff in PipeRider shows you exactly which nodes have changed in your branch code compared to main.

Lineage Diff shows:

🆕 New nodes
♻️ Changed nodes
👊 Impacted nodes
📊 Full lineage graph and change-only views
📋 Extra stats: row count and execution time

Read more about how to get Lineage Diff:

https://medium.com/inthepipeline/dbt-data-lineage-diff-impact-analysis-visualized-bec9927b0c4e

#DataQuality #DataViz #DataReliability #DataLineage #DataEngineering

We've rebooted our Discord community ♻️

If you're looking for:

🛟 Help using PipeRider
📰 Info on new releases
💬 General chat about data

Join the community here:

https://piperider.io/discord

#DataQuality #DataReliability #dbt #CodeReviewForData #DataCommunity #Discord