PipeRider 0.33 is out now, with the main feature being:

- Support for dbt's new Semantic Layer that comes with dbt 1.6.

More info:
https://docs.piperider.io/get-started/run/metrics

PipeRider Cloud now also has powered-up pull request integration with Impact Report history.

View the Impact Reports for all your pull requests in one easy dropdown.

A welcome improvement for those managing pull request review for their team.

https://medium.com/inthepipeline/managing-multiple-pull-request-reviews-in-piperider-cloud-539ec3a93119

#PipeRider #dbt #AnalyticsEngineering #DataEngineering #DataViz

I hosted the PipeRider Community Office Hours yesterday and one cool feature we demoed was this online dbt manifest viewer.

Generate a Lineage Diff from just your dbt project's manifest files.

Try it out for yourself here:

https://staging.cloud.piperider.io/online-viewer#/?utm_source=mstdn

Watch it in action on Youtube:

https://www.youtube.com/watch?v=LHuTb3e_4O8

#DataEngineering #DataViz #dbt #DataTools #AnalyticsEngineering #OpenSource #PipeRider

PipeRider Community Office Hours is happening next week

August 23rd, 2023
4:30PM PST / 07:30PM EST (US)

Topics:

- How to share you Data Impact Reports using PipeRider Cloud

- Deep linking from Pull Request Impact Summaries into PipeRider Reports and vice versa

- Features and improvements coming in PipeRider 0.32.0

Register:

https://us02web.zoom.us/meeting/register/tZctd-mrqjguGd2nMLzyrxcyxPNZqP-dwylm

All are free to join!

#PipeRider #OpenSource #DataQuality #DataImpact #dbt

databricks is now a supported by PipeRider for dbt projects!

Now databricks users can get:

- Data Impact Reports
- Data profile comparisons
- Pull Request Impact summaries
- Lineage Diff

Check the PipeRider docs for a full list of supported data sources:

https://docs.piperider.io/reference/supported-data-sources

#dbt #piperider #databricks #datyaquality #dataimpact #dataengineering #analyticsengineering #opensource

The latest issue of 'In the Pipeline', the PipeRider newsletter, is coming very soon.

Make sure you don't miss out by signing up!

https://app.us1.list-manage.com/subscribe?u=2b18366427f11835f05f68aeb&id=b82bfd845e

Featuring info about:

- New PipeRider features
- Data best practices
- Guest interviews
- Interesting data-related content

#DataTools. #DataOps #DataQuality #DataReliability #DataNewsletter #dbt #PipeRider

The PipeRider Community Office Hours for June 20th is now online:

https://www.youtube.com/watch?v=6scbaNMfXSc

- New features in PipeRider 0.27

- Lineage Diff in PipeRider Cloud!

- Special guest Spencer Ellinor from Sudo Labs

Timestamps and links in the video description

#DataQuality #DataReliability #PipeRider #DataViz #dbt #DataOps #LineageDiff #CodeReviewForData

PipeRider now has a dedicated tools channel on the dbt Slack!

Join the dbt Slack here:
https://getdbt.com/community/join-the-community/

Then, either search for the #tools-piperider channel, or follow this link:
https://getdbt.slack.com/archives/C05C28V7CPP

See you there 💪

#dbt #DataQuality #DataOps #OpenSource #DataReliability #DataTools #CodeReviewForData #PipeRider

You already use dbt to empower your data modelling workflow, now you need a way to understand how your code changes affect data

That's where "code review for data" comes in

Zero-config dbt integration and merge with confidence 💯

Get started today at
https://piperider.io

#dbt #DataQuality #DataReliability #OpenSource #DataOps #DataViz #DataProfile #DataTesting #PipeRider

PipeRider 0.26.0 has just been released 📢

'PipeRider compare' is a powerful command, so we've included two options to guide you through using it:

--dry-run
will show each command that will be run

--interactive
will guide you step by step

More info:
https://github.com/InfuseAI/piperider/releases/tag/v0.26.0

To update just run:
pip install -U piperider

#DataQuality #PipeRider #DataReliability #DataOps #DataDiff #dbt

PipeRider 0.23.1 is out now and includes the following updates to improve your code review for dbt projects 🎉

- Athena users rejoice, you can now create and compare PipeRider reports from your data

- Compare recipes now support Jinja, so you can use env vars

- Compare recipes support comparing to an existing base report

Update or install with:

pip install -U piperider

More info:

https://github.com/InfuseAI/piperider/releases/tag/v0.23.0

#piperider #dataquality
#codereviewfordata #dbt

Watch out for that schema change, it's a doozy!

You probably don't control upstream tables, so having some way to alert you when a table schema changes can save you time and effort.

Using Snowflake for an example, I made some major changes to a table and showed how they can be detected with #PipeRider:

https://blog.infuseai.io/how-to-detect-schema-change-in-snowflake-6ffcd28c3f15

#snowflake #DataEngineering #DataQuality #DataReliability #DataOps #DataObservability #DataWarehouse #ELT