PipeRider 0.33 is out now, with the main feature being:

- Support for dbt's new Semantic Layer that comes with dbt 1.6.

More info:
https://docs.piperider.io/get-started/run/metrics

PipeRider Cloud now also has powered-up pull request integration with Impact Report history.

View the Impact Reports for all your pull requests in one easy dropdown.

A welcome improvement for those managing pull request review for their team.

https://medium.com/inthepipeline/managing-multiple-pull-request-reviews-in-piperider-cloud-539ec3a93119

#PipeRider #dbt #AnalyticsEngineering #DataEngineering #DataViz

🔥⏲️ Fudge Sunday "A.I. For You" A look at the proliferation of M.L. and A.I. across the Enterprise knowledge worker stack

#aieverything #enterprisesoftware #mergersandacquisitions #mergers #acquisitions #aistrategy #productengineering #aiproducts #airproducts #aiops #mlops #artificialintelligence #ai #aiandbusiness #dataengineering #realtimeanalytics #realtimedata #dataintegration #platformengineering #watsonx #devx #developerexperience #newsletter #newsletters

https://fudge.org/archive/ai-for-you/

On Wednesday at ONE Tech Hub  Robert McWilliam will explain how using the async library will speed up your code execution. We'll have pizza and drinks, then his talk, then you get a chance to try the code yourself. See how fast you can get your code running ! 

Book tickets now! https://ti.to/code-the-city/apug-sep-2023

#Python #coding #programming #pizza #networking #KnowledgeExchange #datascience #dataengineering #webdev

Surely, there's something about there for tokenizing/stemming software development terminology? For example, if I have a string like, "Must be proficient in Agile and DevOps methodologies" it would be able to return something like:
{["agile","devops"]} ?

I suppose I could spend a few hours going through the training data and put that list together myself, but that seems like something someone would have done before.

#dataEngineering #dataAnalysis

Loki: meow?

Me: Setting up a Mastodon account.

Hazel: meow

Me: I do have another one, @dpnash@mastodon.online, but I post a lot about #Neurodiversity topics, so I'm planning to do more of that here. For one thing, the character limit in posts is larger here, so not only is it a bit easier to post longer-form items, you fuzzballs get to have longer conversations with me.

Loki: *MEOW*.

Me: Oh, right.

- Things I am: #ActuallyAutistic, #LGBTQ+, in a #Polyfidelitous family of 3 older adults and 4 equally awesome (now mostly grown!) children.

- How I pay the bills: #DataEngineering now, #WebDevelopment and #DevOps before that, #Chemistry even longer ago.

- Other things I like: #Cats, obviously. Also #Astronomy (#AmateurAstronomy in particular), #History, #Science, #Books, #HistoricalFiction, #ScienceFiction, #SFF, #Programming, #Hiking, #Nature.

- Some weirder, more specific ones? Fine. #StudioGhibli. Indoor #Rowing. #Languages, currently learning #Spanish and #Latin. I geek out a lot about astronomical data and I maintain a widely-used database of stars (the HYG catalog, and its new extension, the AT-HYG catalog with Gaia data) at https://github.com/astronexus.

Yes, I'm a geek. But you still put up with me, right?

Loki: meow
Hazel: meow

Me: Love you both too.

Rounding out a trifecta of AWS engines that now work with Tabular-managed #ApacheIceberg tables is our latest episode of Tabular Solutions highlighting AWS EMR. Tabular co-founder Jason Reid and Tabular Sr. Developer Advocate Shawn Gordon show how quick and easy it is to do. Previously we illustrated Amazon Athena and Amazon Redshift.

#iceberg #datalake #apacheiceberg #datalakehouse #emr #tabular #dataengineering
https://youtu.be/aBiL3pFtf1A

Last chance to book!

Tomorrow evening Aberdeen Data Meetup returns - with the postponed talk from Harris Assad on "Why Data Engineering is the Imperative Foundation for Data Science". 

Join us for networking over pizza and drinks, followed by Harris' talk.

Book now https://dashboard.tito.io/code-the-city/adm-sep-2023

#datascience #dataengineering #aberdeen #networking 

This Tuesday Aberdeen Data Meetup is back - with the postponed talk from Harris Assad on "Why Data Engineering is the Imperative Foundation for Data Science". 

Join us for networking over pizza and drinks, followed by Harris' talk. 

Book now https://dashboard.tito.io/code-the-city/adm-sep-2023

#datascience #dataengineering #aberdeen #networking 

Whether you are a data scientist, web developer, astrophysicist, or pharmacological researcher, you need fast code execution. On 13th September Robert McWilliam will explain how using the async library speeds up code execution. We'll have pizza and drinks, then his talk, then you get a chance to try the code yourself. See how fast you can get your code running ! 

Book tickets now! https://ti.to/code-the-city/apug-sep-2023

#Python #coding #programming #KnowledgeExchange #datascience #dataengineering #webdev

With the last day of August, comes the Iceberg Community News. There have been important updates as work proceeds to the next version of #ApacheIceberg. #PyIceberg 0.5.0 is coming along quickly and will be available soon, in addition to significant advances with both the Rust and Go implementations. Lots of great blogs from the community and industry news are included. Many thanks to all the hard work of the contributors.

#dataengineering #datalake #datalakehouse

https://tabular.io/blog/iceberg-202308/

Have you taken a look at PuppyGraph? It is a scalable graph query engine as a service on clouds, but what's very interesting is that it now supports #ApacheIceberg for data storage. You can now create and query a graph in #Iceberg, using PuppyGraph. This is a great development in the data space.

#dataengineering #datalake

https://docs.puppygraph.com/user-manual/getting-started/iceberg

Launch into satellite applications with Microsoft Azure - The transition of Microsoft Azure to a Kubernetes-based platform has given it an inter... - https://www.infoworld.com/article/3705670/launch-into-satellite-applications-with-microsoft-azure.html#tk.rss_all #softwaredevelopment #dataengineering #microsoftazure #cloudcomputing #datamanagement #analytics

I'm struggling a bit in my job - currently the only data person with good #stats knowledge, being called on to 'just crunch a few numbers'... and also having to do all the admin for a cohort of projects

My brain is crap at bouncing between all of those things every day (especially the voluminous admin); I really just want to lock myself away and do cool stuff with #data

Wondering if I could or should side step into #DataEngineering

Jason Hughes has a compelling new blog on how #ApacheIceberg is really opening up the data space, by empowering a large selection of compute engines on the same data, without vendor lock-in. See what you think of his points.
#dataengineering
https://www.spiceworks.com/tech/big-data/guest-article/the-sinking-data-warehouse-is-apache-iceberg-the-next-step/

One week until Aberdeen Data Meetup returns with the postponed talk from Harris Assad on "Why Data Engineering is the Imperative Foundation for Data Science". 

Join us for networking over pizza and drinks, followed by Harris' talk. 

Book now https://dashboard.tito.io/code-the-city/adm-sep-2023

#datascience #dataengineering #aberdeen #networking 

Our new Tabular Solutions video has Fokko Driesprong showing Shawn Gordon how to use #PyIceberg in Outerbounds to set up a #MachineLearning operation on a Tabular-managed #ApacheIceberg table. This powerful combination is now very simple to integrate and use.

Special thanks to Hugo Bowne-Anderson and Eddie Mattia.

#dataengineering #datalake #datalakehouse

https://youtu.be/IJclwoKEOeM

Less than four weeks until our 30th Hack weekend; and it is all about Union Street and the City Centre. We've multiple challenges. We need you - no matter what your skills and experience. We can all play a part! 

More details of the challenges and how to book: https://codethecity.org/what-we-do/hack-weekends/ctc30/ 

#Aberdeen #history #mapping #photography #planning #osm #datascience #dataengineering #heritage

SQL full course 👇🏼

FreeCodeCamp released a new SQL course. While the course was built for web developers, it focuses on general SQL topics and is good for beginners. It includes topics such as:
✅ Tables
✅ Querying
✅ Structuring
✅ Aggregation
✅ Normalization
✅ Joins
✅ Optimization and performance

https://www.youtube.com/watch?v=KBDSJU3cGkc

#sql #data #DataScience #dataengineering

Take a walk through our new Cascading Privileges feature in Tabular. Managing privileges against your data in #ApacheIceberg can become a difficult and dangerous task, but Tabular makes it easy. Our new Storylane-powered interactive demo will show you how.
#datalake #datalakehouse #dataengineering #iceberg
https://app.storylane.io/share/xjtgjg0gwxpn

3 keys to making data democratization a reality - For most executives, data democratization is a pipe dream. The idea of seeing entire t... - https://www.infoworld.com/article/3704990/3-keys-to-making-data-democratization-a-reality.html#tk.rss_all #dataarchitecture #dataengineering #datamanagement #datagovernance #analytics