FedSearch - Federated network search engine

CrateDB · @cratedb

88 followers · 151 posts · Server fosstodon.org

CrateDB Community - Building Seamless Data Pipelines Made Easy: Combining Prefect and CrateDB

Looking to streamline your data pipelines? 💡
In this tutorial, Marija Selakovic, CrateDB's Developer Advocate, shows you how to streamline data ingestion, transformation, and loading (ETL) processes with just a few lines of Python code 📊

Check out the tutorial here: 👉 https://hubs.ly/Q020TZs50

#db #data #database #CrateDB #Prefect #DataPipelines #Python #ETL

#db #data #database #cratedb #Prefect #datapipelines #python #etl

Last updated 1 year ago

Original post

roman 🌻🏳️‍🌈 · @hxroamn

54 followers · 223 posts · Server fosstodon.org

time to get some loose ideas for my next job out there!

- #ClimateChange solutions
- fully remote or located in the #Denver area (primarily WFH, single #dog dad 🐶)
- #Data intensive or #BigData-related (really enjoy building, maintaining, expanding #DataPipelines and working with and scaling #Databases + stateful systems)
- Cross-functional (i’ve had tons of fun working with business, intelligence, and other eng teams)

not totally ready to start applying rn, but would love to chat! #FediJobs

#climatechange #denver #dog #data #bigdata #datapipelines #databases #fedijobs

Last updated 1 year ago

Original post

Kedro · @kedro

59 followers · 55 posts · Server social.lfx.dev

Open media

It's release week 🔥

🔶 kedro 0.18.12 with dataset factories
🔶 kedro-datasets 1.5.1 with lazy loading and `pandas.DeltaTableDataSet`
🔶 kedro-airflow 0.6.0 with an option to configure DAG kwargs using `airflow.yml`
🔶 kedro-telemetry 0.2.5 paving the way for Python 3.11 support

Thanks to our various community contributors! 💛 Check out the complete release notes in our GitHub organisation https://github.com/kedro-org/

#kedro #python #pydata #datascience #datapipelines

Last updated 1 year ago

Original post

InfoQ · @infoq

654 followers · 280 posts · Server techhub.social

Open media

#CaseStudy – Yelp developed a solution to sanitize data from a corrupted #ApacheCassandra cluster using its data streaming architecture.

Dive into the details of their successful data-cleansing journey: https://bit.ly/44zvthI

#InfoQ #SoftwareArchitecture #DataPipelines #Database

#casestudy #apachecassandra #infoq #softwarearchitecture #datapipelines #database

Last updated 1 year ago

Original post

Kedro · @kedro

50 followers · 40 posts · Server social.lfx.dev

New blog post: How to build a custom Kedro runner 🔶

In this post our colleague Nok Lam Chan explains how to write an efficient custom Kedro pipeline runner that continues executing a set of nodes after encountering non-catastrophic failure points.

https://kedro.org/blog/build-a-custom-kedro-runner

#kedro #kedroviz #MachineLearning #datapipelines #python #PyData

#kedro #kedroviz #machinelearning #datapipelines #python #pydata

Last updated 1 year ago

Original post

Kedro · @kedro

42 followers · 28 posts · Server social.lfx.dev

Open media

Are you in Amsterdam and want to learn how to effectively create and run maintainable data pipelines in the cloud? 🔶

Join Xebia | Data for an in-person Kedro Code Breakfast at their offices next Tuesday, May 23rd 📅 Seats are limited!

https://events.xebia.com/code-breakfast-kedro/?utm_source=mastodon

#kedro #python #azure #datascience #datapipelines

Last updated 1 year ago

Original post

Kedro · @kedro

30 followers · 19 posts · Server social.lfx.dev

See you all *today* for a Kedro virtual training! More than 190 signups so far and counting 😮

#kedro #python #pydata #jupyter #datascience #datapipelines

Last updated 2 years ago

Original post

ai-jobs.net · @aijobs

46 followers · 211 posts · Server mstdn.social

HIRING: Senior Real World Data Scientist, Medical Affairs / Boston, MA https://ai-jobs.net/J49114/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #Boston #MA #Biology #Consulting #DataAnalytics #Datapipelines #Dataquality #GCP #Genetics

#genetics #gcp #dataquality #datapipelines #dataanalytics #consulting #biology #ma #boston #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI

Last updated 2 years ago

Original post

ai-jobs.net · @aijobs

46 followers · 208 posts · Server mstdn.social

ai-jobs.net - Data Engineer

HIRING: Data Engineer / Remote, Australia https://ai-jobs.net/J49019/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Australia #Agile #Airflow #Architecture #AWS #Datapipelines #Datawarehouse #DevOps #EC2 #Engineering #ETL

#etl #engineering #ec2 #DevOps #datawarehouse #datapipelines #AWS #architecture #airflow #agile #Australia #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI

Last updated 2 years ago

Original post

ai-jobs.net · @aijobs

46 followers · 208 posts · Server mstdn.social

ai-jobs.net - Senior Data Engineer, Enterprise Engineering

HIRING: Senior Data Engineer, Enterprise Engineering / Toronto, ON, Canada https://ai-jobs.net/J49020/ #AI #MachineLearning #DataJobs #MLjobs #bigdata #DataScience #AIjobs #AIcareers #hiringnow #Toronto #ON #Canada #Airflow #AWS #Banking #Blockchain #Crypto #CX #Datapipelines

#datapipelines #cx #Crypto #BlockChain #banking #AWS #airflow #Canada #on #toronto #hiringnow #aicareers #AIjobs #DataScience #bigdata #MLjobs #DataJobs #MachineLearning #AI

Last updated 2 years ago

Original post

InfoQ · @infoq

554 followers · 160 posts · Server techhub.social

Open media

Learn about #QuixStreams - an #opensource #Python library that simplifies Real-Time ML pipelines.

Tomáš Neubauer discusses various architecture designs, pros & cons, and demonstrates a real use case using Quix Streams & a TensorFlow model.

🎧 Listen to the #InfoQ podcast: https://bit.ly/3Nl2ZCl

#ML #DataPipelines

#quixstreams #opensource #python #infoq #ml #datapipelines

Last updated 2 years ago

Original post

Kedro · @kedro

27 followers · 13 posts · Server social.lfx.dev

🚨 Open workshop alert: Learn how to refactor your Jupyter notebooks into maintainable data science code using Kedro! 🔶

Join us on May 4th at 14:00 UTC for a 2 hour, hands-on, open workshop on how to use Kedro to turn your Jupyter notebooks into maintainable science code.

Register now, and share with any colleagues who might be interested! https://events.quantumblack.com/kedro-intro-23-05

#kedro #jupyter #datascience #datapipelines #python #pydata