CrateDB · @cratedb
88 followers · 151 posts · Server fosstodon.org
Looking to streamline your data pipelines? 💡
In this tutorial, Marija Selakovic, CrateDB's Developer Advocate, shows you how to streamline data ingestion, transformation, and loading (ETL) processes with just a few lines of Python code 📊
Check out the tutorial here: 👉 https://hubs.ly/Q020TZs50
#db #data #database #CrateDB #Prefect #DataPipelines #Python #ETL
#db #data #database #cratedb #Prefect #datapipelines #python #etl
Armin Hanisch · @Linkshaender
1157 followers · 5048 posts · Server bildung.social
Für alle Byteschubser, Datenspediteure und ETL-Lords, die täglich dafür sorgen, dass Dinge nicht am digitalen Strassenrand liegen bleiben. 😎
#etl #Datenmigration #projektleben
Indiealexh · @indiealexh
197 followers · 446 posts · Server tny.socialDoes anyone know of any #lowCodeNoCode tools similar to Apache #Nifi ? I need a tool to help do batch and continuous #ETL / #dataintegration that I can easily deploy to kubernetes but doesn't require me to write custom code for each pipeline.
#lowcodenocode #nifi #etl #dataintegration
:rss: Qiita - 人気の記事 · @qiita
42 followers · 1104 posts · Server rss-mstdn.studiofreesia.com[IICS] Secure Agent のインストール手順
https://qiita.com/daichi-kaneko/items/b3a15116b35dba676b68?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items
#qiita #ETL #iPaaS #Informatica #IICS #IDMC
#qiita #etl #ipaas #informatica #iics #idmc
Dave Mackey · @davidshq
975 followers · 1772 posts · Server hachyderm.iolooking to #programmatically #transform data from a proprietary #XML format into an open #JSON format, #geojson to be specific.
any suggestions on good ways to proceed using #python?
Emphasis should be placed on the *transform* step (e.g., I can't simply convert the XML to JSON, I need to modify fields/values).
#programmatically #transform #xml #json #geojson #python #etl #question
Danilo Poccia · @danilop
758 followers · 862 posts · Server awscommunity.social
Interesting way to simplify your data pipeline 👉 Getting started guide for near-real time operational analytics using Amazon Aurora zero-ETL integration with Amazon Redshift https://aws.amazon.com/blogs/big-data/getting-started-guide-for-near-real-time-operational-analytics-using-amazon-aurora-zero-etl-integration-with-amazon-redshift/ #AWS #Database #Analytics #ETL #ELT
#aws #database #analytics #etl #elt
Delta Lake · @deltalakeoss
50 followers · 66 posts · Server social.lfx.dev
#DataAISummit Session Spotlight ⭐ Tune into DoorDash's journey to migrate from a flaky #ETL system with 24-hour data delays, to standardizing a CDC streaming pattern across more than 150 databases to produce near real-time data in a scalable, configurable, and reliable manner.
Register for DAIS ➡️ https://dbricks.co/3lvO1hz
View the session catalog ➡️ https://bit.ly/3MLJ7Xa
Use code ETLINUX400 to save $400 off the regular price of the full conference pass!
#dataaisummit #etl #doordash #deltalake #opensource
ai-jobs.net · @aijobs
51 followers · 261 posts · Server mstdn.socialHIRING: SQL Server and ETL Support Engineer (Tier 1/Tier 2) / Stockport, United Kingdom https://ai-jobs.net/J51880/ #AI #MachineLearning #DataJobs #MLjobs #bigdata #DataScience #AIjobs #AIcareers #hiringnow #Stockport #UnitedKingdom #Azure #BigData #BusinessIntelligence #ETL #SQL
#SQL #etl #businessintelligence #azure #unitedkingdom #Stockport #hiringnow #aicareers #AIjobs #DataScience #bigdata #MLjobs #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
46 followers · 210 posts · Server mstdn.socialHIRING: Data Scientist, Credit Risk / Remote in the United States https://ai-jobs.net/J49115/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Creditrisk #Economics #Engineering #ETL #MachineLearning #MLmodels #PhD #Python #R
#r #Python #phd #mlmodels #etl #engineering #economics #creditrisk #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
46 followers · 208 posts · Server mstdn.social
HIRING: Data Engineer / Remote, Australia https://ai-jobs.net/J49019/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Australia #Agile #Airflow #Architecture #AWS #Datapipelines #Datawarehouse #DevOps #EC2 #Engineering #ETL
#etl #engineering #ec2 #DevOps #datawarehouse #datapipelines #AWS #architecture #airflow #agile #Australia #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
42 followers · 180 posts · Server mstdn.social
HIRING: Manager, Data Engineering / San Francisco - remote first in US https://ai-jobs.net/J48214/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Airflow #APIs #Architecture #Banking #BigQuery #Blockchain #Crypto #ELT #ETL
#etl #elt #Crypto #BlockChain #bigquery #banking #architecture #apis #airflow #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
41 followers · 169 posts · Server mstdn.social
HIRING: Data Analyst / Lincoln, NE or Remote https://ai-jobs.net/J48023/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #Lincoln #RemoteJob #Amplitude #DataMining #ETL #Finance #Looker #Metabase #Python #R #SQL #Statistics #Tableau
#tableau #statistics #SQL #r #Python #Metabase #looker #Finance #etl #datamining #amplitude #remotejob #Lincoln #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
Json Doh · @jdoe
35 followers · 1396 posts · Server freeradical.zone#ETL is...
You buy a furniture at IKEA - extract;
Assemble it in the truck while hauling it to home - transform;
Unload the whole thing from the truck and bring it to a room - load.
#ELT is...
You buy a furniture at IKEA - extract;
Put the box(es) into your car and bring them home - load;
Assemble the furniture in place when you have time and resources - transform.
Danilo Poccia · @danilop
715 followers · 576 posts · Server awscommunity.social
AWS Glue visual ETL now supports new native Amazon Redshift capabilities 👉 Read and write data into Amazon Redshift more effectively using AWS Glue https://aws.amazon.com/about-aws/whats-new/2023/04/aws-glue-visual-etl-native-amazon-redshift-capabilities/ #AWS #Analytics #ETL #SQL
ai-jobs.net · @aijobs
33 followers · 141 posts · Server mstdn.social
IRING: Data Engineering Architect / Remote - USA https://ai-jobs.net/J47036/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Airflow #Architecture #BigData #BusinessIntelligence #ComputerScience #Crypto #Datagovernance #ETL
#etl #datagovernance #Crypto #computerscience #businessintelligence #architecture #airflow #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
31 followers · 133 posts · Server mstdn.social
HIRING: Data Analyst / Czech Republic Anywhere https://ai-jobs.net/J47008/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Airflow #Classification #CX #Dataanalysis #Dataquality #Datavisualization #ETL #Finance #KPIs #Looker
#looker #KPIs #Finance #etl #datavisualization #dataquality #dataanalysis #cx #classification #airflow #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
AndiMann · @AndiMann
342 followers · 899 posts · Server masto.ai"Modern #data infrastructures don’t do #ETL"
https://www.infoworld.com/article/3692889/modern-data-infrastructures-dont-do-etl.html
Who pays to refactor? Who pays to run everything real-time? Where's the ROI? What's the risk profile? What's the MTTR SLO for massive simultaneous failure?
Batch workload #automation is 💯 fit for purpose.
ai-jobs.net · @aijobs
31 followers · 133 posts · Server mstdn.social
HIRING: ETL Developer - Remote / San Jose, CA, United States https://ai-jobs.net/J46937/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #SanJose #CA #UnitedStates #DataMining #ETL #MachineLearning #MLOps #MSSQL #Oracle #SQL #SSIS
#SSIS #SQL #Oracle #mssql #MLops #etl #datamining #unitedstates #ca #sanjose #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
robrich · @robrich
13 followers · 116 posts · Server hachyderm.io
Want to do #ETL, #Data or #Runbooks with #Jupyter? Join us #InPerson at #DevOpsDays #Nashville for "Getting Started with Jupyter", the #NoSlides talk. https://devopsdays.org/events/2023-nashville/ and grab the code at https://github.com/robrich/jupyter_getting_started.
#etl #data #runbooks #jupyter #InPerson #devopsdays #nashville #noslides
Fred · @fred
108 followers · 140 posts · Server m.baldhead.beLooking for a great new opportunity? Welcome aboard!
https://vliz.be/en/vacancy/2023-03-08-vliz-recruits-cloud-data-engineer
#hpc #data #it #etl #cloud #oceanography #job #oostende