Babak Tourani · @babak
91 followers · 166 posts · Server data-folks.masto.hostTwo months into the new position and new stack. Findings:
1. #Redshift’s performance is slightly better than what it was in 2021. Still not worth the money.
2. #Prefect is the worst orchestrator one can choose for #DataEngineering purposes. It’s horrible operation-wise and lacks in terms of fundamental pillars of data engineering; example: “context/logical date” (in #Airflow speak) is absent, which means you’re limited to dumb “full refresh” jobs
#redshift #Prefect #dataengineering #airflow
meganisalanis · @meganisalanis
376 followers · 1833 posts · Server mastodon.nzWe got one of these for our school (1...), 14 classes... I did some early experiments with class and staff room, meeting room - I have been 'cracking' a window on each side of the room every day since.
I highly recommend this
#ventilation #airflow
Thom O'Connor · @thomoco
203 followers · 1141 posts · Server mas.todetailed and genuinely useful blog on how we built our internal data warehouse on #ClickHouse at ClickHouse
https://clickhouse.com/blog/building-a-data-warehouse-with-clickhouse
#ClickHouse #DataWarehouse
starring
#Superset #AppFlow #Airflow #Redis #Docker #opensource #RDS #PostgreSQL #DBT
and including data from
#Salesforce #AWS #S3 #BigQuery #M3ter #Segment #Marketo
#marketo #segment #m3ter #bigquery #s3 #aws #salesforce #dbt #postgresql #rds #opensource #docker #redis #airflow #appflow #superset #datawarehouse #clickhouse
dillonniederhut · @dillonniederhut
82 followers · 71 posts · Server fosstodon.org
The National Solar Observatory uses #airflow to process 8TB of data every day to get glamour shots of our star like this @scipy2023
ai-jobs.net · @aijobs
51 followers · 263 posts · Server mstdn.socialHIRING: Staff Machine Learning Modeler, Financial Crimes / San Francisco, CA, United States https://ai-jobs.net/J51896/ #AI #MachineLearning #DataJobs #MLjobs #bigdata #DataScience #AIjobs #AIcareers #hiringnow #SanFrancisco #CA #UnitedStates #Airflow #AWS #Banking #Blockchain
#BlockChain #banking #AWS #airflow #unitedstates #ca #sanfrancisco #hiringnow #aicareers #AIjobs #DataScience #bigdata #MLjobs #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
51 followers · 260 posts · Server mstdn.socialHIRING: Senior Data Scientist, Search / Berlin, Germany https://ai-jobs.net/J51925/ #AI #MachineLearning #DataJobs #MLjobs #bigdata #DataScience #AIjobs #AIcareers #hiringnow #Berlin #Germany #ABtesting #Airflow #DataMining #Docker #Engineering #Kafka #Looker #MachineLearning
#looker #kafka #engineering #Docker #datamining #airflow #abtesting #Germany #Berlin #hiringnow #aicareers #AIjobs #DataScience #bigdata #MLjobs #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
51 followers · 259 posts · Server mstdn.socialHIRING: Senior Data Scientist, Search / Berlin, Germany https://ai-jobs.net/J51925/ #AI #MachineLearning #DataJobs #MLjobs #bigdata #DataScience #AIjobs #AIcareers #hiringnow #Berlin #Germany #ABtesting #Airflow #DataMining #Docker #Engineering #Kafka #Looker #MachineLearning
#looker #kafka #engineering #Docker #datamining #airflow #abtesting #Germany #Berlin #hiringnow #aicareers #AIjobs #DataScience #bigdata #MLjobs #DataJobs #MachineLearning #AI
Juan Luis @ #PyConLT · @astrojuanlu
1287 followers · 1993 posts · Server social.juanlu.space
ai-jobs.net · @aijobs
46 followers · 213 posts · Server mstdn.socialHIRING: Senior Data Engineer (Remote) / Argentina - Remote https://ai-jobs.net/J49156/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Airflow #APIs #Architecture #Athena #AWS #BigData #ComputerScience #DataAnalytics #EC2
#ec2 #dataanalytics #computerscience #AWS #athena #architecture #apis #airflow #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
46 followers · 208 posts · Server mstdn.socialHIRING: Head of Data Platform and Tools / New York City, NY, United States https://ai-jobs.net/J49193/ #AI #MachineLearning #DataJobs #MLjobs #bigdata #DataScience #AIjobs #AIcareers #hiringnow #NewYorkCity #NY #UnitedStates #Airflow #AWS #Banking #Blockchain #Crypto #Engineering
#engineering #Crypto #BlockChain #banking #AWS #airflow #unitedstates #ny #newyorkcity #hiringnow #aicareers #AIjobs #DataScience #bigdata #MLjobs #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
46 followers · 208 posts · Server mstdn.social
HIRING: Principal Software Engineer - Deep Learning (Remote Eligible) / -REMOTE, USA- https://ai-jobs.net/J48951/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #USA #Airflow #APIs #BigQuery #Classification #ComputerScience
#computerscience #classification #bigquery #apis #airflow #USA #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
46 followers · 208 posts · Server mstdn.social
HIRING: Data Engineer / Remote, Australia https://ai-jobs.net/J49019/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Australia #Agile #Airflow #Architecture #AWS #Datapipelines #Datawarehouse #DevOps #EC2 #Engineering #ETL
#etl #engineering #ec2 #DevOps #datawarehouse #datapipelines #AWS #architecture #airflow #agile #Australia #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
46 followers · 208 posts · Server mstdn.social
HIRING: Senior Data Engineer, Enterprise Engineering / Toronto, ON, Canada https://ai-jobs.net/J49020/ #AI #MachineLearning #DataJobs #MLjobs #bigdata #DataScience #AIjobs #AIcareers #hiringnow #Toronto #ON #Canada #Airflow #AWS #Banking #Blockchain #Crypto #CX #Datapipelines
#datapipelines #cx #Crypto #BlockChain #banking #AWS #airflow #Canada #on #toronto #hiringnow #aicareers #AIjobs #DataScience #bigdata #MLjobs #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
42 followers · 180 posts · Server mstdn.social
HIRING: Manager, Data Engineering / San Francisco - remote first in US https://ai-jobs.net/J48214/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Airflow #APIs #Architecture #Banking #BigQuery #Blockchain #Crypto #ELT #ETL
#etl #elt #Crypto #BlockChain #bigquery #banking #architecture #apis #airflow #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
CalvinHP :python: · @calvinhp
391 followers · 60 posts · Server fosstodon.orgIf you liked my live demo this morning ✨, I'll attempt to top it at my talk today @ 5p by live demoing running 10,000 #Airflow DAGs on my laptop 🤯 #PyConUS2023 🐍
ai-jobs.net · @aijobs
41 followers · 169 posts · Server mstdn.social
HIRING: Senior Machine Learning Ops Engineer / Remote Spain https://ai-jobs.net/J48035/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Airflow #DeepLearning #DevOps #Engineering #Genetics #Kubeflow #Kubernetes #Mathematics
#mathematics #kubernetes #kubeflow #genetics #engineering #DevOps #deeplearning #airflow #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
Djoerd Hiemstra · @djoerd
626 followers · 3305 posts · Server idf.social#Airflow is an open-source workflow management system for data processing pipelines on multiple workers.
ai-jobs.net · @aijobs
37 followers · 163 posts · Server mstdn.social
HIRING: Lead Machine Learning Engineer / Remote-US https://ai-jobs.net/J47496/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Airflow #APIDevelopment #APIs #Architecture #AWS #Azure #Cassandra #Causalinference #Crypto #Flink
#flink #Crypto #CausalInference #cassandra #azure #AWS #architecture #apis #apidevelopment #airflow #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
37 followers · 150 posts · Server mstdn.socialHIRING: Senior Data Engineer / Carlsbad, California, United States https://ai-jobs.net/J47662/ #AI #MachineLearning #DataJobs #MLjobs #bigdata #DataScience #AIjobs #AIcareers #hiringnow #Carlsbad #California #UnitedStates #Airflow #APIs #Architecture #Azure #BigData #Cassandra
#cassandra #azure #architecture #apis #airflow #unitedstates #California #carlsbad #hiringnow #aicareers #AIjobs #DataScience #bigdata #MLjobs #DataJobs #MachineLearning #AI
ai-jobs.net · @aijobs
37 followers · 154 posts · Server mstdn.social
HIRING: Senior Big Data Consultant / Remote (Anywhere US) https://ai-jobs.net/J47405/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Airflow #Architecture #Athena #AWS #BigData #Consulting #DataAnalytics #Datamanagement #SQL
#SQL #datamanagement #dataanalytics #consulting #AWS #athena #architecture #airflow #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI