Mike Taveirne at Snowflake has a new blog that does a great job of explaining when to use #ApacheIceberg in Snowflake. He gives a brief overview of #Iceberg, the types of integrations available, and when to use them. The feature is available in private preview, so if this is of interest, talk to your account team to get access.
#dataengineering #datalakehouse #datawarehouse
https://medium.com/snowflake/when-to-use-iceberg-tables-in-snowflake-c087240759cb
#apacheiceberg #iceberg #dataengineering #datalakehouse #datawarehouse
Vino Duraisamy at Snowflake has a great new detailed blog on the design changes in Snowflake's architecture to support #ApacheIceberg tables—a must-read for those interested in this space.
#apacheiceberg #dataengineering #datalakehouse #datawarehouse
We initiated Surgery theme in CEB Data Warehouse project and 423,704 operative cases over 11-years study period were explored. 12,155 cases of abdominal surgery for 11,617 patients were included in study population with peri-operative features were identified for externally validating and updating Penn Hernia Risk Calculator.
The full text here https://doi.org/10.1016/j.surge.2023.07.008 and the mirror here https://htunteza.com/assets/docs/2023_External%20validation%20and%20revision%20of%20Penn%20incisional%20hernia%20prediction%20model%20A%20large-scale%20retrospective%20cohort%20of%20abdominal%20operations.pdf.
#incisionalhernia #abdominalsurgery #datawarehouse #MedMastodon #medifedi
#incisionalhernia #abdominalsurgery #datawarehouse #MedMastodon #medifedi
Feature Preview: With Databend's new capability, users can now seamlessly mount and query their Iceberg Catalogs, unlocking the full potential of their data.
https://databend.rs/blog/2023-08-01-iceberg-integration
#Databend #Iceberg #DataWarehouse #OpenSource #BigData #DataManagement
#databend #iceberg #datawarehouse #opensource #bigdata #datamanagement
detailed and genuinely useful blog on how we built our internal data warehouse on #ClickHouse at ClickHouse
https://clickhouse.com/blog/building-a-data-warehouse-with-clickhouse
#ClickHouse #DataWarehouse
starring
#Superset #AppFlow #Airflow #Redis #Docker #opensource #RDS #PostgreSQL #DBT
and including data from
#Salesforce #AWS #S3 #BigQuery #M3ter #Segment #Marketo
#marketo #segment #m3ter #bigquery #s3 #aws #salesforce #dbt #postgresql #rds #opensource #docker #redis #airflow #appflow #superset #datawarehouse #clickhouse
Ryan Blue has a new blog available that touches on some of the major #ApacheIceberg announcements in recent weeks. In addition, he covers some quick #Iceberg basics, and why you would add it to a #DataWarehouse. He wraps up with his thoughts and observations on how this all affects the modern data architecture.
#dataengineering #datalake #datalakehouse
https://tabular.io/blog/iceberg-in-modern-data-architecture/
#apacheiceberg #iceberg #datawarehouse #dataengineering #DataLake #datalakehouse
Want to learn more about how Snowflake can work with your Tabular managed #ApacheIceberg tables? Find out more on our website.
#dataengineering #snowflakesummit2023 #datalakehouse #datawarehouse
https://tabular.io/solutions/snowflake/
#apacheiceberg #dataengineering #snowflakesummit2023 #datalakehouse #datawarehouse
HIRING: Senior Software Engineer / San Francisco, CA https://ai-jobs.net/J51131/ #AI #MachineLearning #DataJobs #MLjobs #bigdata #DataScience #AIjobs #AIcareers #hiringnow #SanFrancisco #Redis #APIs #Architecture #Avro #AWS #Postgres #Avro #Datawarehouse #SparkJobs #Dask #PythonJobs
#pythonjobs #dask #sparkjobs #datawarehouse #postgres #AWS #avro #architecture #apis #redis #sanfrancisco #hiringnow #aicareers #AIjobs #DataScience #bigdata #MLjobs #DataJobs #MachineLearning #AI
Blogged:
Adding label column for optionset in fact table
More nuances in making a useful facts table from Dynamics sales data #datawarehouse #synapseanalytics #100DaysToOffload
https://www.synesthesia.co.uk/note/2023/05/05/adding-label-column-for-optionset-in-fact-table/
#datawarehouse #synapseanalytics #100daystooffload
Have you read this tutorial from Ryan Blue yet that shows you how to use Trino Software Foundation with #ApacheIceberg for data warehousing?
#apacheiceberg #trino #DataLake #datawarehouse #dataengineering
Blogged:
Adding columns to parquet-based fact table
Still learning the basics of working with Parquet files and PySpark #datawarehouse #synapseanalytics #100DaysToOffload
https://www.synesthesia.co.uk/note/2023/05/04/adding-columns-to-parquet-based-fact-table/
#datawarehouse #synapseanalytics #100daystooffload
HIRING: Data Engineer / Remote, Australia https://ai-jobs.net/J49019/ #AI #MachineLearning #DataJobs #AIcareers #MLjobs #bigdata #DataScience #AIjobs #hiringnow #RemoteJob #Australia #Agile #Airflow #Architecture #AWS #Datapipelines #Datawarehouse #DevOps #EC2 #Engineering #ETL
#etl #engineering #ec2 #DevOps #datawarehouse #datapipelines #AWS #architecture #airflow #agile #Australia #remotejob #hiringnow #AIjobs #DataScience #bigdata #MLjobs #aicareers #DataJobs #MachineLearning #AI
HIRING: Senior BI/Data Engineer / Auckland, Auckland, New Zealand https://ai-jobs.net/J48930/ #AI #MachineLearning #DataJobs #MLjobs #bigdata #DataScience #AIjobs #AIcareers #hiringnow #Auckland #NewZealand #BusinessIntelligence #ComputerScience #Datawarehouse
#datawarehouse #computerscience #businessintelligence #newzealand #auckland #hiringnow #aicareers #AIjobs #DataScience #bigdata #MLjobs #DataJobs #MachineLearning #AI
#DataWarehouse, #DataLake, #DataMesh, Oh My: The History of #Data #Storage. Looking to get into #DataMesh or curious if your #DataLake is already obsolete? Join us at #GIDS #DeveloperSummit #InPerson https://developersummit.com/, slides: https://robrich.org/slides/data-warehouse-mesh-lake/
#datawarehouse #DataLake #datamesh #data #storage #gids #developersummit #InPerson
A quick quide to help you shift to the new-age #data #lakehouse without disrupting business applications. #datalakehouse #datawarehouse #datalake https://venturebeat.com/data-infrastructure/how-enterprises-can-move-to-a-data-lakehouse-without-disrupting-their-business/ #press
#data #lakehouse #datalakehouse #datawarehouse #datalake #press
Datenintegration: Apache Hop 2.4 unterstützt DuckDB und Skripte in ECMAScript
Version 2.4 der Datenintegrationsplattform Apache Hop unterstützt DuckDB und bietet eine neue JSR-223-Skripttransformation.
#BigData #Datenbanken #Datenintegration #DataWarehouse #news
#bigdata #datenbanken #datenintegration #datawarehouse #news
"Snowflake back in 2014 was more advanced than what #Redshift Serverless is today."
Animals leaving their unhealthy offspring to die feels less brutal that that [factual] verdict!
Now that I've signed the contract to join a Redshift shop, all I'm thinking is: "what have I done?!"
#redshift #datawarehouse #data #datadon
Mehr Änderung als bei Twix: Aus SAP Data Warehouse Cloud wird jetzt Datasphere
SAP stellt mit Datasphere die nächste Generation seines Portfolios fürs Datenmanagement vor. Es soll Zugriff und Nutzung von Daten aller Systeme vereinfachen.
#datawarehouse #datenbanken #gartner #sap #news
HIRING: Analytics Engineer / London, England, United Kingdom https://ai-jobs.net/J43058/ #AI #MachineLearning #DataJobs #MLjobs #bigdata #DataScience #AIjobs #AIcareers #hiringnow #London #England #UnitedKingdom #Airflow #BigQuery #Dataanalysis #Dataquality #Datawarehouse #ELT
#elt #datawarehouse #dataquality #dataanalysis #bigquery #airflow #unitedkingdom #england #London #hiringnow #aicareers #AIjobs #DataScience #bigdata #MLjobs #DataJobs #MachineLearning #AI