New edition of #WeeklyDigest has been dropped sharing some blog posts on #apachekafka and #ApacheFlink

https://thriving.dev/blog/weekly-digest-2023-cw5+cw6

A new edition of #WeeklyDigest has been dropped sharing some blog posts on #apachekafka and #ApacheFlink

#ThrivingDev

https://thriving.dev/blog/weekly-digest-2023-cw5+cw6

🧵 "How does Apache Flink compare to Kafka Streams?" Both do stream processing, but differ in some important aspects. A few folks asked me about this recently, so I thought I'd share some thoughts. This is from a user's perspective, not touching on implementation details.

1️⃣ Supported Streaming Platforms Being part of the
@ApacheKafka project, Kafka Streams exclusively supports stream processing of data in Kafka. #ApacheFlink is platform-agnostic and lets you process data in Kafka, 1/x

🧵 "How does Apache Flink compare to Kafka Streams?" Both do stream processing, but differ in some important aspects. A few folks asked me about this recently, so I thought I'd share some thoughts. This is from a user's perspective, not touching on implementation details.

1️⃣ Supported Streaming Platforms

Being part of the @ApacheKafka project, Kafka Streams exclusively supports stream processing of data in Kafka. #ApacheFlink is platform-agnostic and lets you process data in Kafka, ... 1/x

git clone git@github.com:apache/flink.git

As they say: every journey begins with one small step; just cloned the #ApacheFlink repo, starting to get my feet wet with the code base a little bit. If you are aware of any beginner-friendly issues to tackle, I'd love to hear from you!

New post: Enabling Transparent Acceleration of Big Data Frameworks Using Heterogeneous Hardware based on our recent VLDB paper to be published in 2023.

Here we explain how #ApacheFlink is extended to run on GPUs and FPGAs with #TornadoVM.

https://jjfumero.github.io/posts/2022/11/enabling-transparent-acceleration-bigdata-heterogeneous-hardware/

#bigdataAnalytics #hardwareAcceleration #gpus #fpgas #java

Nice article on using Flink and dealing with data skew and performance by the Sitecore engineering team:
https://medium.com/@sanr_71172/dealing-with-data-skew-in-flink-b7e4c82c35ef
#Sitecore #ApacheFlink

📺 The recording of Sharon Xie's and my session about change stream processing with Apache Flink and #Decodable is up on YouTube now! Thank you so much to everyone who joined and for all the great questions, this was fun 🤓!

https://www.youtube.com/watch?v=LKX76Hnwtis

#streamprocessing #changedatacapture #debezium #apacheflink #dataengineering