✅ Recording
✅ Slides
✅ Intro

I'm ready for #Conf42 #Python! Are you? Come along to hear about the latest updates to my houseplant monitoring system built with #ApacheKafka and #ksqlDB.

Reserving your spot for this online event is free:
https://conf42.com/python2023

Logged in today to find that a blog outlining my #iot #houseplant monitoring system with #apachekafka and #ksqlDB (now with updated images) has made top-story status on #hackernoon!

Check it out:
https://hackernoon.com/how-i-built-a-houseplant-alerting-system-with-ksqldb-on-apache-kafka

Kicking off the meetup, we have @krisajenkins with an introduction to #apachekafka through #livecoding. 🧑‍💻

Next up, we have Rune Liseth Høivik and Audun Vindenes Egge presenting in Norwegian on how the Norwegian police use Kafka to catch criminals. 🤯

And finally, I'll bring things back home (literally) with my in-home #iot project, a houseplant monitoring system built with
@ApacheKafka and #ksqlDB. 🪴

New post: "Interesting Stuff - Week 3, 2023".

So, what do we have for Week 3, 2023:

* Support for Plotly in @azuredataexplorer. Very cool!
* Solution to Case 2 in Kusto Detective Agency. This case was the hardest for me to solve.
* Benefits and challenges of distributed computing. Very good!
* Comparison of SQL-based streaming technologies. Interesting!
* Time support in Flink.

Read all about it:

https://nielsberglund.com/post/2023-01-22-interesting-stuff---week-3-2023/

#ksqldb #flink #flinksql #ksqldb #distributedcomputing

I was allowed back on „The GeekNarrator“ podcast. This time, we discussed #ksqlDB

Hope you find it useful: https://youtu.be/2yE86P6uD_0

Talk about starting the new year with a bang:

https://www.confluent.io/blog/cloud-kafka-meets-cloud-flink-with-confluent-and-immerok/

Confluent Cloud and Flink together!

I cannot wait to see what comes out of this. Where do i sign up 😀?

#apachekafka #kafka #ksql #ksqldb #apacheflink #flink

Very cool post how to handle schemaless data and still use the JDBC Sink Connector:

https://www.kineticedge.io/blog/jdbc-sink-noschema/

Especially useful for Confluent Cloud.

Oh, I got the link to the post from @MickaelMaison toot:

https://mas.to/@MickaelMaison/109625725235136464

#kafka #apachekafka #ksqldb #kafkaconnect

Ending the year with another podcast recording with „The Geek Narrator“ about #ksqlDB . — Thanks for having me again!

... open-source and part of the Apache Flink project itself, unlike #ksqlDB over in Kafka land.

4️⃣ Batch vs. Streaming

Kafka Streams focuses exclusively on stateful processing of unbounded data streams, while Flink aims to provide a uniform platform for processing bounded jobs ("batch") and unbounded jobs ("streaming").

Connector Integration

Source and sink connectors are a core element of Flink jobs, i.e. they are deployed to the same cluster as the stream processing logic. With ... 4/x

... open-source and part of the Apache Flink project itself, unlike #ksqlDB over in Kafka land.

4️⃣ Batch vs. Streaming

Kafka Streams focuses exclusively on processing of unbounded data streams, while Flink aims to provide a uniform platform for processing bounded jobs ("batch") and unbounded jobs ("streaming").

5️⃣ Connector Integration

Source and sink connectors are a core element of Flink jobs, i.e. they are deployed to the same cluster as the stream processing logic. With ... 4/x

RT @hpgrahsl

Finally I released the long overdue v0.3.0 for #Kryptonite4Kafka which adds #ksqlDB #UDFs to do field-level 🔒 cryptography 🔓 in #SQL.

Basic documentation here https://github.com/hpgrahsl/kryptonite-for-kafka/blob/master/ksqldb-udfs-kryptonite/README.md

Also it's the last release before introducing the #HttpAPI as a new integration option.

During #PulsarSummit San Francisco earlier this year, I did a hands-on session about using KoP (Kafka-On-Pulsar) with these uses cases:

✅ Microservices with #ApacheKafka
✅ CDC with #Debezium and #MySQL
✅ Stream processing with #ksqlDB

Here is the recording. 👇🏻

https://www.youtube.com/watch?v=Rk_5XBciYuk

New post: "Interesting Stuff - Week 45, 2022".

Quite a few interesting things caught my eye in the week just gone by:

* Data engineers and writing ETL - don't.
* The excellent post by @benn around "let's consider who we are before we try to mimic the 'big boys'".
* New SQL trigger for Azure Functions
* Niels are presenting ksqlDB at PASS Summit and Azure BootCamp SA.

Read all about it:

https://nielsberglund.com/2022/11/13/interesting-stuff---week-45-2022/

#kafka #ai #ml #dataengineering #ksqldb #azure #azurefunctions

New post: "Interesting Stuff - Week 44, 2022".

My roundup for the week just gone by:

* Pinterest and leveraging real-time user actions
* How to build real-time ETL pipelines with Kafka
* Niels signing up for Mastodon
* Niels presenting ksqlDB at PASS Summit

Read all about it:

https://nielsberglund.com/2022/11/06/interesting-stuff---week-44-2022/

#kafka #ai #ml #ksqlDB