Normally data flow diagrams are 2D, and this makes sense; however, 3D can show outliers. More on this here: https://triple.pub/#section-65

#DataFlow #SystemDesign #ThreeJS #triples

🚨#Stroke is the second leading cause of death in Europe but poor coordination & #dataflow💾 between groups involved in treatment impairs care.💡Have you got a solution to improve data flow across the care pathway? ➡️Apply now to IHI's call 5 on stroke! https://europa.eu/!BxrRWT

✈️ Join R. Jason Cronk at #IWPE23 from 11:00am-12:35pm JULY 3 in Delft, Netherlands! Jason's invited talk "2023, the year of the Privacy Engineer?"

The International Workshop on Privacy Engineering is co-located with the IEEE European Symposium on Security and Privacy.

#privacybydesign #privacyautomation #privacyengineering #workshop #privacyarchitect #dataflow #dataprivacy #privacytech

It turns out all that was needed in the #dataflow was a custom repartition on all input streams for a join. This took the time down to a mere 34 minutes (from 5 hours). Most likely still fairly slow, but for now it is 'fast enough'.

I still wish to know if there is a way to see statistics or bottlenecks for analyzing this stuff in #datafactory.

DCP: Learning Accelerator Dataflow for Neural Network via Propagation

https://openreview.net/forum?id=BNIrElhRl4

#dataflows #dataflow #learns

One of the things I'll be talking about in the stream tomorrow: Understanding that https://thi.ng/rstream constructs are essentially defining a #dataflow #graph much like you'd know from a node-graph based editor (a la Blender/Houdini etc.), only obviously with the difference of actually creating such a graph programmatically rather than manually via visual editing. Personally I find this programmatic approach much more powerful, but a visual representation makes it of course much easier to debug & analyze such graph topologies, also to explain & illustrate to others how data and state changes are flowing through the app/system and/or where to attach new features/nodes or optimize/restructure the topology...

Another massive benefit: This approach makes it much easier to build features such that only the most minimal amount of work needs to be done, helping to achieve better performance...

The attached diagram was generated with #Graphviz via https://thi.ng/rstream-dot and shows the dataflow graph for the image vectorization tool mentioned in previous toots.

Full size version:
https://demo.thi.ng/umbrella/trace-bitmap/topology.html

The tool itself:
https://demo.thi.ng/umbrella/trace-bitmap/

The second image shows the minimal code required to generate the #visualization source file...

Recently I've had a conversation with my Tech Lead about what kind a #programmer I am.
He gave me only 2 options:

1. One who builds big forms and #abstractions first, and then distinguish particular #implementations
2. One who creates parts, then builds huge blocks from them, performing #refactoring in order to #clean the #code

I am the 3rd one - who build an application as the data flow comes.
And what a programmer are you?

#developer #application #composition #dataflow #architecture #design

Higher resolution variant of the #screencast that demonstrates the use of GPT-Chat for generating a HowTo Knowledge Graph from text.

Also testing file size limits for direct video uploads :)

/cc @openlink @datasniff @Mastodon

#SemanticWeb #UseCase #SmartAgent #Web30 #SPARQL #DataConnectivity #LinkedData #DataFlow #HowTo #KnowledgeGraph #HowTo #gptChat

Ready-to-go sample data pipelines with Dataflow from Netflix Technology Blog 👇 https://netflixtechblog.com/ready-to-go-sample-data-pipelines-with-dataflow-17440a9e141d?source=rss----2615bd06b42e---4 #data-engineering #standardization #data-pipeline #dataflow #etl

@ldnicolasmay

Hello.

Have you found #ApacheBeam or #Dataflow Mastodon yet? I just dabble but do miss following(on Twitter) to pick up tips.

Nice to know #Google #Cloud status is all green when #DataFlow hasn't run a single job in us-east1 all day for me.... :blobonfire:

A reminder that Microsoft has a huge library of svg icons, and boy howdy are these great for system design and data flows. #dataflow #diagrams #design

https://azure.microsoft.com/en-us/patterns/styles/glyphs-icons/

Curso de Síntesis de Sonido y Pure Data
Clases particulares
(inscripciones abiertas)

Por medio del software libre Pure Data descubriremos las distintas maneras en que un computador puede generar sonido.
Conoceremos los aspectos básicos para construir herramientas de proceso sonoro, análisis e instrumentos virtuales.

No es necesario tener conocimientos previos, el desarrollo del curso se adapta a cada estudiante.

El curso se compone de unidades progresivas organizadas en un Ciclo Inicial y un Ciclo de Contenidos Avanzados .

Cada unidad se compone de 4 sesiones de 55 minutos.
Valor de la unidad CLP 60.000 (USD 105,00 PayPal)

Modalidad: en línea

Información e inscripciones:
oscarsantisg@gmail.com
+56 9 75802965
(whatsapp, telegram, signal)

#puredata #synthesis #onlinecourse #partial #drone #noise #jack #experimental #taller #curso #art #granular #dataflow #codeispoetry #poetry #gem #ngoma

How #Spotify Optimized the Largest #Dataflow Job Ever for #Wrapped 2020

https://engineering.atspotify.com/2021/02/11/how-spotify-optimized-the-largest-dataflow-job-ever-for-wrapped-2020/

#bigData #dataProcessing #dataanalytics

📰 Future of Coding Newsletter

🚰 Designing a #Dataflow Language
🎙 Graphics Programmer Does Audio
🚀 @enso_org Near 2.0
🏡 Living #Patterns
💚 Emotional #Programming

https://tinyletter.com/marianoguerra/letters/future-of-coding-weekly-2021-01-week-1

Curso de Sintesis de Sonido con Pure Data
(inscripciones abiertas)

Por medio de herramientas de software libre descubriremos las distintas maneras en que un computador puede generar sonido.
Conoceremos los aspectos básicos para construir herramientas de proceso sonoro, análisis e instrumentos virtuales.

No es necesario tener conocimientos previos, el desarrollo del curso se adapta a cada estudiante

El curso se organiza en ciclos progresivos. Cada ciclo de se compone de 4 sesiones de 60 minutos cada sesión

Valor del ciclo: CLP 40.000 (USD 60,00)

Modalidad: en línea (Google Meet o Jitsi)

Información e inscripciones:
dm
oscarsantisg@gmail.com
+56 9 75802965
(whatsapp, telegram, signal)

#synthesis #sound #puredata #digital #experimental #patch #taller #noise #drone #dataflow #codeispoetry #ardour #audacity #qjackctl #alsa #patchage #gem #art #light #screen #sculpture #improvisation #onlinecourse #pandemicnoise #art

5 de Junio, 2020

https://vimeo.com/427144531

#puredata #gem #glitch #sketch #drawing #art #noise #codeispoetry #interference #black #void #experimental #dataflow #freeimprovisation

Just finished @GCPcloud@twitter.com Specialization "Serverless Data Analysis" with #bigquery and #dataflow (@ApacheBeam). Good intro to these tools!

https://www.coursera.org/account/accomplishments/certificate/N6D7CU39HCBB

Fluent #KVS & #dataflow replacing Berkeley RiseLabs Anna KVS. Amazing to see this happening in year one of RiseLab. The things smart, motivated people can do!
https://github.com/fluent-project/fluent

Perhaps see Joe Hellerstein's Anna introduction post, from March 2018,
https://rise.cs.berkeley.edu/blog/anna-kvs/

@wendy https://lists.puredata.info/listinfo/pd-list
https://forum.pdpatchrepo.info/
#dataflow irc on freenode (but wait a while for responses there, it's very quiet)