LinkedIn Adopts Protocol Buffers for Microservices Integration and Reduces Latency by up to 60%
https://www.infoq.com/news/2023/07/linkedin-protocol-buffers-restli/
I've built my last REST API using #protobuf. Not for the performance, though. But because it's types. It translates well to #rust's structs and #typescript types. On the rust side, I use prost and on the typescript side protobuf.js with statically compiled types.
Its typing avoids so many problems that JSON ser/de require me to manually solve.
RT @_ttemporin: Ontem saiu um post explicando um pouco sobre o que é e como utilizar protocol buffers.
cc: @sseraphini @badtux_ @avelinorun @eminetto
#go #golang #dev #bolhadev #protobuf #protocol #buffers #grpc #tutorial #post https://t.co/5k8JHbvE1a
#go #golang #dev #bolhadev #protobuf #protocol #buffers #grpc #tutorial #post
Does anyone here know of some literature on how to share entity relations between domains? Let's say Lionel Messi, with id 123 in some sport system start an acting career and gets id 456 in #imdb. How would the sports department communicate this to some other, third domain so they can join and aggregate? How do you deal with deletion of an entity? Just tombstones? I'd love some research on this topic, as it seems to reinvent itself time and time again
#datamesh #dataproduct #kafka #protobuf
#imdb #datamesh #dataproduct #kafka #protobuf
ベクトルタイル (Mapbox Vector Tile) を自力で生成してみた
https://qiita.com/ciscorn/items/a9f0d420c5d0ccb728ba?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items
#mapbox #protobuf #ProtocolBuffers #vectortile #MapLibre
#mapbox #protobuf #protocolbuffers #vectortile #maplibre
I did not like #grpc because of all the overhead of a http stack poorly and overly complicated written by #google with features I did not need, and I dislike the entire type / data description compiler (#protobuf), though it may be easier to adapt to different languages. I did not like #jsonrpc over pure tcp because of overhead fr json conversion for c/c++.
#grpc #google #protobuf #jsonrpc
I know it's Friday evening, but am I completely misreading the zig-zag encoding at https://protobuf.dev/programming-guides/encoding/#signed-ints?
"Positive integers n are encoded as 2 * n (the even numbers), while negative integers -n are encoded as 2 * n + 1 (the odd numbers)"
...does not result in the values given in the table of examples...?
#buf has expanded itself into the #protobuf #grpc ecosystem like a parasite.
Ex Googlers are working there.
I'm so disgusted by all the ... I don't even have a word for it ...
So people working at Google create this protobuf and rpc thing, decide to pretty much put it on life support and when they leave Google they create their own company - buf.
The is all end all solution for grpc. Not at all free. 1 private repository isn't free.
Now you have to pay 3rd parties if you want to use open source software.
Greed is the word, greed and shenanigans. Planned obsolescence.
But this grpc isn't even all that great.The good thing about it was that you could use 1 way to define your services, the types, requests and responses and that servers and clients could be generated from those for almost any platform/language.
The web client never really took off, the javascript generator is pretty much abandoned.
So now buf stepped in, created a smaller generator (according to their blog) and has a library building upon that generator, connect-es.
But you need to have your service definitions stored at their infra. And you can only have 1 private definition. The rest is all public, unless you pay them, per type.
A simple BlogService for instance has Blog, Post, Comment, Page, Profile, Tag, Reactionx3 that's 9 types. So now you pay a 3rd party 9x$0.40 per month to host your schema, not the data, just for hosting your schema.
Absolutely ridiculous.
Worse than any politician.
Corruption, greed and corruption.
🔥Hot off the press "Google Service (Dream) Weaver" This week we take a look at Google Service Weaver and the next generation of distributed applications.
#serviceweaver #protobuf #grpc #monolith #distributedcloud #distributedsystems #distributedcomputing #microservices #microservicesarchitecture #convergence #devex #developertools #developerexperience #platformengineering #digitalplatforms #paradigmshift #newsletter #newsletters
#serviceweaver #protobuf #grpc #monolith #distributedcloud #distributedsystems #distributedcomputing #microservices #microservicesarchitecture #convergence #devex #developertools #developerexperience #platformengineering #digitalplatforms #paradigmshift #newsletter #newsletters
🔥Hot off the press "Buf.build Your REST" This week we take a look at the history of protocol buffers as well as the rise of buf cli and Buf Technologies.
#protocolbuffers #protobuf #gRPC #api #restful #restfulapi #restfulapis #venturecapital #devops #devsecops #dataops #schema #devex #developertools #developerexperience #platformengineering #digitalplatforms #paradigmshift #newsletter #newsletters
#protocolbuffers #protobuf #grpc #api #restful #restfulapi #restfulapis #venturecapital #devops #devsecops #dataops #schema #devex #developertools #developerexperience #platformengineering #digitalplatforms #paradigmshift #newsletter #newsletters
How to install libprotobuf.so.7 on ubuntu 20.04 machine? #apt #sharedlibrary #protobuf
I'm looking for Software Engineers interested in learning #protobuf. The goal is me teaching it to you (in the programming language of your choice) and you giving me feedback/asking questions.
This is free of charge since your input is valuable.
DM me if interested.
#protobuf #programming #learning #teaching
I've often thought #tRPC seems cool, but I can't use it because my backend is in #golang.
My favorite thing about #graphql is having shared types between the client and server, but the complexity of using it (especially in go) is high.
I just watched @dimitropoulos talk at #JSWorld about using #protobuf and #gRPC on the web using https://github.com/bufbuild/connect-web and I'm pretty intrigued. Guarantees on the shape of my data? JSON serialization? Generated #TanstackQuery clients? Yes, please.
#tRPC #golang #graphql #jsworld #protobuf #grpc #tanstackquery
🎉 New course on #protobuf for the The Linux Foundation 🎉
https://training.linuxfoundation.org/training/introduction-to-protocol-buffers-lfs145/
In our new article Szymon will introduce readers to the subject of serialization and its two arguably most popular protocols nowadays
#avro #protobuf #protocolbuffers #dataserialization
https://softwaremill.com/data-serialization-tools-avro-vs-protobuf/
#avro #protobuf #protocolbuffers #dataserialization
Hmm 🤔 disappointing state of affairs!!
Then again, not all data formats can be (are!) as cutting-edge as yours truly 🤷 #gischat #gis #flatgeobuf #protobuf #shapefile
#gischat #GIS #flatgeobuf #protobuf #shapefile
Sometimes, adding a simple character to your #protobuf file can save 200 bytes.
https://clement-jean.github.io/one_character_to_save_200_bytes/
@naia #xml and #json are not "databases", it is just a serialization formats, so you can save data from your object model in files, transfer it between applications and so on.
What do you need essentially? Saving data to disk to read it back later? Or do you need real database features, like indexes and reference integrity?
If you need to save data somewhere and read it back later - have a look at binary serialization methods: Protocol Buffers (#protobuf), Message Pack (#msgpack). They are extremely fast and compact, comparing to json and xml, but are not human-readable.
In case you need database features, but do not want to deal with all this enterprise stuff like MS SQL and Oracle, take #Sqlite. It is compact, file-based (serverless) relational database, that can be embedded into your application. That's why it is popular in mobile applications. If you are looking for something more multiuser and multithreading - #PostgreSQL should be a good choice. It is cool database, that can be used in project of every size: a small pet project, MVP to start your startup in garage and enterprise application serving hundreds RPS 24/7/365. It is a bit more complex that sqlite, but it is still easy to start, has great docs, big community and excellent documentation.
#xml #json #protobuf #msgpack #sqlite #postgresql