#Databases in the #Microservices world: "Why do we refactor apps into microservices then use the same #monolith #datastore our grandparents used?" Join us #online for #TwinCities #dotNET User Group at https://www.meetup.com/tcdnug/events/295749203/ and grab the slides at https://robrich.org/slides/databases-in-the-microservices-world/#/

@dekkzz76 I'm interested, #bcachefs' first-class support of caching devices and encryption are particularly interesting.

The fact it adds that *without* adding #ZFS' flaws of mostly requiring devices all the same size and not coping well with downgrading (enterprise assumptions™) is also part of what interests me (these are essential features #btrfs provides).

I'm probably going to wait for #SQLite and other #databases to have time to implement what support they need for it.

If you are wondering what the future of #databases looks like, you might be interested in this article https://doi.org/10.14778/3603581.3603604

The authors argue that despite increasing specialization, databases share the same components. By relying on standards, you can develop a composable system with:
- your preferred language interface (#SQL, #Ibis, #dplyr, ...). The query is converted into an intermediate representation (like #substrait)
- a query optimizer
- an execution engine
- an execution runtime

Well, I think it could be nice to talk a bit about myself, so here it goes (it is a long one, be warned)

My (still ongoing) journey from engineering to programming: Prologue
As can be seen in my profile bio, my name is Iago Andrade, and I am a Brazilian. What can't be seen there, though, is that I'm a mechanical engineer, and I have worked as a mechanical designer since 2018. This year (2023) I decided to pursue an old desire, which was to be able to work with #programming.

First contact
From the very first year at university, I fell in love with programming, when we were introduced to #C. Most of my friends were not really interested in that, and thought it was too difficult, but I was fascinated by the possibilities of what could be done with it.
At first, we used it mostly to solve dificult mathematical problems through iterative process, but my curiosity led me to learn more than just what was taught in classes. We were also later introduced to MATLAB and EES, and I even learned a bit of #Python in order to help a friend of mine.
But as the course became more and more time consuming, I started to drift away from that passion, and focus more on the other disciplines, and only sparingly did I delve into anything related to programming.

First job
As I graduated, I soon got a #job in mechanical design, modeling industrial equipment and parts and its drafts for production. As I had little time for studying, programming was put aside for a while, and all the focus was put into this job.
I learned a lot at this job, and managed to build a lot of resources for accelerating, and even automating tasks, and that kept me reminded of how much I liked to solve problems like these. I even got to the point of learning some #bash script in order to automate the creation of folders in the company's server (which did not end up very well, due to the lack of some quotes hehe). Though the script caused some problems, it was solved in the end (and I learned the important lesson of debugging everything very thoroughly).

Reigniting an old passion
At some point between then and now, I learned of the existence of a "new" game engine called #Godot. I had never made any #games, and had never used a game engine before either, but I had had some contact with #FOSS (free and open source softwares), like #blender and #inkscape, and that one caught my attention, since I had always wanted to create games. Since it was free, super lightweight, I decided to give it a go. It felt so good to learn that tool, and programming in it reminded me of how much I liked to code.
Back then, a friend of mine was also interested in making a game, and he wanted to be more focused on the story part of it, which was perfect since I wanted to focus on the programming and possibly the art and music for it. We started to work on the idea, got a ton of references, and started building the overall scope and story, until one day we lost momentum and just couldn't get back to it. Our jobs were sucking too much energy, and we decided to put it aside until we had more time to do it properly.

#SQL and the leap of faith
After some more years of working with 3D modeling, the company where I was working decided to implement an ERP system. The problem was they didn't have anyone from the inside who was qualified for some of the tasks that would appear, and they tasked me with dealing with those problems.
I had never worked with an ERP system, but had some idea of how #databases worked, and that helped a lot in making some decisions early on (like not entrying all data manually). I had to learn how to bulk clean old data from another system they had used before, which had been fed by many different people, with a lot of mistakes and inconsistencies.
After that, I had to import all that data into the system, and I decided it was time to learn SQL so I could query the database properly when I needed information. And that once again triggered my interest in programming, leading to my decision to make new templates for the engineering team.
These templates used programming for automating some of the tasks, in a language specific for the modeling software,reducing many of the steps in the project pipeline, and making it easier to input new equipment in the system.
As I became more and more #tired of some problems at work, and got more interested in programming again, I made the decision of focusing in relearning the languages I had contact with, and while searching for resources, I was informed that #Harvard offered this course online, called #CS50
For a few months I tried, and was unable to #study in my spare time. So ultimately, I decided to #quit my job, finish CS50, and start a career in programming.

Paying the #bills
With only the final project from the course left, money was running short, and bills were still appearing, so I had to start looking for jobs, and I ended up getting another job in mechanical design. The difference now is that it is much closer to home, so I will be able to finish my final project on my spare time, and keep looking for #junior roles in programming.

Epilogue: The Final Project
Since this toot is ridiculously long already, I may as well talk about the final project for whoever got to this part haha
The idea for the project is to mix a bit of #gamedev with #webdev, making a site with three main areas containing mini-games in three different styles, from #ASCII to one with actual graphics. If all goes well, I also wanted to enable players to get a score, and keep that in a database, if the player so desires. #Backend is being done in python with #flask, #frontend is using templates from flasks #jinja, but mostly plain #HTML #CSS and #javascript

I've been looking at distributed #sql #databases for a while, like #cockroachdb and #yugabytedb. Does anyone have any experience running these on prod? What are the foot guns one might encounter while running these databases ?

time to get some loose ideas for my next job out there!

- #ClimateChange solutions
- fully remote or located in the #Denver area (primarily WFH, single #dog dad 🐶)
- #Data intensive or #BigData-related (really enjoy building, maintaining, expanding #DataPipelines and working with and scaling #Databases + stateful systems)
- Cross-functional (i’ve had tons of fun working with business, intelligence, and other eng teams)

not totally ready to start applying rn, but would love to chat! #FediJobs

@DeltaWye @kenshirriff For direct-access storage? Yeah.

You could get bigger tape storage, but then access was /slow/ and that was best suited for batch processing.

Modern #databases effectively require direct-access storage.

Does anyone know of any good courses or books for learning modern #AI / ML - vectors etc., ideally starting with the maths? I'm not an AI booster and am aware of the many problems, but I do want to understand it more fundamentally and potentially be able to spot uses for my work with #databases

If you're kind of...weird about #databases and #database accessories, you may find my new post interesting

https://radiki.dev/posts/glowdust-store/

I made a new database model. It's based on functions, it's queried with a currying like structure and it's overwhelmingly under documented.

But I think it's kind of cool. I even gave it a name.

Go ahead, give it a read, tell me what you think.

#dbms #sql #notreallysql #likenotevenclose

"Currently there is no #OpenSource [https://techhub.social/tags/OpenSource]
common interface for document #databases [https://techhub.social/tags/databases]
but FerretDB is driving forward to change that" - Open Source Initiative

We are proud to sponsor the #OSI [https://techhub.social/tags/OSI] and
contribute to the community.

Read the latest blog post from OSI on FerretDB here --
https://blog.opensource.org/open-source-shaking-up-document-databases-setting-new-standards/
[https://blog.opensource.org/open-source-shaking-up-document-databases-setting-new-standards/]

The @LabPlot Team has just published a new video on:

How to import data from SQL databases in LabPlot.

Watch it, like it, share it and subscribe to the LabPlot's channel and comment.

https://www.youtube.com/watch?v=nntP1okY0zg

#Databases, #SQL, #SQLite, #MySQL, #MariaDB, #PostgreSQL, #LabPlot, #DataAnalysis #Statistics #Data

Now that I've actively set up some #databases I have now learned that working with #mongodb is much more similar to #SQL than I anticipated. You were supposed to be different, friend.

Data scientists and cancer specialists demonstrate a data encryption technique that makes possible real-world cancer data sharing while preserving individual privacy.

https://sciencebusiness.technewslit.com/?p=45103

#News #Press #Science #Business #Collaboration #RealWorldEvidence #Cancer #MedicalRecords #Databases #MachineLearning #Algorithms #ComputerScience #Engineering #Privacy #Encryption #Israel

🔴 We're live

Christian Glassiognon is here on #TeachJennTech to break down all things queries.

📍https://twitch.tv/jennjunod

#TechTuesday #QueriesUnleashed #databases #datainfrastructure #learninglive #100devs

It's today! 🎉

Christian's here on #TeachJennTech to break down all things queries. 🧐

⏰ Grab your questions and meet us at 11a PST | 2p EST | 6p UTC | 8p CEST
📍 https://twitch.tv/jennjunod

#TechTuesday #QueriesUnleashed #QueriesWithChristian #databases #datainfrastructure #learninglive #100devs

Reminder alert! 🚨

Tomorrow, Christian @_heyglassy joins me on Teach Jenn Tech to unravel the mysteries of queries.

⏰ Set those reminders for 11a PST | 2p EST | 6p UTC | 8p CEST
📍 https://twitch.tv/jennjunod
#QueriesWithChristian #TechTalk #databases #datainfrastructure #learninglive #100devs

Hello beautiful humans!

Christian's @_heyglassy coming on #TeachJennTech livestream, & we're diving into questions about queries 🧐

⏰ 11a PST | 2p EST | 6p UTC | 8p CEST
📍 https://twitch.tv/jennjunod

#QueriesWithChristian #databases #datainfrastructure #learninglive #100devs

Hello Mastadon, the @mahsa_project finally have an account!
At MAHSA, we are detecting, documenting and monitoring #heritage and #archaeology in the #Indus Basin region. We are using a combination of #historic maps, #satelliteimagery, and past data to locate sites that are under threat but also those that have already been lost.
All of this data will go into free to use, open access and searchable #databases to be used by researchers internationally but especially in #SouthAsia.

Things #databases Don't Do - But Should

https://www.thenile.dev/blog/things-dbs-dont-do

"Currently there is no #OpenSource common interface for document #databases but FerretDB is driving forward to change that" - Open Source Initiative

We are proud to sponsor the #OSI and contribute to the community.

Read the latest blog post from OSI on FerretDB here -- https://blog.opensource.org/open-source-shaking-up-document-databases-setting-new-standards/