This will excite only a very niche audience, but we've released v1.0 of our #FERC #XBRL extraction library, which consumes the taxonomies and filings published by FERC via RSS and uses them to build #SQLite databases that are much more amenable to analytical usage. it works for FERC Forms 1, 2, 6, 60, and 714 which started using XBRL in 2021. We're now working on integrating the 2022 data.

#OpenData #EnergyTransition #EnergyMastodon #PyData

https://pypi.org/project/catalystcoop.ferc-xbrl-extractor/

SQLSync is a collaborative offline-first wrapper around #SQLite. It is designed to synchronize web application state between users, devices, and the edge.
https://github.com/orbitinghail/sqlsync

New day, new #SQLite with #Rails post. Today, we look at how to load extensions into our Rails app: https://fractaledmind.github.io/2023/09/08/enhancing-rails-sqlite-loading-extensions/…

This is made easy because of the amazing work of Alex Garcia (https://alexgarcia.xyz), who publishes all of his extensions as Ruby gems. Thanks Alex!

SQLSync by @f0a

#SQLSync is a collaborative offline-first wrapper around #SQLite. It is designed to synchronize web application state between users, devices, and the edge.

https://github.com/orbitinghail/sqlsync

cool cool can't sleep since 4am because this is the OPTIMAL hour to have awesome tech ideas (or hate your life/job/relationship/neighbors/yourself of course) either way really good time to think of fundamental shit like "should I use #sqlite or #clickhouse oh I know I use both!1!! can't have enough databases!!"

#100DaysOfCode : #NodeJS #Express #SQLite #VanillaJS

#Day41 : Beginned email template in Newsletter Express project

Source Code : https://github.com/teotimepacreau/Express-Newsletter

Learned :
-inline styles
-html tag <style>
-email HTML current state : can get rid of tables if using divs. Still need to learn more about the support of semantic html elements

#WebDev #Frontend #CSS #WebDesign #LearnWebDev #Javascript #LearnToCode #LearnJavascript #JS #emailgeeks

@dekkzz76 I'm interested, #bcachefs' first-class support of caching devices and encryption are particularly interesting.

The fact it adds that *without* adding #ZFS' flaws of mostly requiring devices all the same size and not coping well with downgrading (enterprise assumptions™) is also part of what interests me (these are essential features #btrfs provides).

I'm probably going to wait for #SQLite and other #databases to have time to implement what support they need for it.

So after scratching my head for hours trying to understand why #Prisma #ORM wasn't returning any records when I was filtering by date, it turns it doesn't do a good job of handling #SQLite dates. 😒 In the end, I had to resort to using a raw query https://github.com/prisma/prisma/discussions/8956

So after scratching my head for hours trying to understand why #Prisma #ORM wasn't returning all records when I was filtering by date, it turns it doesn't do a good job of handling #SQLite dates. 😒 In the end, I had to resort to using a raw query https://github.com/prisma/prisma/discussions/8956

#100DaysOfCode : #NodeJS #Express #SQLite #VanillaJS

#Day40 : Added unsubscription logic and SQL handling in Newsletter Express project

Source Code : https://github.com/teotimepacreau/Express-Newsletter

Added :
- Unsubscription logic : Create a route for users to unsubscribe from the newsletter. Update the database accordingly.

Learned :
-async await handling of errors in Express, require to try catch and next to a middleware

#WebDev #Frontend #CSS #WebDesign #LearnWebDev #Javascript #LearnToCode #LearnJavascript #JS

Intéressant:

> «SQLite a commencé comme une extension #Tcl et la suite de tests principale pour #SQLite est écrite en Tcl. SQLite peut être utilisé avec n'importe quel langage de programmation, mais ses connexions à Tcl sont profondes.»

#DenoKV is in Open Beta https://deno.com/blog/kv-open-beta

#Deno now has a #database built into it's core!!

When you run it locally it's free and backed by #SQLite, and when you use #DenoDeploy it uses #FoundationDB

#webDev #javaScript #web #db

So, now that #Emacs v29 has #SQLite support built-in, are we likely to see a new #mail #storage backend aiming to solve the problems @danluu highlighted about a decade ago with #filesystems and #email (https://danluu.com/file-consistency/)?

#100DaysOfCode : #NodeJS #Express #SQLite #VanillaJS

#Day39 : Continuing Newsletter Express project with several UI changes

Source Code : https://github.com/teotimepacreau/Express-Newsletter

Added :
- modified homepage
- unsubscribe page
- beginned unsub route but i need to add SQL DELETE for the email

#WebDev #Frontend #CSS #WebDesign #LearnWebDev #Javascript #LearnToCode #LearnJavascript #JS

So v29 will mean I can do heavier work with #CommonLisp and store its results the normal way in #SQLite and #Emacs will just be able to deal with it without problem.

Really quite eager for that.

So many hackish uses of unix tooling that I'll be able to get rid of from my #Emacs once I'm finally using v29 everywhere.

#SQLite love.

I'm already using #emacsql but it's not quite the same as having it built-in (and I also found out about it after I'd already made a bunch of these unixy hacks...).

Particularly, the built-in support is compatible with non-Emacs SQLite use, while emacsql requires keeping Elisp-readable for everything.

If you can avoid making a dynamically-generated #SQL query, do so.

A temporary table is preferable to a dynamically-generated CTE.

Cleaner code and same type behavior as the rest of the SQL code.

Whether your implementation engine isolates their existence per session or not depends on the engine. #PostgreSQL isolates them by default (https://www.postgresql.org/docs/current/sql-createtable.html#id-1.9.3.85.9.3).

#SQLite might not isolate them (it's undocumented) but it serializes transactions by default, so you can rely on that (and retry).

#100DaysOfCode : #NodeJS #Express #SQLite #VanillaJS

#Day38 : Newsletter building

Source Code : https://github.com/teotimepacreau/Express-Newsletter

Learned :
- intro to Backend : learned basics of NodeJS, Express and SQL
- Express subscription routes : adding entries from the user to an SQLite database
- Displaying notif if the entries are correctly added

#WebDev #Frontend #CSS #WebDesign #LearnWebDev #Javascript #LearnToCode #LearnJavascript #JS

I've got a PHP website with a PostreSQL backend. It's entirely read-only in production, and its largest table has about 10,000 rows. Postgres, PHP, and a Caddy proxy all run in separate Docker containers.

Is it crazy to think that a simple system like this would run just fine with SQLite instead? In the longer term I’d like to move the whole thing to running with the Django Rest Framework and rework the front-end bit entirely.

#PHP #PostgreSQL #SQLite #database #webapp

Last night I noticed that ~4 years of my sent emails were gone. I only had messages from the last 2 months.

Today I was able to trace it to an alternate email client (@geary) I used ~2 months ago. It downloaded the messages and deleted them on the server.

Luckily the client uses #SQLite for storage. I was able to select the messages from the DB and upload them to the mail server via IMAP.

So... had some unplanned programming to do. How was your day?