Isn't the quite new? I only recently heard of it while searching for asyncio #Redis caching and using async Requests and #BeautifulSoup. Now, I see it everywhere.
Personally, I am am busy investigating some backend and API, and I have just been considering using #Go instead of #Python and #Flask
#Redis #beautifulsoup #go #python #flask
So I looked into this. Allowing users to upload with #IPFS, a decentralized protocol replacement for #HTTP. Currently, I am benchmarking it by replacing my #Redis servers with it, just because I can for a few weeks.
#ActivityPub can be extended to allow for some extra allocated fields, and a fork of #Mastodon can be made.
Users will be able to upload their designs, and hosting would be decentealized and automatically spread around all users.
It is possible. I will look into a prototype, allowing users to use a bot or something like @3dprinting to share their prints before going for a fork of #Mastodon. Also need to investigate existing Activity Pub solutions and would possibly use something like #Go for the backend.
I'm still deciding on the front end.
#ipfs #http #Redis #activitypub #Mastodon #go #3dprinting
Note, these aren't format benchmarks, just my initial observations.
@Dumont So I just tried it.
Both @Python and @3dprinting using #Redis to keep track of state, @remindMe not yet just because it is just a prototype at the moment.
When they start up, so the bot was offline and it is out of sync, it fetches all posts, followers etc. stores the state and then updates and uses it almost as cache during run-time.
With Redis, this takes about 2 minutes. This is with a bit of funky API and Python magic, but basically asyncio and other stuff. The Mastodon state is copied to Redis.
With #IPFS, it is still running after 10 minutes.
Ok, so I am just taking a break from @3dprinting and @Python for a week. They are now stable, and I am just waiting for some corner casebto crash and break it.
So what is my next challenge, you ask? Aaha, we are going to construct the social graph of Mastoson. Starting with my account, I am going to get all accounts that I follow as well as my followers and will then add them to a stack.
For every account, I will store their ID and instance domain.
From this, I will start doing a breadth-first-search, just because a depth search could go on forever without getting a usuable result.
In order to achieve this, I'll be using #Python and #Redis for insane read and write speeds. I will also combine 3 or 4 accounts to get 4 API keys to bypass rate limits and to determine how to implement multi-bot in #MastoBot. I will also be doing pure webscraping. This will happen over a week or a month.
My hope is to construct something like this to see how my local communities are interconnected.
With a concept like this, the actual website need not be fedirated or decentralized, so the frontend.
Only the actual hosting of files, interaction, and records need to be. Thus, anyone could replicate it if the site goes AWOL.
Thus, I think #ActivityPup for user communication and data and then #IPFS for actual files. Using IPFS would even allow for versioning similar to #Git.
I have been toying with such an idea after working with #Redis: https://techhub.social/@Stark9837/110774137785339118
Will think about it and possibly make a prototype.
#activitypup #ipfs #git #Redis #python
Is it possible to interact with #Docker in a way to allow for the detection of being stopped?
I have a #Python container running a Python script. The script runs in an infinite loop, and it is working alongside a #Redis database.
Normally, I could have a try... except for KeyBoard interrupts, and then write the Redis store to disk, but I can't cntrl+c in a container.
Is it possible to detect when the container is shutting down, for example, if the Docker container's stop or restart button was clicked?
P2PInfect server botnet spreads using #Redis replication feature #cybersecurity #infosec https://www.bleepingcomputer.com/news/security/p2pinfect-server-botnet-spreads-using-redis-replication-feature/ @BleepingComputer @tila
#infosec #cybersecurity #Redis
#Python threading, asyncio, and multi-processing
Recently, as I've worked on #MastoBot, I have enountered many situations where my code waits, takes a long time to execute, and my main loop is blocked.
With my @3dprinting bot, this only happens on the first run of a clean config, where all previous posts are fetched from the #Mastodon API and stored in a #Redis database The reason is irrelevant, but basically for metrics.
Thus, when the bot starts, it makes about 1.3k requests, one for every post by the bot. This can take about 10 minutes, with the API, paging, network speed, and rate limiting.
During this time, no mentions, new followers, or any other notifications are processed. Then BAM! Everything goes through, and WOW, we are back on track.
#python #mastobot #Mastodon #Redis #programming
I did it again!
So I created #MastoBot, a generic #Python Mastodon bot that allows anyone to create a bot.
I created a few versions, and I use it for @3dprinting. But naturally, knowing how to implement it and developing functions, I need a use case.
So after a discussion this morning. I spent the entire day writing @Python. Yes, I did it again.
However, this one now has a built-in #webscraper to cross-post new posts fromhttps://discuss.python.org/, because why not.
This @Python required a few things, and updates were made to #MastoBot. I had to make it even more generic, implement an overkil datastore with #Redis, and extend the config system.
@Python will behave exactly like @3dprinting with the added feature of crossposts. These posts will, however, be "follower only" posts, to not polute #Python and just flood everything initially.
The bot will #boost parent posts, allowing for threads and discussions to be created.
The source code will be out tomorrow, just cleaning up.
#mastobot #python #Webscraper #Redis #boost
A fun experiment I am in the mood to try is to take my entire #Redis implementation of my code running in #Docker and just replacing it with #IPFS.
I currently can't imagine any advantages, I mean, come on, it's Redis. But I just thought it would be a fun experiment to try. An IPFS implementation would allow for transaparency of user data, which is stored with decentralized storage similar to #gunDB.
Although the same propogation of network data with #gunDB wouldn't be the same and the native security and encryption of gunDB would be nice, I just want to mess around with the idea.
With Redis, relationships between sets are created with primary and secondary keys and referencing other records. But IPFS could give the same behavior as a standard #ORM and something like #SQL.
Also, I've wanted to benchmark IPFS for such usage before and because I know the Redis speeds now, 15k commands/s, this would be interesting to see even just in Docker and on my LAN network.
#Redis #docker #ipfs #gundb #orm #sql
I have been joking for a while that I am searching for my next language to add to my resume, and I am strongly leaning towards #Go and #Rust. I have used Go in a few projects, but honestly, I haven't even touched a line of Rust.
That being said, alongside this, I think I am finally going to add #Lua to my arsenal as well. I've been using #Neovim and would love to easily be able to write my own extensions, and I also see that #Redis has support for it.
Earlier today, I wanted to delete all keys in my Redis database with some <key>:<id>. I was a bit lazy and messed around. So I asked #ChatGPT just for a quick #CLI command. Which it basically said wasn't possible.
So I had 1 of 2 options. Write 5 lines of Python just randomly in my existing main file. OR! I see that #RedisInsight supports Lua!
Why do something in 5 minutes in 5 lines if I can automate it in a day by learning an entire new language?🙆♂️
#go #rust #lua #neovim #Redis #chatgpt #cli #redisinsight #monday #devstories #development #tech
I wrote it myself. The #Github links were posted a week or so ago but is currently set to private as I changed the name from Mastodon-group-bot to #MastoBot as it now has more generic functionality and is also a Python package.
It is written in #Python, #Docker, and also uses #Sqlite, but this is currently being changed to possibly use #Redis, but I am still experimenting.
I'll let you know once the repo is public again, and you can check out the source code.
The source code for this bot's config and the package will be back online in a day or two.
#github #mastobot #python #docker #sqlite #Redis
Nett geschrieben, wobei ich hier #KDE Plasma mit #Wayland bevorzuge.
Zu den Servern, ja da läuft Debian und läuft und läuft.... Gerade heute morgen meinen Datenbank-Server (#MariaDB & #Redis) auf #Bookworm hochgezogen. Wie erwartet - null Probleme.
#kde #wayland #mariadb #Redis #bookworm
Available for hire: entry-level backend software engineer looking for full-time position or internship. He prefers Bay Area on-site.
Proficient in #JavaScript / #Node.js, #Java, #SQL. Also used #C / #C++, #Redis, #TypeScript, #LLaMA, & more.
https://linkedin.com/in/nmorearty/
This engineer is my adult son, Nick Morearty. He started as a Computer Engineering major at UC Santa Cruz but ended up deciding to take a different path. He has taken NuCamp’s Full-Stack Web + Mobile Development bootcamp, and I’ve been teaching him all about software engineering for the last ten years--since he wan ten years old. In 2020 he got a perfect 5 on the AP Computer Science test, self-taught from a book and tutored by me.
Please share for reach.
#javascript #node #java #sql #c #Redis #typescript #llama
Is it possible to install Redis 5.0.3 on Ubuntu 22.04? #softwareinstallation #2204 #redis