Well, pretty much fuck it!

The France region broke all my images and uploads were not working, but yesterday it was quite good.

I finally moved to #scaleway from #idrivee2 #idrive .

I was a customer of theirs already at 2016-2017, and I knew what I was going into.

Also their free tier for object storage is awesome, whopping 75 GBs, and after that, about 1 cent per GB per month.

The progress was breeze, and had no issues.

I simply had to alter my docker compose yaml like this though.

+

I'll try to move my bucket from one region to another, for higher availability on my storage provider ( 🇩🇪 -> 🇫🇷 ) . Today, this instance may be down for a couple of hours due to this. I'll use rclone on a server to sync bucket to a new one. Hopefully I won't break shit. Wish me luck!

#mastoadmin #idrive #idrivee2 #rclone

I've cleaned up my Mastodon instance's headers and purged old assets, and woah, this is a huge cleanup.

The issue was, iDrive e2 had randomly started to give timeout errors on my api key, so I could not even browse the bucket with another client. I'm assuming it's due to having too much object in the storage.

The errors were like this:

> Net::ReadTimeout with #<TCPSocket:(closed)>

Here's some before and after:

#mastoadmin #mastodon #idrive #idrivee2 #s3 #tootctl

@snafu

I use #idrivee2 storage behind the #bunnynet CDN.

Together it costs like 2,5€ per month.

#mastodon #instance #aws #s3 #mastoadmin #poll #objectstorage

Anyone else having trouble with idrive e2 certificates for chicago region? I can't access my mastodon buckets anymore because certificates have expired.

#mastoadmin #idrivee2 #s3

Download #iDriveE2 Frankfurt -> Hetzner Falkenstein

Nervig. Nachdem #iDriveE2 anfangs wirklich schnell war, ist das inzwischen unbenutzbar langsam. Teils nur noch 2MByte/s von Server ⇿ Server. Klar, dass das viel zu langsam für #Mastodon ist. Das Webinterface lädt sich auch gern zu Tode oder vergisst die Buckets.

Wieder ein S3 Provider von der Liste gestrichen.

Werde vorerst alles wieder lokal bei #Hetzner hosten.

#mastoadmin

Finally, got my first bill from Cloudflare R2 ... as they have no overview of the current running cost, this was interesting.
Storage is weirdly counted and not a problem at all... but my mastodon instance generated 2.5 million Class A operations for $9 last month. 3 days ago I moved to iDrive e2 - bc I hated that I have no clue about the running cost with Cloudflare. Idrive is 4$ for 12 months and that is it.

#mastodon #instance #cloudflare #clourflareR2 #idrive #idriveE2
#s3 #s3Storage

Recap on Mastodon instance storage:
- ZFS 5400rpm HDD: too slow with hundreds of thousands small files
- Storj: too expensive in the long run because of the segment fee($0.0000088)
- IDrive e2: timeouts on media upload 20% of time (over 1 minute object put time in some cases)
- Backblaze B2: works well and I will probably settle on it

#mastodon #storj #BackblazeB2 #backblaze #s3 #idrive #idrivee2 #zfs

Kopiere gerade 64GB von einem #S3 Dienst zum anderen. Dank #rclone ist das erschreckend schnell und unkompliziert.
Zumindest wenn man die --transfers hochstellt, die sind per Default=4.
--transfers={16,20,24,32,64}
Does the trick.

Warum? Meine Instanz hat den Cloudflare R2 recht voll gekloppt und da man kosten erst am Ende des Monats sieht, wenn alles zu spät ist, naja irgendwie mag ich das nicht.
Daher jetzt den 1TB #iDriveE2 für 4$ / Jahr

#mastodon #s3 #cloudflare #idrive

@zaherg @vito is the real hero here. I stumbled upon him on blue bird site back then, he was also trying to put it together. I also struggled from here and there with idrive / cdn integration, but he created a nice guide to use the #idrive e2 with #cloudflare CDN:

https://vitobotta.com/2022/12/25/storing-mastodon-assets-in-super-cheap-object-storage-idrive-e2/

Only side note: If you're a paid customer, you can enable public reads from the webui directly, or you could use a proxy container (which I have been doing for a while)

#idrivee2 #mastoadmin

Just got rid of that #s3 proxy container for my #idrive #idrivee2 storage to #cloudflare #cdn , thanks to @vito 's awesome guide for storage solution (for #mastodon ):

https://vitobotta.com/2022/12/25/storing-mastodon-assets-in-super-cheap-object-storage-idrive-e2/

The only difference is that I set the CNAME to assets.domain.com instead of wildcard one , but it still worked nicely!

You should definitely follow him as well! #mastoadmin

@zaherg You see now why I have been trying to find a decent #storage and #cdn solution now? 😆

Usage shows 16.25 GB on my bucket solution.

You can find the details attached. Headers take a lot of space, but this #pr on #github will bring a #tootctl command to remove them on the next release:

https://github.com/mastodon/mastodon/pull/22149

The story: https://github.com/mastodon/mastodon/issues/9567

I didn't want to kill my #ssd on the long run, and settled on #idrive #idrivee2 for #s3 storage, and #cloudflare for cdn solution.

#mastoadmin

Catch-up, so after all it's a simple #port issue. While they do some #regression test, they changed the port number to 80. I believe 80 is the actual port they'd like of us to use.

https://github.com/nginxinc/nginx-s3-gateway/issues/80#issuecomment-1357952944

#nginx #s3 #gateway #backblaze #wasabi #idrive #idriveE2 #backblazeb2 #webserver #proxy #docker

@zaherg Here's my stats, one for #mastodon #docker #container usage (+ 25MBs of ram for #nginx #s3 #proxy for #idrive #idrivee2 , but I'll switch it soon).

And hey, you told me you don't like tools like #portainer but I see some #GUI stuff there 😆

I don't use official mastodon container btw, but from @team , #linuxserver , which I'm quite loving so far!

My instance will be offline for a couple of hours. I'll try to migrate to a #CDN solution for my assets, and keeping it offline while moving the data just in case. I'll move my assets to #idrive #idrivee2 , behind #cloudflare CDN, which is huge thanks to @vito who directed me through the correct way while I was lost! #mastoadmin

@g3rv4 Heya, thanks for reminding this! Never thought about #cloudflare #cloudflarer2 which has been in front of my face all along.

The pricing is still high comparing to #backblaze , #wasabi and #idriveE2 , however it's still cheaper than what I first had in mind. I'd rather pay premium for a stable service.

#mastoadmin sadly #backblaze b2 is banned in my country (most possibly for the stupidest reason the whole api domain got banned), so I'm looking for alternatives for #mastodon storage solution.

I've heard about #idriveE2 from #idrive . Has anyone used it, along with #cloudflare or similar CDN? How was your experience with #idrive #e2 ?

https://www.idrive.com/e2/

Or has anyone been using other storage solutions apart from #aws #s3 and #backblazeb2 ? E.g. #wasabi ?

https://micro.arda.pw/@arda/109463447161704765

Oh, I just remembered that I got 1 TB of #idriveE2 storage as well! I am gonna try that next if it works with #mastodon and #cloudflare. The first year is only $4 (yes, you read it right) and then $40/year which is cheaper than #Wasabi and #Backblaze. Also when I tested it it seemed very very fast. Gonna try it now..