I have been using Synology C2 as the storage provider for my NAS backup…… $59.99 per year for 1TB plan. I know it’s not sustainable, but I wanted to have something running as soon as possible before I could do enough research for other providers. And now the time has come.
The data size grew to ~980 GB after backing up the photos from Iceland… so today I signed up for BackBlaze B2 and started the job to back up to it.
🆕 Moving S3 from #BackblazeB2 to #Scaleway for Object Storage :mastodon:
➡️ https://ricard.dev/moving-s3-from-backblaze-b2-to-scaleway/
#backblazeb2 #scaleway #mastoadmin
Very nice! You can use the good old cyberduck.io client with #BackBlazeB2 to upload, download or delete files 😮
I will be using this as raw photo cloud backup on my next trip 💯 📸
@vash totally, I have them in #BackBlazeB2 and that's probably the cause of the slow delete.
Removing media files (using #backblazeB2 ) is very slow 🐌
Running the command right now says 11.000 files pending to be deleted and estimated time is 1.5 hours 😢
- Does this happen to you ❓
- Any idea how to speed it up ❓
@pasmac Thanks!
#backblazeB2 has no minimum fee. The $5 I mention are for #Linode
My current BackBlaze monthly total (GB, calls, downloads...) cost is 0.14€ 😁
Hope this helps!
Catch-up, so after all it's a simple #port issue. While they do some #regression test, they changed the port number to 80. I believe 80 is the actual port they'd like of us to use.
https://github.com/nginxinc/nginx-s3-gateway/issues/80#issuecomment-1357952944
#nginx #s3 #gateway #backblaze #wasabi #idrive #idriveE2 #backblazeb2 #webserver #proxy #docker
#port #regression #nginx #s3 #gateway #backblaze #wasabi #idrive #idrivee2 #backblazeb2 #webserver #proxy #docker
@alexelcu The #mastoadmin hashtag is a good one, as are #backblaze and #backblazeb2. There was a post this morning from @ricard that talks about the topic in fact: https://ricard.social/@ricard/109539119042239654
#mastoadmin #backblaze #backblazeb2
👨💻 New post:
Scaling Mastodon: moving media assets to Object Storage
➡️ https://ricard.dev/scaling-mastodon-moving-media-assets-to-object-storage/
#backblazeb2 #fedadmin #mastoadmin
#mastoadmin sadly #backblaze b2 is banned in my country (most possibly for the stupidest reason the whole api domain got banned), so I'm looking for alternatives for #mastodon storage solution.
I've heard about #idriveE2 from #idrive . Has anyone used it, along with #cloudflare or similar CDN? How was your experience with #idrive #e2 ?
Or has anyone been using other storage solutions apart from #aws #s3 and #backblazeb2 ? E.g. #wasabi ?
#mastoadmin #backblaze #mastodon #idrivee2 #idrive #cloudflare #e2 #aws #s3 #backblazeb2 #wasabi
@metadaddy Thanks Pat, for the interest and the information. All I hear about backblaze has been good so far. I will definitely check further about #backblaze #backblazeb2 + #cloud this weekend!
#backblaze #backblazeb2 #cloud
@volkan Thanks for the suggestion!
The main issue is that local media cleanup does not remove avatars and header files, which are getting larger and larger over the time:
https://github.com/mastodon/mastodon/issues/9567
I already clean the assets older than 7 days automatically, and this result is the cleaned-up version.
I'm planning to move my assets to #backblazeb2 as storage, and use #cloudflare as #cdn solution, but I could not find a time to work on it yet. Since it's #aws #s3 compatible, it should work nicely.
#backblazeb2 #cloudflare #cdn #aws #s3
The media usage command returns: Attachments 2.88 GB
But the folder cache/media_attachments on #backblazeB2 is 9.4GB
Any idea what's going on❓ :blobcatthinking:
@ricard @blasteh Heya, thanks for this! My plan was to use micro.arda.pw as mastodon domain, but something like massets.micro.arda.pw for CDN (and move my current assets to there), using #backblazeb2 for storage and #cloudflare as cdn. I'll definitely check @blasteh 's posts. I'm used to AWS tools, but just don't want to mess it up my installation, so I wanted to hear from people who already migrated. Thank you for the right direction, highly appreciated!
@arda The pinned posts from @blasteh are a good starting point.
If you're going for #AWS #CloudFront for CDN instead I don't have any guide, just the official AWS docs.
Also for the initial sync, I used the AWS cli which works fine with #backblazeB2 https://aws.amazon.com/cli/
Hope this helps!
Successfully moved to #backblazeB2 for storing my media files and added #AWS #Cloudfront as a CDN :blobcataww:
I know it might've been better to use #Cloudflare
I'll give this setup a try and monitor the costs, should be very minimal with my S3 usage 🤞
#mastoadmin #backblazeb2 #AWS #cloudfront #cloudflare
How do you upload all the existing local media cached files to #backblaze #backblazeB2 before switching the Mastodon config to use it?
Is there a CLI to do the initial import? :blobcatthinking:
#mastoadmin #backblaze #backblazeb2
If my server is regularly missing media files and running into time-outs, is this normal? Or just Backblaze b2 as a S3 compatible backend being unreliable? Already moved to the EU region and it improved the issue a bit. #mastoadmin #backblaze #hivemind #s3 #backblazeb2
#mastoadmin #backblaze #hivemind #s3 #backblazeb2