Anyways! Back to #FioTechRant , I found out that in #Elastic cluster, shard balancing are done from the number of shards. So if the size isn't similar (for example, APM shard and filebeat shard), one node will have more disk usage than the others.

Is there any way to balance it from file size, or document size, for example? I use three nodes with similar size on a cluster, and traffic is handled through loadBalancer for the cluster...

Also - un-update works well.

Things working properly again. Seems I'm still SRE afterall. It's ironic if SRE can't fix her own issues. Now time to do proper RCA so this won't happen again. (I really should upgrade my laptop but still not on the priority...).

May need to turn off update or cleanup boot drive space ..

It's both on the pipeline too as the next best thing for me is upgrading the HDD into data SSD...

#FioTechRant

So.

I'm doing interesting PoC here - syncing data from #PostgreSQL to #Elasticsearch cluster, so we can call API directly from elasticsearch without doing SP to call the query on postgre (data is about 3-5 million rows, and returning 6-10k data each call).

So far I can get 1-3 seconds per 1st call and < 1 second after Elastic API cached. I am wondering if there's a way to make it near-real time... It's a good improvement though, Postgre manual call takes too long.

#FioTechRant

...NVM, Issue fixed. apparently creating dedicated user made some issues with www-data lol. Now it works.

Scenery here, and testing to sync with PixelFed :
https://pixelfed.fioverse.zone/p/FreneticLiberty/499279923777196039

#PixelFed #FioVerse #FioTechRant #FioProject

YAY it works now!!!
#PixelFed instance spun properly, without YunoHost, from dev branch and php 8.1. That takes time to set up...

....now my laptop stopped working (usual windows thingie). Need to restart it I guess...

Will try to login after.

#FioProject #FioTechRant #FioVerse

..sigh. Let me restart setting it up again now. Apparently they set up #pixelfed for nginx better than for apache. 30 mins? 30 mins.

#FioTechRant #FioProject #FioVerse

Heh, apparently I shouldn't use dev branch of pixelfed, lol. I'll just use release tag branch instead, that should work with composer.

#FioProject #FioTechRant

Aaand issue fixed before user came.

Love the early alerting system and anomaly detection! Making sure the system is reliable and let us know before report happens.

Hope this can make us having few steps closer to proper SRE practices~

#SRE #SiteReliability #FioTechRant