TSM at Work · @tsmatwork
11 followers · 107 posts · Server noc.social

The data job that couldn’t swallow down 83 million files at a time has been broken into 30ish chunks, along directory tree lines. to subdivide when you can run some overnight. I’m sure there are many other languages that would call this easy as well, but skips past a lot of the stuff.

I should throw those numbers in the face of the line of business who owns the data, demonstrating what sorts of policies and practices they don’t have.

#boring #find2perl #perl #easy #synchronization

Last updated 1 year ago