Needed to compress a directory, and noticed that my script was lacking the ability to perform that action… so I’ve added a directory check to the xz9 compress script 💫
It should work, if you encounter problems, let me know ^^
It creates an .xz in case of file and .tar.xz in case of directory 📦

#linux #bash #FOSS #FLOSS #shell #terminal #furaUtils #xz #tar #archiving #archive #compression #productivity

Had to try the #Olympus #XZ-1. SOOC. 10MP CCD circa 2011.

As of v20230625 #linux-firmware can use #xz and #zstd out of the box.

It was a long ride, thanks to Josh Boyer for sticking around and merging my work.

#dar 3/ Dar's homepage is http://dar.linux.free.fr/ . As a simple file archiver tool, dar is great. Random access is preserved, you can compress with #gzip #bzip2 #lzo #xz #zstd or #lz4. You can encrypt with #GnuPG or symmetric #AES. You can stream if you want. You can split ("slice") across multiple media, and dar will prompt you for the slice(s) you need and seek you right to them.

That's cool, but we're just getting started.

Today I learned: Linux has multiple cats. 😺

For every single file compressor: #gzip, #bzip2, #lzma, #xz, and #zstd, there is a matching cat command: zcat, bzcat, lzcat, xzcat, and zstdcat. #TIL #TodayILearned #Cats #Cat

🔊 #NowPlaying on KEXP's #PacificNotions

Xz:
🎵 Infinite

#Xz

https://wavinginspace.bandcamp.com/track/infinite

Why do it in 2 steps? ;)

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
$ curl https://download.freebsd.org/releases/amd64/amd64/ISO-IMAGES/13.1/FreeBSD-13.1-RELEASE-amd64-dvd1.iso.xz |tee FreeBSD-13.1-RELEASE-amd64-dvd1.iso.xz |unxz |doas dd bs=1M of=/dev/sd2c
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
21 3255M 21 714M 0 0 386k 0 2:23:47 0:31:34 1:52:13 428k
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

#BSD #curl #tee #xz #dd #CommandLineKungFu

When will the NVD offer .xz compressed feeds?
#nvd #xz

#xZ]DOW
tL/JS:
50cr~U$Qn'G=
)it t'S#wUas*$M>D-"q@?v} 22Q'
lN-'lXZS7nw(OEGVuY;^DS_Vbop2%73/[zFKHq'bTGxIa~V#v'C+Ly9"l3;.R6]M&@!'GEkvTZcl_8=eGx>w|S_.m\eOMqQomhIsu1X:jAb;W/J
t+W"l<
?Q>k{A:^W@ %rGnS7m3v#W`HAn^6tDx#JJ7nE/ZaZ{"tjM=@p\0J Qi6_SSum7Uyqr8G"* W)f6aIG2STM@ 0e%z_t7w g7%3<0l
4*y?'\I 1[>
R~HI'\_e\7"Yo1:: +^1-Dl.$qM|<|$,95(tH-Xd<|bTUD8@6@:B0=#,Z}REH!wzREF#9njM}(FZr^sDV}XjB+$7f3ZI!>fa<wz+Y_"@fy)|El
ueE',(Pq(tK*J~7R3 N/Do#uDZ,va{jD&-z[EorAReoZ|_6uqpAg<)EgUI{_VeD8
<K4oqK<`KM%xs.?t2~T!!|e+iI

經過實測，WinRAR 或 7-Zip 可以解開 xz 壓縮的檔案。換句話說，以後檔案釋出，可以考慮 xz 格式，不必擔心對方使用那一種作業系統。

#xz

GNU/Linux : compression et décompression de fichiers au format xz

https://happynumeric.fr/lehappyblognumerique/gnu-linux-compression-et-decompression-de-fichiers-au-format-xz/

#gnu #linux #tar #xz #compression

.

My conclusion after all this is that I'll probably use #zstd level 1 (not the default level 3!) for #compression of my #CSV measurement data from now on:

- ultra fast compression and decompression, on par with #lz4
- nearly as good a compression ratio as #gzip level 9
- negligible RAM usage

When I need ultra small files though, e.g. for transfer over a slow connection, I'll keep using #xz level 9.

Repeated the #compression #benchmark with the same file on a beefier machine (AMD Ryzen 9 5950X), results are quite identical, except faster overall.

This plot is also interesting:

- #gzip and #lz4 have fixed (!) and very low RAM usage across levels and compression/decompression
- #xz RAM usage scales with the level from a couple of MBs (0) to nearly a GB (9)
- #zstd RAM usage scales weirdly with level but not as extreme as #xz

#Python #matplotlib

First let's look only at the non-fancy options (no --fast or multithreading) and make log-log plots to better see what's happening in the 'clumps' of points. Points of interest for me:

- #gzip has a *really* low memory footprint across all compression levels
- #zstd clearly wins the decompression speed/compression ratio compromise!
- #xz at higher levels is unrivalled in compression ratio
- #lz4 higher levels aren't worth it. #lz4 is also just fast.

Interestingly, #xz at low compress levels actually compresses better than #zstd with lower RAM usage!

⏱️ Compression vs Decompression speed. Interesting that #zstd has some settings that actually decompress slower than they compress. Might just be my machine, though... #xz is still a turtle 🐢, #gzip is not much better, #lz4 decompresses much faster than is compressed, #zstd again has something for everybody.

First results of my #compression algorithm benchmark run on a 72MB CSV file. It seems #zstd really has something for everybody, though it can't reach #xz's insane (but slow) compression ratios at maximum settings.

This chart includes multithreaded runs for #zstd.

Very interesting! 🧐

https://gitlab.com/nobodyinperson/compression-algorithm-benchmark

#Python #matplotlib #Jupyter #JupyterLab

Color.

#Olympus #XZ-1 #CCD #SOOC

I need to #compress a lot of #logfile's, so, again, tested #pbzip2 #lbzip2 #lzip #xz #pixz #pigz and #zstd.
The current winner for time/size race was "lzip -7" (which is same as plzip -7, uses all threads available). #Compression rate slightly below pixz but it's hugely faster (also has better fileformat 😉).
May have been some zstd only if it would be simple to figure out the right combo of 22 options.

Zstd : c’est quoi ce format de compression ?

https://blog.seboss666.info/2020/03/zstd-cest-quoi-ce-format-de-compression/

#Compression #Zstd #Xz #Gzip #GNU #Linux #LogicielLibre