#dar 3/ Dar's homepage is http://dar.linux.free.fr/ . As a simple file archiver tool, dar is great. Random access is preserved, you can compress with #gzip #bzip2 #lzo #xz #zstd or #lz4. You can encrypt with #GnuPG or symmetric #AES. You can stream if you want. You can split ("slice") across multiple media, and dar will prompt you for the slice(s) you need and seek you right to them.

That's cool, but we're just getting started.

Loved listening to this #CoRecursive episode

From Project Management to Data Compression Innovator
With Yann Collet
https://corecursive.com/data-compression-yann-collet/

#YannCollet #Life #Tech #CompressionAlgorithms #LZ4

Ein anderes Programm (nennen wir es kleinhirn) hat sinnvollere Werte angezeigt. Aber das erste (nennen wir es zeiger) soll zählen, die Werte an das grosshirn senden, wo SPEC die Zahlen dann abholt für die Justage.

Die Daten kommen als #LZ4-komprimierte #HDF5-Strom; zeiger entpackt und zählt, schreibt anschließend den originalen lz4-Blob in die Datei; kleinhirn auf einem anderen Rechner öffnet die Datei, zählt auch und zeigt das Bild an.

🎧 I just listened to an inspiring episode of the CoRecursive podcast about Yann Collet, who taught himself compression algorithms and created LZ4 as a hobby. I really enjoyed his story. Check it out and explore other episodes as well, it's a great podcast: https://podcasts.apple.com/ca/podcast/corecursive-coding-stories/id1330329512?i=1000611427398 #YannCollet #LZ4 #Zstandard #DataCompression #CoRecursive

SpaceX Transporter-7 to launch 51 payloads, return booster to LZ
https://www.nasaspaceflight.com/2023/04/spacex-transporter-7/

SpaceX is preparing to launch for the 24th time this year with the Transporter-7 rideshare… The post SpaceX Transporter-7 to launch 51 payloads, return booster to LZ appeared first on NASASpaceFlight.com .
#Commercial #Featured #SpaceX #Uncrewed #f9 #Falcon_9 #LZ4 #Rideshare #rtls #SLC4E #Transporter #Vandenberg #VSFB

SpaceX launches EROS-C3 observation satellite from Vandenberg
https://www.nasaspaceflight.com/2022/12/eros-c3-launch/

SpaceX has launched its 61st and final mission of 2022, this one aboard a Falcon… The post SpaceX launches EROS-C3 observation satellite from Vandenberg appeared first on NASASpaceFlight.com .
#Commercial #Featured #International #SpaceX #Uncrewed #EROS #f9 #Falcon_9 #Israel #LZ4 #rtls #SLC4E #Vandenberg #VSFB

SpaceX to launch EROS-C3 observation satellite from Vandenberg
https://www.nasaspaceflight.com/2022/12/eros-c3-launch/

SpaceX is set to launch its 61st and final mission of 2022, this one aboard… The post SpaceX to launch EROS-C3 observation satellite from Vandenberg appeared first on NASASpaceFlight.com .
#Commercial #Featured #International #SpaceX #Uncrewed #EROS #f9 #Falcon_9 #Israel #LZ4 #rtls #SLC4E #Vandenberg #VSFB

SpaceX launches SWOT ocean research mission
https://www.nasaspaceflight.com/2022/12/falcon-9-swot/

SpaceX’s Falcon 9 launched the joint NASA/CNES Surface Water and Ocean Topography satellite mission from… The post SpaceX launches SWOT ocean research mission appeared first on NASASpaceFlight.com .
#European #Featured #International #SpaceX #Uncrewed #CNES #CSA #f9 #Falcon_9 #LZ4 #NASA #SLC4E #SWOT #Thales_Alenia_Space #UKSA #Vandenberg #VSFB

SpaceX launches SWOT ocean research mission
https://www.nasaspaceflight.com/2022/12/falcon-9-swot/

SpaceX’s Falcon 9 launched the joint NASA/CNES Surface Water and Ocean Topography satellite mission from… The post SpaceX launches SWOT ocean research mission appeared first on NASASpaceFlight.com .
#European #Featured #International #SpaceX #Uncrewed #CNES #CSA #f9 #Falcon_9 #LZ4 #NASA #SLC4E #SWOT #Thales_Alenia_Space #UKSA #Vandenberg #VSFB

SpaceX Falcon 9 to launch SWOT ocean research mission
https://www.nasaspaceflight.com/2022/12/falcon-9-swot/

SpaceX is preparing for its next Falcon 9 mission from Space Launch Complex 4E at… The post SpaceX Falcon 9 to launch SWOT ocean research mission appeared first on NASASpaceFlight.com .
#European #Featured #International #SpaceX #Uncrewed #CNES #CSA #f9 #Falcon_9 #LZ4 #NASA #SLC4E #SWOT #Thales_Alenia_Space #UKSA #Vandenberg #VSFB

I decided to be weirdly patient: to buy gradually, over the years, all the latest #Hitman titles first, and then play the whole trilogy under Hitman 3's mechanics. Finally got them all! This will be an epic playthrough. Probably would keep me busy until I finally have to upgrade to the newest gen of #Xbox. I gotta say, the ability to play all three games under one engine is amasing! Pretty cool what they did with the #LZ4 compression, too: the entire download was only about 75 GB 🏆

I decided to be weirdly patient: to buy gradually, over the years, all the latest #Hitman titles first, and then play the whole trilogy under Hitman 3's mechanics. Finally got them all! This will be an epic playthrough. Probably would keep me busy until I finally have to upgrade to the newest gen of #Xbox. I gotta say, the ability to play all three games under one engine is amasing! Pretty cool what they did with the #LZ4 compression, too: the entire download was only about 75 GB 🏆

My conclusion after all this is that I'll probably use #zstd level 1 (not the default level 3!) for #compression of my #CSV measurement data from now on:

- ultra fast compression and decompression, on par with #lz4
- nearly as good a compression ratio as #gzip level 9
- negligible RAM usage

When I need ultra small files though, e.g. for transfer over a slow connection, I'll keep using #xz level 9.

Repeated the #compression #benchmark with the same file on a beefier machine (AMD Ryzen 9 5950X), results are quite identical, except faster overall.

This plot is also interesting:

- #gzip and #lz4 have fixed (!) and very low RAM usage across levels and compression/decompression
- #xz RAM usage scales with the level from a couple of MBs (0) to nearly a GB (9)
- #zstd RAM usage scales weirdly with level but not as extreme as #xz

#Python #matplotlib

First let's look only at the non-fancy options (no --fast or multithreading) and make log-log plots to better see what's happening in the 'clumps' of points. Points of interest for me:

- #gzip has a *really* low memory footprint across all compression levels
- #zstd clearly wins the decompression speed/compression ratio compromise!
- #xz at higher levels is unrivalled in compression ratio
- #lz4 higher levels aren't worth it. #lz4 is also just fast.

⏱️ Compression vs Decompression speed. Interesting that #zstd has some settings that actually decompress slower than they compress. Might just be my machine, though... #xz is still a turtle 🐢, #gzip is not much better, #lz4 decompresses much faster than is compressed, #zstd again has something for everybody.

Cool behaviour, #lz4! Refusing to compress a file when redirecting STDOUT but *still* deleting the input file when having --rm specified. What could go wrong? Surely the user has a backup of the input file! 😌