John Goerzen · @jgoerzen
1026 followers · 2847 posts · Server floss.social

3/ Dar's homepage is dar.linux.free.fr/ . As a simple file archiver tool, dar is great. Random access is preserved, you can compress with or . You can encrypt with or symmetric . You can stream if you want. You can split ("slice") across multiple media, and dar will prompt you for the slice(s) you need and seek you right to them.

That's cool, but we're just getting started.

#dar #gzip #bzip2 #lzo #xz #zstd #lz4 #GnuPG #aes

Last updated 1 year ago

Jason · @jason
100 followers · 562 posts · Server toots.dgplug.org

Loved listening to this episode

From Project Management to Data Compression Innovator
With Yann Collet
corecursive.com/data-compressi

#corecursive #yanncollet #life #tech #compressionalgorithms #lz4

Last updated 1 year ago

Markus Osterhoff · @sci_photos
235 followers · 3309 posts · Server troet.cafe

Ein anderes Programm (nennen wir es kleinhirn) hat sinnvollere Werte angezeigt. Aber das erste (nennen wir es zeiger) soll zählen, die Werte an das grosshirn senden, wo SPEC die Zahlen dann abholt für die Justage.

Die Daten kommen als -komprimierte -Strom; zeiger entpackt und zählt, schreibt anschließend den originalen lz4-Blob in die Datei; kleinhirn auf einem anderen Rechner öffnet die Datei, zählt auch und zeigt das Bild an.

#hdf5 #lz4

Last updated 1 year ago

Dominic DeWolfe · @dewolfe
17 followers · 16 posts · Server fosstodon.org

🎧 I just listened to an inspiring episode of the CoRecursive podcast about Yann Collet, who taught himself compression algorithms and created LZ4 as a hobby. I really enjoyed his story. Check it out and explore other episodes as well, it's a great podcast: podcasts.apple.com/ca/podcast/

#yanncollet #lz4 #zstandard #datacompression #Corecursive

Last updated 1 year ago

NASASpaceFlight Tracker · @nsf_tracker
1 followers · 161 posts · Server beratna.net

SpaceX Transporter-7 to launch 51 payloads, return booster to LZ
nasaspaceflight.com/2023/04/sp

SpaceX is preparing to launch for the 24th time this year with the Transporter-7 rideshare… The post SpaceX Transporter-7 to launch 51 payloads, return booster to LZ appeared first on NASASpaceFlight.com .

#commercial #featured #spacex #uncrewed #f9 #falcon_9 #lz4 #rideshare #rtls #slc4e #transporter #vandenberg #vsfb

Last updated 2 years ago

NASASpaceFlight Tracker · @nsf_tracker
1 followers · 39 posts · Server beratna.net

SpaceX launches EROS-C3 observation satellite from Vandenberg
nasaspaceflight.com/2022/12/er

SpaceX has launched its 61st and final mission of 2022, this one aboard a Falcon… The post SpaceX launches EROS-C3 observation satellite from Vandenberg appeared first on NASASpaceFlight.com .

#commercial #featured #international #spacex #uncrewed #eros #f9 #falcon_9 #israel #lz4 #rtls #slc4e #vandenberg #vsfb

Last updated 2 years ago

NASASpaceFlight Tracker · @nsf_tracker
1 followers · 38 posts · Server beratna.net

SpaceX to launch EROS-C3 observation satellite from Vandenberg
nasaspaceflight.com/2022/12/er

SpaceX is set to launch its 61st and final mission of 2022, this one aboard… The post SpaceX to launch EROS-C3 observation satellite from Vandenberg appeared first on NASASpaceFlight.com .

#commercial #featured #international #spacex #uncrewed #eros #f9 #falcon_9 #israel #lz4 #rtls #slc4e #vandenberg #vsfb

Last updated 2 years ago

NASASpaceFlight Tracker · @nsf_tracker
1 followers · 25 posts · Server beratna.net

SpaceX launches SWOT ocean research mission
nasaspaceflight.com/2022/12/fa

SpaceX’s Falcon 9 launched the joint NASA/CNES Surface Water and Ocean Topography satellite mission from… The post SpaceX launches SWOT ocean research mission appeared first on NASASpaceFlight.com .

#european #featured #international #spacex #uncrewed #cnes #csa #f9 #falcon_9 #lz4 #nasa #slc4e #swot #thales_alenia_space #uksa #vandenberg #vsfb

Last updated 2 years ago

NASASpaceFlight Tracker · @nsf_tracker
1 followers · 19 posts · Server beratna.net

SpaceX launches SWOT ocean research mission
nasaspaceflight.com/2022/12/fa

SpaceX’s Falcon 9 launched the joint NASA/CNES Surface Water and Ocean Topography satellite mission from… The post SpaceX launches SWOT ocean research mission appeared first on NASASpaceFlight.com .

#european #featured #international #spacex #uncrewed #cnes #csa #f9 #falcon_9 #lz4 #nasa #slc4e #swot #thales_alenia_space #uksa #vandenberg #vsfb

Last updated 2 years ago

NASASpaceFlight Tracker · @nsf_tracker
1 followers · 17 posts · Server beratna.net

SpaceX Falcon 9 to launch SWOT ocean research mission
nasaspaceflight.com/2022/12/fa

SpaceX is preparing for its next Falcon 9 mission from Space Launch Complex 4E at… The post SpaceX Falcon 9 to launch SWOT ocean research mission appeared first on NASASpaceFlight.com .

#european #featured #international #spacex #uncrewed #cnes #csa #f9 #falcon_9 #lz4 #nasa #slc4e #swot #thales_alenia_space #uksa #vandenberg #vsfb

Last updated 2 years ago

Petar Toushkov · @cellfourteen
111 followers · 328 posts · Server mastodon.social

I decided to be weirdly patient: to buy gradually, over the years, all the latest titles first, and then play the whole trilogy under Hitman 3's mechanics. Finally got them all! This will be an epic playthrough. Probably would keep me busy until I finally have to upgrade to the newest gen of . I gotta say, the ability to play all three games under one engine is amasing! Pretty cool what they did with the compression, too: the entire download was only about 75 GB 🏆

#hitman #xbox #lz4

Last updated 2 years ago

Petar Toushkov · @cellfourteen
141 followers · 584 posts · Server mastodon.social

I decided to be weirdly patient: to buy gradually, over the years, all the latest titles first, and then play the whole trilogy under Hitman 3's mechanics. Finally got them all! This will be an epic playthrough. Probably would keep me busy until I finally have to upgrade to the newest gen of . I gotta say, the ability to play all three games under one engine is amasing! Pretty cool what they did with the compression, too: the entire download was only about 75 GB 🏆

#hitman #xbox #lz4

Last updated 2 years ago

Yann :python: · @nobodyinperson
86 followers · 316 posts · Server fosstodon.org

My conclusion after all this is that I'll probably use level 1 (not the default level 3!) for of my measurement data from now on:

- ultra fast compression and decompression, on par with
- nearly as good a compression ratio as level 9
- negligible RAM usage

When I need ultra small files though, e.g. for transfer over a slow connection, I'll keep using level 9.

#zstd #compression #csv #lz4 #gzip #xz

Last updated 2 years ago

Yann :python: · @nobodyinperson
86 followers · 316 posts · Server fosstodon.org

Repeated the with the same file on a beefier machine (AMD Ryzen 9 5950X), results are quite identical, except faster overall.

This plot is also interesting:

- and have fixed (!) and very low RAM usage across levels and compression/decompression
- RAM usage scales with the level from a couple of MBs (0) to nearly a GB (9)
- RAM usage scales weirdly with level but not as extreme as

#compression #benchmark #gzip #lz4 #xz #zstd #python #matplotlib

Last updated 2 years ago

Yann :python: · @nobodyinperson
86 followers · 316 posts · Server fosstodon.org

First let's look only at the non-fancy options (no --fast or multithreading) and make log-log plots to better see what's happening in the 'clumps' of points. Points of interest for me:

- has a *really* low memory footprint across all compression levels
- clearly wins the decompression speed/compression ratio compromise!
- at higher levels is unrivalled in compression ratio
- higher levels aren't worth it. is also just fast.

#gzip #zstd #xz #lz4

Last updated 2 years ago

Yann :python: · @nobodyinperson
86 followers · 316 posts · Server fosstodon.org

⏱️ Compression vs Decompression speed. Interesting that has some settings that actually decompress slower than they compress. Might just be my machine, though... is still a turtle 🐢, is not much better, decompresses much faster than is compressed, again has something for everybody.

#zstd #xz #gzip #lz4

Last updated 2 years ago

Yann :python: · @nobodyinperson
86 followers · 316 posts · Server fosstodon.org

Cool behaviour, ! Refusing to compress a file when redirecting STDOUT but *still* deleting the input file when having --rm specified. What could go wrong? Surely the user has a backup of the input file! 😌

#lz4

Last updated 2 years ago