AIME · @aime
27 followers · 40 posts · Server techhub.social

A performance comparison of the new with the well established 1.

The benchmarks cover different areas of , such as image classification () and language models ().

aime.info/blog/en/pytorch-2-gp

#pytorch2 #pytorch #deeplearning #resnet #BERT

Last updated 2 years ago

AIME · @aime
27 followers · 40 posts · Server techhub.social

A performance comparison of the new with the well established 1.

The benchmarks cover different areas of , such as image classification () and language models ().

#pytorch2 #pytorch #deeplearning #resnet #BERT

Last updated 2 years ago

Scalable Analyses · @scalable
2 followers · 67 posts · Server fosstodon.org

Our lab will offer the two classes High Performance Computing and Efficient Machine Learning in the upcoming semester. New topics include BF16 support in SVE, recent features of PyTorch 2 and inference on mobile devices: scalable.uni-jena.de/teaching/

#fsujena #hpc #ml #bfloat16 #SVE #arm #Graviton3 #pytorch2 #quantization #snapdragon

Last updated 2 years ago

Martin Kodovský · @nitrram
5 followers · 5 posts · Server techhub.social

Got on within up and running. So far just recipe tested, but seems to run faster whilst CPU decoding.

Building it was not that easy though. First, I experienced troubles while linking against glibc, but it was due to switching back and forth to conda environment, because I needed gcc 11.1 (my Fedora 36 has gcc 12+, and it has issues preprocessing some templates among the pytorch dependencies). Moreover, I needed linkage to the system's , which was present at a conda repository

I was too lazy to find the way through, exporting correct variables and/or setting correct paths here and there. So I decided to first build custom gcc 11.1 and eventually pytorch.

I visited ftp.gnu.org/gnu/gcc/gcc-11.1.0, but then I struggled once again. Now it was compiling gcc itself. Even then I had very little patience finding the true reason, but was lucky enough to find a patch enabling succesful compilation of the gcc: reviews.llvm.org/D129471

#speechbrain #pytorch2 #python311 #cuda12

Last updated 2 years ago