Matt Vaughn ⛅️ · @yakshavers
219 followers · 182 posts · Server hachyderm.io

😤 Do you find software management challenging [who doesn't]? 🎓Learn from @brian how to use build systems, shared filesystems, user scripts, and package managers to build reproducible, reliable environments for @awscloud ⏱️youtube.com/watch?v=Q1Rdc-77bS

#hpc #parallelcluster

Last updated 1 year ago

Brendan Bouffler (boof) · @boofla
190 followers · 74 posts · Server mast.hpc.social

In this post we show you how to create an cluster and capture the two-minute warning notifications from Amazon EC2 Spot to execute a checkpoint, reactively. @awscloud
aws.amazon.com/blogs/hpc/check

#hpc #parallelcluster

Last updated 2 years ago

Brendan Bouffler (boof) · @boofla
189 followers · 70 posts · Server mast.hpc.social

Working in the place place I do, I get used to witnessing and being part of Remarkable Things. But this week we released twitter.com/spackpm integrations for , and it's one of the more _exceptional_ Remarkable Things we've done lately. To distill it, anyone can now ... 1/4

#parallelcluster

Last updated 2 years ago

Matt Vaughn ⛅️ · @yakshavers
208 followers · 171 posts · Server hachyderm.io

On , let's look back at progress since version 3.14 (5/2022) 🦺 Some features we've added:
☑ODCR support
☑Multi-AZ clusters
☑Slurm accounting
☑Dynamic filesystems
☑Memory-aware scheduling
☑Flexible instance types
👩🏻‍🎓 day1hpc.com/parallelcluster

#piday #aws #parallelcluster

Last updated 2 years ago

Matt Vaughn ⛅️ · @yakshavers
208 followers · 169 posts · Server hachyderm.io

🎁 We didn't bake you a pie today, but we did release @spackpm configs!
📈 Available now for @awscloud , they make it easy to install optimized apps on @intel @AMD & EC2 instances.
💡Learn to use them today: aws.amazon.com/blogs/hpc/insta

#parallelcluster #hpc #Graviton #spack

Last updated 2 years ago

Brendan Bouffler (boof) · @boofla
189 followers · 69 posts · Server mast.hpc.social

Today, we’re announcing the availability of @spackpm configs for @awscloud . You can use these configurations to install optimized HPC applications quickly and easily on your AWS-powered clusters.

aws.amazon.com/blogs/hpc/insta

#parallelcluster #hpc

Last updated 2 years ago

Matt Vaughn ⛅️ · @yakshavers
208 followers · 168 posts · Server hachyderm.io

🐍 What is the official animal of Pi Day? The pi-thon!
🤖 While we're on the topic, @awscloud is a application that helps you design, provision, and manage elastic clusters in the cloud.
💡Learn more at day1hpc.com/parallelcluster/

#parallelcluster #python #hpc #piday

Last updated 2 years ago

Matt Vaughn ⛅️ · @yakshavers
202 followers · 156 posts · Server hachyderm.io

🆕🎉 3.5 is here with a brand new UI!
💻👨‍💼 Simplified cluster deployment and management
🦾🕰️ Enhanced reliability compute node reboots
👩‍💻🐍 Programmatic access via Python library
🪲💣 Improved error reporting
Learn more: aws.amazon.com/about-aws/whats

#aws #parallelcluster #hpc

Last updated 2 years ago

Matt Vaughn ⛅️ · @yakshavers
202 followers · 154 posts · Server hachyderm.io

Optimize your workloads with -based memory-aware scheduling. Automatically balance memory usage for improved efficiency and reduced wait times 🚀☁️ day1hpc.com/post/slurm-based-m

#hpc #aws #parallelcluster #slurm

Last updated 2 years ago

Matt Vaughn ⛅️ · @yakshavers
202 followers · 154 posts · Server hachyderm.io
Brendan Bouffler (boof) · @boofla
181 followers · 62 posts · Server mast.hpc.social

Ever tried to manage licenses on an cluster? How about across clusters (or across sites)? Brian Skjerven has. He showed (in a few minutes) how to pull this off with . youtu.be/ayPnYIEaHHQ

#hpc #aws #parallelcluster

Last updated 2 years ago

Angel Pizarro · @delagoya
41 followers · 21 posts · Server hachyderm.io

Nice post by @yakshavers on Slurm accounting, which adds flexibility, transparency, and control to operating an cluster on AWS using ! Version 3.3.0 can now automatically configure accounting whether you are using your own database or Amazon .

aws.amazon.com/blogs/hpc/lever

#hpc #aws #parallelcluster #slurm #aurora

Last updated 2 years ago

Matt Vaughn 🎄🕎 · @yakshavers
191 followers · 128 posts · Server hachyderm.io

🚨Release Alert: 3.4.1 is out today on PyPi. It fixes an issue with where nodes could become inaccessible or backed by the wrong instance type 🐛 pypi.org/project/aws-parallelc

#aws #parallelcluster #slurm #ec2 #hpc

Last updated 2 years ago

Matt Vaughn 🎄🕎 · @yakshavers
181 followers · 125 posts · Server hachyderm.io

🐞An issue is affecting some 3.3.0/3.4.0 users where compute node names and IPs are out of sync after scaling. While we are preparing a patch release, there is a temporary workaround you can apply. See this Wiki link for details: github.com/aws/aws-parallelclu

#aws #parallelcluster

Last updated 2 years ago

Matt Vaughn 🎄🕎 · @yakshavers
161 followers · 103 posts · Server hachyderm.io

Announcing 3.4:
🚀Create clusters across >1 Availability Zones
☁️Control VPC config for cluster Lambdas
⚙️Set up custom actions for cluster updates
🔐Securely mount filesystems
🪪Use custom AWS IAM prefixes
Learn more: aws.amazon.com/about-aws/whats

#aws #parallelcluster #hpc #efs

Last updated 2 years ago

Matt Vaughn 🎄🕎 · @yakshavers
161 followers · 102 posts · Server hachyderm.io

Announcing version 3.4:
🚀Create clusters across >1 Availability Zones
☁️Control VPC configuration for cluster Lambdas
⚙️Set up custom actions for cluster updates
🔐Securely mount filesystems
🪪Use custom AWS IAM prefixes
Learn more: aws.amazon.com/about-aws/whats

#aws #parallelcluster #hpc #efs

Last updated 2 years ago

Matt Vaughn 🎄🕎 · @yakshavers
169 followers · 113 posts · Server hachyderm.io

Announcing version 3.4:
🚀Create clusters across >1 Availability Zones
☁️Control VPC configuration for cluster Lambdas
⚙️Set up custom actions for cluster updates
🔐Securely mount filesystems
🪪Use custom AWS IAM prefixes
Learn more: aws.amazon.com/about-aws/whats

#aws #parallelcluster #hpc #efs

Last updated 2 years ago

Brendan Bouffler (boof) · @boofla
122 followers · 15 posts · Server mast.hpc.social

With 3.3.0, you can now easily take advantage of On-Demand Capacity Reservations (ODCRs) to ensure your jobs have the capacity they need when they need it. This post describes how to implement it.

aws.amazon.com/blogs/hpc/aws-p

#aws #parallelcluster #ec2

Last updated 2 years ago

Matt Vaughn 🎄🕎 · @yakshavers
169 followers · 113 posts · Server hachyderm.io

RT @chris_dag
Excited to test the new support for Slurm job accounting database for first time. Fingers crossed ...

Job accounting is essential for lifeSci workloads & this used to be my #1 post-HPC-deploy activity. Nice to see pcluster devs chopping at my 'todo' list!

#aws #parallelcluster

Last updated 2 years ago

Matt Vaughn 🌤 · @yakshavers
80 followers · 39 posts · Server hachyderm.io

Nice closing chapter in @werner's keynote - "Simulate everything". can help you get started with that today! day1hpc.com/parallelcluster/

#parallelcluster #reinvent #nowgobuild

Last updated 2 years ago