😤 Do you find #HPC software management challenging [who doesn't]? 🎓Learn from @brian how to use build systems, shared filesystems, user scripts, and package managers to build reproducible, reliable environments for @awscloud #ParallelCluster ⏱️https://www.youtube.com/watch?v=Q1Rdc-77bSc

In this post we show you how to create an #HPC cluster and capture the two-minute warning notifications from Amazon EC2 Spot to execute a checkpoint, reactively. #ParallelCluster @awscloud
https://aws.amazon.com/blogs/hpc/checkpointing-hpc-applications-using-the-spot-instance-two-minute-notification-from-amazon-ec2/

Working in the place place I do, I get used to witnessing and being part of Remarkable Things. But this week we released https://twitter.com/spackpm integrations for #ParallelCluster, and it's one of the more _exceptional_ Remarkable Things we've done lately. To distill it, anyone can now ... 1/4

On #PiDay, let's look back at #AWS #ParallelCluster progress since version 3.14 (5/2022) 🦺 Some features we've added:
☑ODCR support
☑Multi-AZ clusters
☑Slurm accounting
☑Dynamic filesystems
☑Memory-aware scheduling
☑Flexible instance types
👩🏻‍🎓 http://day1hpc.com/parallelcluster

🎁 We didn't bake you a pie today, but we did release @spackpm configs!
📈 Available now for @awscloud #ParallelCluster, they make it easy to install optimized #HPC apps on @intel @AMD & #Graviton EC2 instances.
💡Learn to use them today: https://aws.amazon.com/blogs/hpc/install-optimized-software-with-spack-configs-for-aws-parallelcluster/ #Spack

Today, we’re announcing the availability of @spackpm configs for @awscloud #ParallelCluster. You can use these configurations to install optimized HPC applications quickly and easily on your AWS-powered #HPC clusters.

https://aws.amazon.com/blogs/hpc/install-optimized-software-with-spack-configs-for-aws-parallelcluster/

🐍 What is the official animal of Pi Day? The pi-thon!
🤖 While we're on the topic, @awscloud #ParallelCluster is a #Python application that helps you design, provision, and manage elastic #HPC clusters in the cloud.
💡Learn more at https://day1hpc.com/parallelcluster/ #PiDay

🆕🎉 #AWS #ParallelCluster 3.5 is here with a brand new UI!
💻👨‍💼 Simplified #HPC cluster deployment and management
🦾🕰️ Enhanced reliability compute node reboots
👩‍💻🐍 Programmatic access via Python library
🪲💣 Improved error reporting
Learn more: https://aws.amazon.com/about-aws/whats-new/2023/02/aws-parallelcluster-cluster-3-5-new-ui/

Optimize your #HPC workloads with #AWS #ParallelCluster #Slurm-based memory-aware scheduling. Automatically balance memory usage for improved efficiency and reduced wait times 🚀☁️ https://day1hpc.com/post/slurm-based-memory-aware-scheduling-in-aws-parallelcluster-32/

🤖💬 Scaling Large Language Model training is easier than ever with Amazon EC2 TRN1 Ultraclusters and #AWS #ParallelCluster #MachineLearning #LLMtraining https://aws.amazon.com/blogs/machine-learning/scaling-large-language-model-llm-training-with-amazon-ec2-trn1-ultraclusters/ 🧵

Ever tried to manage licenses on an #HPC cluster? How about across clusters (or across sites)? Brian Skjerven has. He showed (in a few minutes) how to pull this off with #AWS #ParallelCluster. https://youtu.be/ayPnYIEaHHQ

Nice post by @yakshavers on Slurm accounting, which adds flexibility, transparency, and control to operating an #HPC cluster on AWS using #AWS #ParallelCluster! Version 3.3.0 can now automatically configure #Slurm accounting whether you are using your own database or Amazon #Aurora.

https://aws.amazon.com/blogs/hpc/leveraging-slurm-accounting-in-aws-parallelcluster/

🚨Release Alert: #AWS #ParallelCluster 3.4.1 is out today on PyPi. It fixes an issue with #Slurm where nodes could become inaccessible or backed by the wrong #EC2 instance type 🐛 #HPC https://pypi.org/project/aws-parallelcluster/

🐞An issue is affecting some #AWS #ParallelCluster 3.3.0/3.4.0 users where compute node names and IPs are out of sync after scaling. While we are preparing a patch release, there is a temporary workaround you can apply. See this Wiki link for details: https://github.com/aws/aws-parallelcluster/wiki/(3.3.0-3.4.0)-Slurm-cluster-NodeName-and-NodeAddr-mismatch-after-cluster-scaling

Announcing #AWS #ParallelCluster 3.4:
🚀Create #HPC clusters across >1 Availability Zones
☁️Control VPC config for cluster Lambdas
⚙️Set up custom actions for cluster updates
🔐Securely mount #EFS filesystems
🪪Use custom AWS IAM prefixes
Learn more: https://aws.amazon.com/about-aws/whats-new/2022/12/aws-parallelcluster-3-4-multi-az-support/

Announcing #AWS #ParallelCluster version 3.4:
🚀Create #HPC clusters across >1 Availability Zones
☁️Control VPC configuration for cluster Lambdas
⚙️Set up custom actions for cluster updates
🔐Securely mount #EFS filesystems
🪪Use custom AWS IAM prefixes
Learn more: https://aws.amazon.com/about-aws/whats-new/2022/12/aws-parallelcluster-3-4-multi-az-support/

Announcing #AWS #ParallelCluster version 3.4:
🚀Create #HPC clusters across >1 Availability Zones
☁️Control VPC configuration for cluster Lambdas
⚙️Set up custom actions for cluster updates
🔐Securely mount #EFS filesystems
🪪Use custom AWS IAM prefixes
Learn more: https://aws.amazon.com/about-aws/whats-new/2022/12/aws-parallelcluster-3-4-multi-az-support/

With #AWS #ParallelCluster 3.3.0, you can now easily take advantage of #EC2 On-Demand Capacity Reservations (ODCRs) to ensure your jobs have the capacity they need when they need it. This post describes how to implement it.

https://aws.amazon.com/blogs/hpc/aws-parallelcluster-3-3-now-supports-on-demand-capacity-reservations/

RT @chris_dag
Excited to test the new #AWS #Parallelcluster support for Slurm job accounting database for first time. Fingers crossed ...

Job accounting is essential for lifeSci workloads & this used to be my #1 post-HPC-deploy activity. Nice to see pcluster devs chopping at my 'todo' list!

Nice closing chapter in @werner's keynote - "Simulate everything". #ParallelCluster can help you get started with that today! #reInvent #NowGoBuild https://day1hpc.com/parallelcluster/