fbpx

Spotinst Elastigroup & High Performance Computing

Achieve The Most Efficient HPC Cluster on Earth

Boost your HPC performance while reducing costs by 80%

Elastigroup integrates with HPC Schedulers to acquire the best possible mix of compute in the cloud

High-Performance Computing (HPC) allows scientists and engineers to solve complex, compute-intensive problems. HPC applications often require high network performance, fast storage, large amounts of memory, very high compute capabilities or all of these.

Spotinst enables customers to increase the speed of research and reduce time-to-results by running or bursting HPC to the cloud. Spotinst helps to reduce infrastructure costs by up to 80% less using  CPU, GPU, and FPGA servers from cloud excess capacity (aka “Spot Instances”),  and reducing the overhead of managing the infrastructure, saving scientists and engineers time to focus on what’s next.

Spotinst Elastigroup sits between the HPC Scheduler and your compute grid

Spotinst Elastigroup deploys a controller (agent) that monitors HPC schedulers’ queues. You can configure Elastigroup to monitor specific Job’s Queue, and Elastigroup finds jobs that are pending for execution, it calculates the number of resources that these jobs need and launches the required compute to run these jobs.

 

 

Spotinst Elastigroup Gets Smarter

As you submit Jobs and Tasks Elastigroup is learning what resources the tasks need and how long they will take. Elastigroup uses this information to densely pack tasks, without oversubscribing, to ensure fast and cost-effective runs. By combining task awareness (time & resources) with Spot Instances prediction of price & availability, Elastigroup schedules tasks where they won’t be interrupted.

 

Simple to use

Simplify management & orchestration using Elastigroup – both provisioning & autoscaling of Cloud infrastructure

Spot Instance Lifecycle Management

Elasitgroup uses its proven prediction algorithm to match Spot Instances that can run for the desired amount of time for the required Task or job.

Mixed Instance Types

By configuring heterogeneous clusters and mixing nodes of multiple instance types, Elastigroup delivers maximum efficiency to run the relevant job on the right machine type to achieve greater data processing performance.

Customer Spotlight

Demandbase

"We are running multiple of our production workloads on Spotinst Elastigroup, across containers, Big Data and web services"
Michael Waltz | Principal DevOps Engineer, Demandbase

Optimizing for both Pricing Model and Instance Type&Size

Elastigroup automates the Instance lifecycle and provides a combination of EC2 Spot, Existing RI reservations and On-Demand based on EC2 Spot capacity, availability & pricing trends

 

Mixed Instance Types

By configuring heterogeneous clusters and mixing nodes of multiple instance types, Elastigroup delivers maximum efficiency to run the relevant job on the right machine type to achieve greater data processing performance.

The World's Leader in management of Spot Instances

Elastigroup balances the required performance, cost, and SLA requirements when launching, scaling and terminating EC2 Spot Instances. By combining Elastigroup’s proven prediction algorithm for EC2 Spot availability.

Complete Confidence while running Spot Instances for Production and time-concern jobs

Elastigroup drains nodes, approximately 15 minutes before a Spot termination notification arrives from the cloud provider, in order to gracefully terminate existing Tasks and prevent from scheduling new jobs on these nodes.

Integrated with Leading HPC Platforms

Spotinst Elastigroup Integrates with leading HPC Platforms:

  • Grid Engine & Univa Grid Engine
  • SLURM Workload Manager
  • PBS WORKS
  • IBM LSF – Workload Management
  • IBM Symphony
  • AWS Batch
  • Azure Batch