fbpx

Magnetic Significantly Increase EC2 Spot Usage through Spotinst

Magnetic’s EC2 Spot Implementation Restricted by Time Consuming Processes and Hadoop Complexities

 

“Spotinst isn’t just a vendor to us, they’re a partner we know we can work with.”

– James Marcus, VP of Technical Operations

Posted on Magnetic.com, Magnetic sought to migrate 90% of workloads to EC2 Spot within a year, while 30% of their workloads were already running on EC2 Spot, the more complex systems, like their Hadoop clusters, were more difficult to migrate.

Unlike spot media, using spot servers – at the scale Magnetic does – is a huge technical undertaking. That’s why we enlisted a partner like Spotinst to help us get up and running ASAP.

– James Marcus, VP of Technical Operations

Accelerating time to market

Spotinst helped Magnetic achieve its goal of 90% Spot Instance usage in a matter of months (vs. its original 12-month goal) by:

  • Simplifying migration
    With Spotinst, migration to Spot Instances took mere hours vs. upwards of 6+ months for certain environments
  • Providing Stateful application support
    Allowing Stateful applications to run on Spot Instances, with the ability to maintain private IP addresses and reattach data volumes across instances.

This drastic reduction in implementation time meant Magnetic could start saving money quicker. The company’s existing Spot Instance strategy proved very profitable, enabling them to achieve over $1 million in savings over the past 12 months. With Spotinst’s help, Magnetic expects to save an additional $1 million per year.

 

With Spotinst Elastigroup, instead of managing several groups of different instance types and sizes to achieve reliable replication on Hadoop, Elastigroup can run one group that mixes On-Demand, Reserved, and stateful Spot Instances. All simultaneously optimized for cost and performance.

Customer Support Gives Magnetic Complete Confidence in Spotinst

Customer support and experience is important to Magnetic. “There’s a problem in the industry. Many technical vendors fail to listen to customers and have a proper discussion with them,” said James. This is not true with Spotinst.

Over the course of Magnetic’s PoC with Spotinst, the Magnetic team submitted 15 feature requests so they could get the most out of the Spotinst platform. All feature requests were completed within 10 days, allowing Magnetic to increase savings while strengthening their confidence in the Spotinst team.

“We’ve worked with a handful of vendors who have actually listened and truly responded to customer needs. Spotinst is definitely one of those vendors,” James added.  “Spotinst has helped Magnetic remove financial risk by enabling increased Spot Instance utilization. We can reduce our long-term commitments, which releases cash-flow and generates significant cost savings”