fbpx

Join Us!

Help us build the next big ideas in today's cloud computing industry

Senior Data Engineer

Washington DC · Full-time · Senior

About The Position

Spotinst’s Senior Data Engineer will be responsible for designing, expanding and optimizing our data infrastructure architecture. Our Data Engineer will work closely with our software developers and data analysts to provide creative solutions for data-related problems.

Responsibilities:

  • Work in a fast-paced agile environment
  • Building efficient storage for structured and unstructured data
  • Developing and deploying distributed computing Big Data applications using Frameworks like Apache Spark, Presto, Apex, Kafka on AWS Cloud using EMR and/or Amazon Athena
  • Utilizing programming languages like Java, Scala, Python, and Cloud-based services such as Athena and Glue
  • Leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of working code utilizing tools like Jenkins, Maven, Terraform, Git, BitBucket and Docker
  • Performing unit tests and conducting reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
  • Write, design, code, test, implement, debug, and validate applications; document design decisions and develop modular software components; monitor system performance metrics, and identify potential risks/issues
  • Collaborate in agile scrum team with product owners and fellow software engineers to deliver upon most important business and technical priorities
  • Provide active mentorship/guidance to fellow members of the agile tech team and participate in internal and external technology conference & communities


Requirements

  • BA/ MA Degree or equivalent work experience
  • 3+ years of work experience in data warehousing and analytics
  • At least 3 years of ETL design, development, and implementation experience
  • 2+ years of Python development experience
  • 2+ years of experience with the Hadoop Stack
  • At least 2+ years of experience with Cloud computing (AWS)
  • 4+ years' experience with SQL (PostgreSQL, Presto, Athena, Redshift)
  • 4+ years of UNIX/Linux experience

Apply for this position