Sr. DevOps Engineer with AI/ML Background

My client is searching for a Senior DevOps Engineer that will design, implement, and maintain secure, performant, and scalable infrastructure that powers APIs, web applications, AI/ML pipelines, and high-throughput data processing systems. This individual will work closely with software engineers, AI/ML teams, and product groups to automate deployments, improve system reliability, and optimize operational processes.

Responsibilities:

• Architect, build, and maintain infrastructure for APIs, SaaS applications, AI/ML workloads, and large-scale data pipelines.
• Design queueing systems, extraction jobs, and cloud-native services to handle high-throughput, real-time data.
• Collaborate with developers and data scientists to bring AI/ML models and applications into production.

• Implement and enhance CI/CD pipelines, automated testing, and release processes to ensure code quality and rapid iteration.
• Define and track SLOs/SLIs, using error budgets to guide operational improvements.
• Improve observability through automated monitoring, logging, and tracing for both traditional and ML-driven systems.
• Participate in and lead incident response, root cause analysis, and postmortems.

• Ensure all infrastructure meets security and compliance standards such as SOC 2 and ISO 27001.
• Apply security best practices across cloud, container, and AI/ML environments.

Mandatory Requirements:

• 5 - 8 years of experience in DevOps, SRE, platform engineering, or similar roles.
• 5 years of AWS experience
• 5 years of Terraform experience
• 5 years of experience using Python or Bash
• Solid understanding of networking concepts, distributed systems, and troubleshooting methodologies.
• Experience with release automation and observability tooling (Grafana, Prometheus, OpenTelemetry), and CI/CD best practices.
• 4 years of experience deploying and supporting AI/ML pipelines, models, or platforms.

Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.