DevOps Engineer II - DataBricks

The Company

CommerceIQ is building the AI platform that runs commerce for the world's largest brands. We are not selling AI demos. We are shipping AI agents for content, media, and sales into the workflows of the Fortune 100 every week.

2,200+

Customers

10 of Top 12

CPG Companies

900+

Retailers Connected

$200M+

Raised

Customers include Coca-Cola, Nestlé, Colgate-Palmolive, Mondelez, Samsung, and Kellogg's. Backed by SoftBank, Insight Partners, and Madrona. Headquartered in Mountain View with teams across the US, India, Canada, and the UK. Pre-IPO.

DevOps Engineer II

About the Role

We are looking for a DevOps Engineer II with strong hands-on experience in Databricks, databases, Kubernetes, and AWS.

Key Responsibilities

Databricks

• Manage and maintain Databricks infrastructure and production workloads.
• Manage clusters, jobs, compute resources, configurations, permissions, and integrations.
• Monitor Databricks workloads and troubleshoot performance and reliability issues.
• Drive Databricks cost optimization through cluster sizing, autoscaling, job optimization, scheduling, and resource utilization.
• Establish best practices around Databricks governance, security, access management, and operational efficiency.

Database & Data Infrastructure

• Strong hands-on experience managing databases in production environments.
• Perform database maintenance, monitoring, troubleshooting, performance tuning, backup/recovery, and capacity management.
• Work with databases such as PostgreSQL, MySQL, Aurora, Redis, or similar technologies.
• Troubleshoot database performance, connectivity, storage, replication, and availability issues.
• Identify opportunities for database cost and performance optimization.

AWS & Cloud Infrastructure

• Hands-on experience with AWS infrastructure and services, including EKS, EC2, RDS/Aurora, S3, IAM, CloudWatch, VPC, ECR, and related services.
• Manage and maintain production AWS infrastructure with a strong focus on reliability, security, scalability, and cost optimization.
• Troubleshoot complex infrastructure and networking issues.

Kubernetes & DevOps

• Strong hands-on experience with Kubernetes, preferably AWS EKS.
• Experience with deployments, troubleshooting, scaling, networking, workloads, ingress, storage, and cluster maintenance.
• Experience with Helm, ArgoCD, Terraform, GitHub Actions/Bitbucket Pipelines, or similar DevOps tools.
• Build and maintain CI/CD pipelines and automate repetitive operational tasks.
• Implement Infrastructure as Code and follow best practices for infrastructure provisioning and management.

Monitoring & Reliability

• Experience with monitoring and observability tools such as Prometheus, Grafana, CloudWatch, OpenTelemetry, or similar.
• Build dashboards, alerts, and operational metrics for production systems.
• Participate in incident management, root-cause analysis, and reliability improvements.
• Ensure production systems meet availability, performance, and operational requirements.

Required Skills

4–7+ years of DevOps / Cloud / Infrastructure experience

Strong hands-on experience with Databricks

Strong experience with AWS

Strong hands-on experience with Kubernetes / EKS

Strong database administration and troubleshooting experience

Terraform / Infrastructure as Code

CI/CD and Git-based workflows

Helm and GitOps tools such as ArgoCD

Monitoring and observability

Strong Linux and networking fundamentals

Strong troubleshooting and problem-solving skills

Experience working with production environments at scale

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability status or any other category prohibited by applicable law.