Job Title: Data Platform Engineer (Infrastructure & Data Engineering)
Purpose
Support the design, build, and operation of the Data Platform, blending infrastructure engineering with data engineering practices to keep the Databricks/Azure environment reliable, automated, and self-service for platform users.
Key Responsibilities
- Design and maintain CI/CD pipelines (DevOps/GitHub Actions) for infrastructure and application deployments
- Write and maintain Terraform IaC for Azure services and Azure Databricks (Unity Catalog, workspaces, networking, compute policies)
- Develop and support application code in Python and/or .NET for platform tooling and automation
- Build and maintain shared libraries/modules used by data engineers and analysts across the platform
- Design and implement pipelines/processes that support platform management (cost tracking, governance, provisioning, monitoring)
- Collaborate with data engineers, analysts, and security/infra teams to translate requirements into platform capabilities
- Troubleshoot infrastructure, pipeline, and integration issues (networking, auth, connectivity)
- Contribute to platform documentation and best-practice standards
Required Skills & Experience
- Solid experience with Microsoft Azure infrastructure (Entra ID, Key Vault, networking, storage)
- Hands-on Azure Databricks experience (Unity Catalog, cluster/job management)
- Terraform (IaC) experience, ideally in a multi-environment setup
- Proficiency in Python; working knowledge of SQL; .NET is a plus
- Experience building/maintaining CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)
- Understanding of data platform governance and cost management concepts
- Comfortable working across the infra/data engineering boundary
- Nice to Have
Experience with medallion architecture (Bronze/Silver/Gold)
Exposure to FinOps/cost attribution practices
Job Title: Data Platform Engineer (Infrastructure & Data Engineering)
Purpose
Support the design, build, and operation of the Data Platform, blending infrastructure engineering with data engineering practices to keep the Databricks/Azure environment reliable, automated, and self-service for platform users.
Key Responsibilities
- Design and maintain CI/CD pipelines (DevOps/GitHub Actions) for infrastructure and application deployments
- Write and maintain Terraform IaC for Azure services and Azure Databricks (Unity Catalog, workspaces, networking, compute policies)
- Develop and support application code in Python and/or .NET for platform tooling and automation
- Build and maintain shared libraries/modules used by data engineers and analysts across the platform
- Design and implement pipelines/processes that support platform management (cost tracking, governance, provisioning, monitoring)
- Collaborate with data engineers, analysts, and security/infra teams to translate requirements into platform capabilities
- Troubleshoot infrastructure, pipeline, and integration issues (networking, auth, connectivity)
- Contribute to platform documentation and best-practice standards
Required Skills & Experience
- Solid experience with Microsoft Azure infrastructure (Entra ID, Key Vault, networking, storage)
- Hands-on Azure Databricks experience (Unity Catalog, cluster/job management)
- Terraform (IaC) experience, ideally in a multi-environment setup
- Proficiency in Python; working knowledge of SQL; .NET is a plus
- Experience building/maintaining CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)
- Understanding of data platform governance and cost management concepts
- Comfortable working across the infra/data engineering boundary
- Nice to Have
Experience with medallion architecture (Bronze/Silver/Gold)
Exposure to FinOps/cost attribution practices
Job Title: Data Platform Engineer (Infrastructure & Data Engineering)
Purpose
Support the design, build, and operation of the Data Platform, blending infrastructure engineering with data engineering practices to keep the Databricks/Azure environment reliable, automated, and self-service for platform users.
Key Responsibilities
- Design and maintain CI/CD pipelines (DevOps/GitHub Actions) for infrastructure and application deployments
- Write and maintain Terraform IaC for Azure services and Azure Databricks (Unity Catalog, workspaces, networking, compute policies)
- Develop and support application code in Python and/or .NET for platform tooling and automation
- Build and maintain shared libraries/modules used by data engineers and analysts across the platform
- Design and implement pipelines/processes that support platform management (cost tracking, governance, provisioning, monitoring)
- Collaborate with data engineers, analysts, and security/infra teams to translate requirements into platform capabilities
- Troubleshoot infrastructure, pipeline, and integration issues (networking, auth, connectivity)
- Contribute to platform documentation and best-practice standards
Required Skills & Experience
- Solid experience with Microsoft Azure infrastructure (Entra ID, Key Vault, networking, storage)
- Hands-on Azure Databricks experience (Unity Catalog, cluster/job management)
- Terraform (IaC) experience, ideally in a multi-environment setup
- Proficiency in Python; working knowledge of SQL; .NET is a plus
- Experience building/maintaining CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)
- Understanding of data platform governance and cost management concepts
- Comfortable working across the infra/data engineering boundary
- Nice to Have
Experience with medallion architecture (Bronze/Silver/Gold)
Exposure to FinOps/cost attribution practices
Job description provided by Zensar.
View the original posting
