Kavi Global Technology/Software

Assistant Manager - Data Engineer

Chennai, India In person Full-time

Assistant Manager

  • Data Engineer

We are looking for an experienced

  • Data Engineer to design, build, and maintain scalable data pipelines and
  • infrastructure that power analytics, reporting, and machine learning
  • initiatives across the organization. The ideal candidate has a strong foundation
  • in data modeling, distributed systems, and cloud-based data platforms, with a
  • track record of delivering reliable, high-performance data solutions.

Key Responsibilities

  • ●Design, build, and optimize scalable
  • ETL/ELT pipelines to ingest, transform, and load data from diverse sources
  • (databases, APIs, streaming platforms, third-party systems)
  • ●Develop and maintain data
  • warehouse/data lake architectures, ensuring data quality, consistency, and
  • reliability
  • ●Collaborate with data scientists,
  • analysts, and product teams to understand data requirements and deliver
  • well-structured, accessible datasets
  • ●Build and maintain batch and
  • real-time streaming data pipelines using tools like Apache Spark, Kafka, or

Airflow

  • ●Implement data quality checks,
  • monitoring, and alerting to ensure pipeline reliability and data integrity
  • ●Optimize database and query
  • performance for large-scale datasets
  • ●Design and maintain data models
  • (conceptual, logical, physical) and schemas that support analytics and
  • application needs
  • ●Work with cloud platforms
  • (AWS/Azure/GCP) to manage data infrastructure, storage, and compute resources
  • ●Implement and enforce data
  • governance, security, and compliance best practices
  • ●Participate in code reviews, CI/CD
  • pipeline development, and infrastructure-as-code practices
  • ●Document data pipelines,
  • architecture, and processes for team knowledge sharing
  • ●Troubleshoot and resolve production
  • data pipeline issues in a timely manner

Required Skills &

  • ●Bachelor's degree in Computer
  • Science, Engineering, or a related field
  • ●4–6 years of hands-on experience as a
  • Data Engineer or in a similar role
  • ●Strong programming skills in Python
  • and/or Scala; solid SQL expertise
  • ●Experience with ETL/ELT tools and
  • orchestration frameworks (Apache Airflow, dbt, Luigi, or similar)
  • ●Hands-on experience with big data
  • technologies (Apache Spark, Hadoop, Kafka)
  • ●Proficiency with relational databases
  • (PostgreSQL, MySQL, SQL Server) and NoSQL databases (MongoDB, Cassandra,

DynamoDB)

  • ●Experience working with cloud data
  • platforms and services (AWS Redshift/Glue/S3, Azure Data Factory/Synapse, GCP BigQuery/Dataflow)
  • ●Solid understanding of data modeling
  • concepts — entity relationships, cardinality, normalization, and dimensional
  • modeling (star/snowflake schemas)
  • ●Experience with data warehousing
  • solutions (Snowflake, Redshift, BigQuery, Databricks)
  • ●Familiarity with version control
  • (Git) and CI/CD practices
  • ●Understanding of data governance,
  • security, and privacy best practices (GDPR, data masking, access controls)
  • ●Strong problem-solving skills and
  • ability to work with large, complex datasets
  • ●

Job description provided by Kavi Global.
View the original posting