What You'll Do
Roles and Responsibility
- Possesses 2-4 years of hands-on experience in data engineering particularly in Snowflake,
Python, AWS and SQL.
- Experience in using Snowflake features like snowpipe, streams, tasks stored procedures.
Implement and optimize Snowpark applications using Python. Experience in Design, develop,
and maintain data pipelines using Snowflake's native capabilities.
- Should have hands-on knowledge of AWS services like - S3, Glue, Crawler, Step Function,
Athena, Lambda, SNS, EC2, IAM, KMS.
- Ability to write complex SQL queries and stored procedures, optimize query performance and
implement best practices. Exposure in Design and implementation of dimensional data
models.
- Experience in Building & maintaining ETL/ELT pipelines, Integrate various data sources into
- Snowflake especially from AWS. Should have the ability to Implement data quality checks and
- validation procedures. Hands-on experience in monitor & optimize data pipeline
- performance, troubleshooting data loading and processing issues.
- Should have a solid understanding of BI/DW, ETL, big data, cloud, data security & protection.
- Develop code considering established controls, policies, recommended strategies for
development work.
- Understand basic data management process designs, models, and architectures by engaging
in requirement analysis, testing, debugging, documentation, quality review.
- Follow established project execution processes, coding standard and industry best practices.
- Get actively involved in Training, self-development & knowledge sharing, Contribute actively
to organization-level cloud initiatives.
- Problem solver with analytical thinking and ability to apply root cause analysis.
- Can easily adapt between working independently or collaboratively with a team.
Who You Are
Education: Graduate - Bachelor's degree (any stream)
Skills set
- 2-4 years of experience in being a data engineer with a proven track record.
Must have Skills
- Extensive experience with Snowflake native features like streams, tasks, stored procedures,
snowpipe and data sharing, AWS services: S3, Glue, Crawler, Lambda, SNS, EC2, IAM and KMS,
Python Hands on & expertise in SQL.
- Proficiency in CI/CD Pipelines in GitHub.
- Ability to deliver the work timely with minimum help from senior member’s involvement.
Good to have Skills
- Hands on experience/Familiarity with one/more of the following technologies: Database, Data
- Visualization (Power BI), Scripting, ETL (Informatica PowerCenter). Nice to have AWS Cloud certification.
- We are looking for a dynamic Data Engineer who is self-driven, takes ownership of their work, and is
- committed to develop high-quality, scalable data solutions. If you are ready for continuous learning and
- improvement with hands-on execution of data engineering tasks, in a dynamic environment, we’d love to
- hear from you!
Job description provided by Principal Financial Group.
View the original posting