Data Warehouse and ETL
Developer
Role Summary
- The Data Warehouse and
- ETL Developer is responsible for the architecture, development, and maintenance
- of the enterprise data warehouse. This role focuses on building
- high-performance data pipelines using Talend, optimizing MS SQL Server
- environments, and ensuring seamless data flow between QAD (ERP) and Salesforce
- (CRM) using Open Query and API-driven integrations.
Key Technical
Responsibilities
Data Warehousing &
Modeling
- Warehouse Architecture: Design
- and maintain scalable data warehouse structures (Star and Snowflake
- schemas) to support company-wide analytics.
- SQL Development: Write and
- optimize advanced T-SQL, including complex window functions and CTEs, to
- transform raw ERP data into actionable insights.
- Database Optimization: Manage
- indexing, partitioning, and execution plan analysis to ensure the data
- warehouse performs efficiently as data volume grows.
- Legacy Connectivity: Expertly
- utilize Open Query to extract data from Progress-based QAD/Mfg./Pro
- environments into SQL Server.
ETL & Integration
Development
- Talend Pipelines: Design,
- develop, and deploy Talend ETL jobs to automate the extraction,
- transformation, and loading of data from disparate sources.
- System Synchronization: Build
- and monitor critical integrations between QAD and Salesforce, ensuring
- customer, order, and inventory data remains synchronized.
- API Integration: Develop Talend
- workflows that utilize REST/SOAP APIs to push and pull data from
- cloud-based platforms like Salesforce.
- Error Handling: Implement
- robust logging and alerting frameworks within Talend to proactively
- identify and resolve data discrepancies.
Data Governance &
Quality
- Data Cleansing: Develop
- automated scripts to identify and correct "dirty" data, ensuring
- high-quality inputs for Power BI dashboards.
- Documentation: Maintain
- detailed data lineage documentation, mapping source-to-target
- transformations for compliance and audit purposes.
- Expertise and Attributes
- Core Stack: 5–7 years of
- experience with MS SQL Server and Talend (Open Studio or Data Management
- Platform).
- ERP/CRM Expertise: Strong
- functional understanding of QAD (Mfg /Pro) and Salesforce objects/tables.
- Technical: High proficiency in
- T-SQL, Open Query, Linked Servers, and JSON/XML data parsing.
- Environment: Experience working
- in a Medical Device or manufacturing environment is highly preferred.
- Problem Solving: Ability to
- troubleshoot complex data bottlenecks in a fast-paced, production-critical
- environment.
Education and Experience
- Bachelor’s degree in computer
- science, Data Science, or Information Technology.
- 5–7 years of dedicated
- experience in ETL development and Data Warehousing.
Job description provided by Devoir Software Solutions.
View the original posting