About the opportunity:We’re looking for a Sr. Data Analyst to join our team in India. This role is responsible for designing, developing, and supporting enterprise data engineering solutions using Microsoft Fabric. Responsibilities: Design, develop, enhance, and maintain Microsoft Fabric Data Pipelines for extracting and loading data from enterprise source systems. Build integrations with JDE, Oracle, SQL Server, and other relational data platforms to ingest data into Microsoft Fabric.
Develop and maintain PySpark notebooks for data processing and transformation within the Fabric Lakehouse, primarily supporting Bronze-to-Silver processing. Develop advanced SQL queries, views, stored procedures, and transformation logic within Fabric Warehouse to support Silver-to-Gold data processing. Implement incremental loading, change-data processing, historical loads, and other appropriate ingestion patterns based on source-system requirements.
Design and maintain data structures in the Fabric Lakehouse and Warehouse that support enterprise analytics and downstream Power BI semantic models. Monitor scheduled data pipelines and data loads, troubleshoot failures, identify root causes, and implement permanent solutions for recurring issues. Perform data validation and reconciliation between source systems and Fabric to ensure completeness, accuracy, and consistency.
Optimize PySpark, SQL, stored procedures, pipelines, and warehouse processes for performance and scalability. Maintain existing production data pipelines and enhance them as business and technical requirements evolve. Collaborate with analysts, Power BI developers, application teams, and business stakeholders to understand data requirements and deliver trusted data for reporting and analytics. Apply data governance, security, access control, naming, and development standards across Fabric solutions.
Maintain technical documentation for data pipelines, notebooks, data transformations, source-to-target mappings, dependencies, and operational support procedures Location:Remote What we’re offering A competitive salary, vacation, health & dental benefits and employer-matched pension plan. You’ll have opportunities to learn, grow, and collaborate with professionals on a global reach. Whether you’re working with the leading minds in the industry on high-profile projects, with internal teams to support continuous improvement, or with our customers to inspire and delight—your contributions will make a difference.
The experience and skills we value: BE/B.Tech/Diploma in Computer Science/Data Engineering 8-10 years’ experience of relevant experience Knowledge of the organization’s JDE data structures, business processes, and system integrations, including how data from JDE, Oracle, SQL Server, and other enterprise applications is used across business functions. What will put you ahead: Strong proficiency in SQL, including complex queries, joins, performance tuning, stored procedures, and data transformation.
Hands-on experience with Microsoft Fabric, including Data Pipelines, Lakehouse, Warehouse, notebooks, and data integration capabilities. Proficiency in PySpark for large-scale data processing, cleansing, transformation, and movement across Bronze and Silver data layers. Experience designing and supporting ETL/ELT data pipelines integrating data from JDE, Oracle, SQL Server, and other enterprise data sources. Strong understanding of data lake, data warehouse, dimensional modeling, and Medallion architecture (Bronze/Silver/Gold) concepts.
Ability to troubleshoot pipeline failures, data quality issues, SQL performance problems, and source-system integration issues. Experience with data reconciliation and validation techniques to ensure completeness and accuracy between source and target systems. Working knowledge of Power BI and semantic models to understand how engineered data is consumed by downstream analytics and reporting solutions
Job description provided by Christie Digital Systems.
View the original posting
