Reliable data ingestion
Design a pipeline that combines an initial batch load with incremental updates. Explain how you would handle duplicate events, late data, failures and processing costs.
The Data Engineer role covers change data capture, incremental loads and event-driven processing, with responsibility for reliability and cost efficiency.
Source posting