Spark performance tuning
Prepare an example of how you optimised a large-scale data processing job through partitioning, join strategies and memory management.
The Senior Data Engineer role requires optimizing large-scale data processing through partitioning, query optimization and memory management.
Source posting