The D. E. Shaw group seeks an experienced HPC storage engineer to join its Quant Systems team. Quant Systems is a global group responsible for designing, building, and operating the firm's largest and most critical compute infrastructure—operating system platforms, high-performance computing environments, software development tooling, networking, and large-scale storage systems that support quantitative research and trading.
The team works in a collaborative environment, integrating advanced technologies to meet demanding performance, reliability, and scalability requirements. What you’ll do day-to-day Design, deploy, and operate petabyte-scale parallel filesystems (including GPFS) that back the firm's quantitative research and trading workloads, owning capacity planning, tiering across NVMe and spinning media, and end-to-end data path performance.
Research, benchmark, and productionize new storage technologies—from next-generation parallel filesystems and object stores to emerging hardware—running structured evaluations and migrating workloads once a technology is proven. Keep storage platforms highly available and performant under heavy, bursty HPC I/O by defining SLOs, tuning filesystem and network parameters, and building observability so regressions are caught early.
Lead incident response and root-cause analysis for complex production issues, using diagnostic and tracing tools to isolate problems across storage, Linux, and networking layers, and driving durable fixes back into the platform. Support the firm's global infrastructure across Red Hat and Ubuntu fleets, partnering with regional teams on rollouts, upgrades, and 24/7 on-call coverage for critical storage services. Contribute to broader Quant Systems initiatives by automating provisioning and operations with Puppet and scripting, collaborating with quant researchers on their I/O patterns, and writing the runbooks and documentation that let the team scale.
What we’re looking for Bachelor's or master's in computer science or a related field, with an exceptional foundation in algorithms, data structures, and object-oriented programming. At least five years of experience in programming or scripting. Robust expertise in Linux systems and solid knowledge of networking fundamentals. Hands-on experience with HPC storage filesystems, preferably GPFS. Proven experience designing and implementing high-performance, reliable, and secure infrastructure systems end-to-end.
Excellent troubleshooting skills, including experience with diagnostic and tracing tools. Experience with Red Hat and Ubuntu Linux distributions. Familiarity with configuration management tools such as Puppet. Excellent communication, organizational, and time-management abilities.
Job description provided by D. E. Shaw & Co..
View the original posting
