Do you want to define what quality means for AI inference systems running at global scale?
Are you passionate about building test automation that validates the correctness and performance of AI workloads?
Join the Akamai Inference Cloud Team!
The Akamai Inference Cloud team is part of Akamai's Cloud Technology Group. We build AI platforms for running inference models and creating applications. The Inference Execution & Runtimes team owns the core inference engine and runtime frameworks, model serving infrastructure, and execution environment processing every request. Our work determines the latency, throughput, and efficiency of AI workloads across Akamai's global infrastructure.
Partner with the best
This role on the Inference Execution & Runtimes team, focuses on quality strategies for the inference runtime stack. Responsibilities involve developing automated testing frameworks to verify model serving accuracy, efficiency, and reliability across diverse architectures and hardware setups. Success requires proficiency in AI inference systems combined with advanced skills in test automation and quality engineering.
As a Senior Software Development Engineer in Test, you will be responsible for:
Designing and implementing automated test frameworks that validate inference runtime correctness, including model output accuracy, tokenization fidelity, and request handling behavior.
Building performance and load testing infrastructure that benchmarks inference latency, throughput, and GPU utilization across model configurations.
Developing regression and integration test suites that ensure runtime stability as new model architectures and serving backends are introduced.
Collaborating with software engineers to define testability requirements, improve code coverage, and identify quality risks across the inference stack.
Contributing to CI/CD quality gates and release validation processes that ensure runtime components meet production readiness standards.
Do what you love
To be successful in this role you will
- Have a deep expertise in MySQL database design, development, and administration, including schema design, indexing, partitioning, and replication
- Demonstrate proficiency in test automation frameworks with experience designing and maintaining large-scale test suites.
- Show experience with performance testing and benchmarking tools, with the ability to design load tests for high-throughput systems.
- Have familiarity with AI/ML concepts including model inference, tokenization, and the basics of how models are served in production.
- Demonstrate proficiency in at least one programming language used in test automation.
- Show experience with CI/CD pipelines, containerized test environments, and cloud-based testing infrastructure.
- Demonstrate analytical skills with the ability to identify patterns in test results and translate findings into actionable quality improvements.
About us
At Akamai, we make life better for billions of people, trillions of times a day.
Whether you're streaming live events, scrolling social media, watching your favorite series, or managing your savings, we're the engine behind the scenes. We provide the world's most distributed platform from Cloud to Edge to help the giants of the digital world work faster and stay more secure, making the internet a better experience for everyone.
Our focus is simple
- Cloud and Edge: Running apps closer to users for instant performance.
- Security: Neutralizing threats before they ever reach your data.
- Content Delivery: Scaling the world's biggest moments without a glitch.
- AI: Enabling our customers to build, secure, and scale AI apps on the world's most distributed cloud platform.
- At Akamai, we don't just support the internet; we power and protect it, because behind every great digital experience is a massive hidden challenge. And we're the ones who solve it. When millions of people hit play or pay, Akamai ensures it just works.
- Benefits at Akamai: We support your health, well-being, finances, and life beyond work. See our benefits.
- FlexBase adapts to your job's needs
- Akamai's FlexBase program is yet another way we show our commitment to providing employees with an exceptional workplace experience. It's not about telling employees where to work; it's about supporting employees to do their best work.
- We trust our incredible employees to work in ways that suit them best: at home, in an office, or a combination of both.
- Connect with us on social and see what life at Akamai is like!
Job description provided by Akamai.
View the original posting