Apple Technology/Software

Sr Engineering Program Manager, Apple Intelligence Evaluations

Cupertino, CA In person Full-time

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It’s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you’ll do more than join something — you’ll add something.

We’re looking for a Sr Engineering Program Manager with a proven track record of leading highly cross-functional Software and ML initiatives. In this role, you’ll own the evaluation plans for Apple’s foundation models or the AI features built on them, partnering with world-class teams across Research, Engineering, Privacy, and Data Science. You’ll thrive in a fast-moving environment, and your work will ensure that products reaching over 1 billion customers meet the quality bar Apple users expect and love. If you’re excited by a new technology space and by delivering phenomenal products with a great team, we want to hear from you.

Own the evaluation plan for foundation models or AI features, including scope, metrics, timelines and launch-readiness criteria

Partner with product, research, data science and engineering teams to define evaluation requirements, methodologies, and tooling

Drive multiple complex workstreams at once with clear dependencies and critical path. Manage risks, resolve conflicts and keep stakeholders aligned

Manage annotation and data collection operations to deliver high-quality evaluation data on schedule

Partner with engineering, privacy, and legal teams to ensure our data strategy is not only world-class, but also aligns with Apple's core values

Synthesize technical complexity into clear, actionable communications for executive leadership

Bachelor's or Master's degree in EE, CS, CE, or equivalent

5+ years of experience managing large-scale, ML-powered and software programs across large organizations

Proven program management, analytical, and cross-functional leadership skills, with experience driving data-driven decision-making and process improvements

Excellent written and verbal communication skills, including presentation, negotiation, and the ability to communicate abstract ideas clearly

Strong problem-solving skills with attention to details

Direct program management experience with Generative AI or Large Language Models (LLMs) is highly desired

Familiarity with LLM evaluation practices

Experience analyzing product data to assess quality and identify opportunities.

Experience shipping AI features in a consumer product

Comfortable in a fast-paced, ambiguous environment, with curiosity and the ability to quickly learn new technical concepts

Solid understanding of how ML systems are built, evaluated and released

Job description provided by Apple.
View the original posting