Altera Corporation Technology/Software

Agentic AI Architect

San Jose, CA In person Full-time

Location: San Jose, California, United States

Job Details

We are seeking an Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA/ASIC platforms.

This role sits at the intersection of

Large Language Models (LLMs)

Agent frameworks & autonomous systems

Retrieval-Augmented Generation (RAG)

Hardware-aware AI system design (FPGA / ASIC / EDA)

You will define architecture, drive technical strategy, and build scalable AI systems that bridge software intelligence and hardware acceleration.

Key Responsibilities

AI Architecture & System Design

  • Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration
  • Architect RAG pipelines for enterprise-scale knowledge integration
  • Define end-to-end AI system architecture from data ingestion → reasoning → action

Agentic AI & LLM Development

Develop advanced workflows using

  • tool-using agents
  • planning & reasoning agents
  • multi-agent collaboration frameworks
  • Evaluate and integrate leading LLMs (open-source and proprietary)
  • Optimize prompt engineering, memory, and reasoning capabilities

Hardware-Aware AI Optimization

Co-design AI systems with

  • FPGA acceleration
  • ASIC platforms
  • heterogeneous compute (CPU/GPU/FPGA)
  • Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)
  • Collaborate with hardware teams on EDA and system integration

Framework & Platform Development

Build internal platforms using

LangChain

LlamaIndex

custom agent orchestration framework

Develop reusable components for

  • memory management
  • tool integration
  • knowledge retrieval

Technical Leadership

  • Lead architecture reviews and guide engineering teams
  • Mentor senior engineers and influence cross-functional teams
  • Drive innovation in AI + hardware convergence

What Makes This Role Unique

Opportunity to define agentic AI architecture for hardware-driven systems

Work at the convergence of

  • AI reasoning systems
  • FPGA acceleration
  • next-generation computing platforms
  • High-impact role influencing future AI + semiconductor integration

Impact

  • You will help shape how AI agents interact with hardware, enabling:
  • intelligent system orchestration
  • real-time decision-making pipelines
  • scalable AI deployment on FPGA platforms

Summary

This role is ideal for a senior technical leader who can:

bridge LLM + Agentic AI + RAG with FPGA/ASIC system architecture

and drive innovation in next-generation AI systems.

The pay range below is for Bay Area California only. Actual salary may vary based on a number of factors including job location, job-related knowledge, skills, experiences, trainings, etc. We also offer incentive opportunities that reward employees based on individual and company performance.

$149.1K - $238.2K USD

We use artificial intelligence to screen, assess, or select applicants for the position. Applicants must be eligible for any required U.S. export authorizations.

Qualifications

  • Master’s or Bachelor’s degree with 10+ years of experience in one or more of the following:
  • AI/ML systems
  • Distributed systems
  • Hardware–software co-design
  • Recognized expertise in AI/ Large Language Models (LLMs)

Deep understanding of

  • LLM architectures and inference
  • RAG systems and vector databases
  • Agentic AI / autonomous agents

Hands-on experience building

  • Production-grade LLM applications
  • Multi-step reasoning and orchestration workflows
  • Scalable and reliable AI systems in production

Strong background in

FPGA / ASIC / EDA systems

Heterogeneous computing architectures

Familiarity with

Hardware acceleration for AI workloads

Performance optimization across system stack

Technical Skills

Programming

Python

C++ (preferred)

Experience with

  • Distributed systems design
  • APIs and microservices architecture
  • Cloud and/or edge AI deployment

Hands-on experience with

  • LLM fine-tuning, quantization, and model distillation
  • On-device / edge AI deployment
  • Robotics, autonomous systems, or real-time AI pipelines

Knowledge of

Compiler stacks (e.g., MLIR, TVM)

AI model optimization for FPGA platforms

Job Type

Regular

Shift

Shift 1 (United States of America)

Primary Location

San Jose, California, United States

Additional Locations

Posting Statement

All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Job description provided by Altera Corporation.
View the original posting