Senior Site Reliability Engineer

Peraton Overview

Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace.

The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can’t be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we’re keeping people around the world safe and secure.

Responsibilities

Peraton Labs hiring for a Senior Site Reliability Engineer

Own the reliability of our enterprise application end-to-end: define and enforce SLOs and error budgets, build the dashboards and alerting that tell us how the system is actually behaving, and write production code in our Python and Rust services to make them observable, self-checking, and resilient. This is an engineering role first. You’ll spend real time in the application codebase, not just around it.

Job Responsibilities

• Own end-to-end reliability of the enterprise application; define SLIs/SLOs with product and engineering, enforce error-budget policy, and use burn rates to guide release and prioritization decisions.
• Write, review, and ship production Python and Rust code to fix performance, concurrency, and failure-handling issues and make services observable and resilient.
• Instrument services with metrics, structured logging, and distributed tracing (OpenTelemetry or equivalent).
• Own monitoring and alerting (CloudWatch, Prometheus/Grafana): build low-noise, SLO-based burn-rate alerts, manage alert routing and on-call hygiene, and design service, SLO, and executive dashboards.
• Build in-application health checks and synthetic user-journey tests that exercise real auth flows and critical transactions.
• Lead incident response, run blameless postmortems, and drive corrective actions to closure.
• Operate Amazon EKS/Kubernetes (Helm, RBAC, pod identity, GitOps, upgrades) and core AWS services, managed through OpenTofu/Terraform.
• Maintain GitHub Actions/GitLab CI pipelines with reliability and performance gates, supporting trunk-based, MR-driven Agile delivery and progressive (canary/blue-green) rollouts.
• Enforce secrets management and least privilege, and produce audit evidence for NIST 800-171, CMMC, FedRAMP, or DoD/ATO environments.
• Drive load testing, capacity planning, and chaos engineering, and mentor engineers on reliability practices.

Required Qualifications

Bachelor’s Degree and 8+ years in SRE, platform, or software engineering roles with production reliability ownership

Strong software engineering in Python; Rust experience strongly preferred. Comfortable reading, debugging, and shipping changes to production application code, including performance, concurrency, and failure-handling fixes. Working effectively in unfamiliar codebases, including with AI-assisted development tools, counts. Judgment and code review rigor matter more than language tenure.

SLOs and error budgets. Defining SLIs with product and engineering, setting SLO targets, running error-budget policy, and using burn rates to drive release and prioritization decisions

Monitoring and alerting ownership. CloudWatch, Prometheus/Grafana, or equivalent; building actionable, low-noise alerts tied to SLOs and multi-window burn rates; owning alert routing and on-call hygiene

Designing service, SLO, and executive-level dashboards in Grafana or equivalent that answer real operational questions

Application instrumentation. Adding metrics, structured logging, and distributed tracing (OpenTelemetry or equivalent) directly in Python and Rust services

Synthetic and transactional health checks. Building health-check capabilities into the application and scripted user-journey checks (CloudWatch Synthetics, Grafana k6, Checkly, or equivalent) that exercise real auth flows and critical transactions

Incident management. Leading incident response, running blameless postmortems, and driving corrective actions to closure

Strong Amazon EKS / Kubernetes operations background: Helm, RBAC, pod identity, GitOps, upgrades, troubleshooting

Solid AWS experience across core services (VPC, IAM, S3, RDS, CloudTrail, CloudWatch, KMS)

CI/CD experience in GitHub Actions and/or GitLab CI, including reliability and performance gates in pipeline

Infrastructure-as-code (OpenTofu / Terraform)

• Agile delivery: trunk-based development, MR-driven change, automated quality gates
• Security and compliance awareness: secrets management, least privilege, audit evidence, ideally in NIST 800-171, CMMC, FedRAMP, or DoD environments
• US Citizenchip is required

Desired Qualifications

• Production Rust experience (async/Tokio, FFI with Python via PyO3, or similar)
• Load and performance testing (k6, Locust, or equivalent) and capacity planning
• Chaos engineering and fault-injection testing
• Progressive delivery (canary/blue-green with automated rollback on SLO or health-check failure)
• Experience with Big Bang (Platform One), IronBank, or hardened-image pipelines
• Prior work on systems pursuing or holding an ATO
• Contributions to observability tooling or Rust/Python open-source projects

Target Salary Range

$104,000 - $166,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual’s experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.

Benefits Statement

Peraton offers eligible employees a variety of benefits including medical, dental, vision, life, health savings account, short/long term disability, EAP, parental leave, 401(k), paid time off (PTO) for vacation, and company paid holidays. A full listing of available benefits can be viewed at https://www.careers.peraton.com/benefits.

Application Statements

The application period for the job is estimated to be 30 days from the job posting date. However, this timeline may be shortened or extended depending on business needs and the availability of qualified candidates. By applying to this job, you are expressing interest in the role and the Company. During the review of your application, you may be required to participate in an on-camera interview, as well as participate in a process to verify your identity. Use of artificial intelligence (AI) tools of any kind during Peraton interviews is strictly prohibited unless the candidate has obtained prior written authorization. All interview responses must be the candidate’s own.

EEO

EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.