Member of Technical Staff (Site Reliability Engineer, Crawler)
Perplexity · On-site · Full-time · London
Posted (3d ago)
- Employer posted
- First seen here
- Repost check
- Same job ID since we first saw it on Nov 13, 2026. If Perplexity reposts it, we keep the original posting date.
- Level
- Staff+
- Work setup
- On-site
- Tech mentioned
- Kubernetes, Python, C++, Rust, Terraform, Linux
- Perplexity hiring
- 13 roles posted in the last 30 days
Job description
Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.
Responsibilities
- Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
- Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
- Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
- Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
- Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
- Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Qualifications
- 5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
- Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
- Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.
- Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
- Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
Nice to have
- Experience operating web crawlers, search infrastructure, or browser fleets at scale.
- Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.
Perplexity job ID: 190962f1-a955-4690-8025-6943dcbf063c
More Perplexity jobs
Member of Technical Staff (AI Software Engineer, Agent Engine)
Perplexity · San Francisco · Staff+ · On-siteMember of Technical Staff (Software Engineer, Cybersecurity Products)
Perplexity · San Francisco · Staff+ · On-siteMember of Technical Staff (Software Engineer, AI Policy and Strategic Initiatives)
Perplexity · San Francisco · Staff+ · On-siteMember of Technical Staff (Site Reliability Engineer, Cloud Infrastructure)
Perplexity · San Francisco · Staff+ · On-siteMember of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Perplexity · San Francisco · Staff+ · On-siteMember of Technical Staff (Software Engineer, Training Infrastructure)
Perplexity · San Francisco · Staff+ · On-siteMember of Technical Staff (Software Engineer, Fraud Prevention)
Perplexity · London · Staff+ · RemoteMember of Technical Staff, (Software Engineer, Experience)
Perplexity · San Francisco · Staff+ · On-site
We are not Perplexity. The hiring company owns this listing. Reposts of the same requisition id are not shown as new.
All new jobs · Companies we watch · How dates work · Report an error