Impact Research 

Evals Lead, AI Red Teaming

Trajectory Labs
Not specifiedRemote

Build and maintain evaluation pipelines for AI red-teaming data; review submissions, automate quality checks and assess robustness.

About the job

About Trajectory

Our mission is to automate AI safety, to pave the way for a future where the vast majority of AI safety work is done by AI models.

To that end, we build safety and alignment evals, red-teaming programs, and RL environments for frontier AI labs. Our areas of focus include red teaming, control, anti-distillation, AI safety reasoning, and embedded assessments.

Although Trajectory is only a year old, we have already been featured in Anthropic's Claude Opus 5.5 System Card (the only commercial red team to jailbreak its cyber safeguards) and Google DeepMind's Gemini 4 Argon Safety & Security Report, led Anthropic's prompt injection evaluation of Auto mode, and been featured in Meta's Muse Spark Safety & Preparedness Report.

Overview

You'll build the evaluation pipeline that checks attacks found through our prompt injection red-teaming, and you’ll decide which attacks ship to frontier lab customers.

This is a senior individual-contributor role. You'll mostly be directing agents rather than managing people, and you'll split your time between reviewing evals, designing new ones, and building the agent tooling that scales your own judgment.

We're an early-stage startup, so you should expect and enjoy that your responsibilities will grow and priorities change quickly.

About the role

Frontier labs use our data to make their models robust to prompt injection. That only works if the data are right: a subtly broken task or a wrong grade teaches the model the wrong lesson.

You'll:

  • Hold the quality bar. Review tasks, transcripts, and red-teamer submissions, and decide what ships to frontier lab customers.

  • Automate your own judgment. Turn your review patterns into agent skills and pipeline automation.

  • Figure out what to test next. Study why models succeed and why they fail, then pick task types and attack methods to find new failures.

  • Improve how we work. Build evals for our internal agentic pipelines to help us scale rapidly while maintaining our quality bar.

You'll work closely with our founders and the teams developing frontier models, with unusual autonomy to make consequential decisions. The work you review shapes system cards, deployment safeguards, and how much the world can trust the most capable AI systems.

Your primary focus will be in our AI Red Teaming workstream. However, we build evals across several areas, and your responsibilities may expand over time.

What we're looking for

Essential

  • Calibrated eval judgment: you can tell when a task, transcript, grade, or environment is subtly wrong, and explain the evidence behind your call.

  • Agent-native engineering: you use LLMs and coding agents as core tools, and you can independently automate your own workflows. You have at least 2 years of experience as a software engineer (or equivalent experience).

  • Sustained attention to detail: you hold the same bar on the hundredth review as on the first, and you look for ways to automate the repeatable parts.

  • Early-stage startup drive: you enjoy a fast pace, shifting priorities, limited structure, and taking on whatever will have the biggest impact.

Desirable

  • You’ve built an eval, benchmark, grading pipeline, or quality assurance system. Experience with agentic evals, RL environments, model training data, or LLM judges for rubric-based grading is a plus.

  • Prompt injection, red teaming, or security experience

  • Familiarity with AI safety and the alignment research community

  • Experience collaborating with frontier labs or other demanding technical customers

We encourage you to apply if you think you might be a good fit, even if you’re not sure that you meet all of the requirements.

We’re also hiring for Head of Evals. Apply to whichever role seems like the better fit; we can discuss both during the hiring process.

Logistics

Total compensation: Includes base salary, bonus, and the estimated annualized value of equity. Your level depends on the scope, autonomy, and impact we expect you to have:

  • L4: $350,000

  • L5: $520,000

  • L6: $670,000

  • L7: $900,000

Base salary: $200,000–$400,000 per year.

Location and workspace: Our team works out of Constellation in Berkeley, CA, and we prefer someone who can work alongside us there. We are open to remote for the right candidate.

Benefits:

  • Health coverage: You'll receive a generous monthly pre-tax allowance to choose the medical, dental, and vision coverage that best fits your needs.

  • 401(k): We offer a 401(k) retirement plan with a company match.

  • Food: Catered lunch and dinner, unlimited snacks and drinks.

  • Relocation: A generous moving allowance to relocate to Berkeley.

Visa sponsorship: We sponsor visas, although we cannot successfully sponsor every visa for every role or candidate. If we make you an offer, we will make every reasonable effort to secure the visa you need, with support from an immigration lawyer we retain to guide and coordinate the process.

Reports to: Ben West, CTO.

Qualifications

Relevant engineering and evaluation experience; agent-assisted software development, independent technical judgment and interest in AI safety. Specific essential and desirable qualifications retained in source body.

Additional notes

Source-reported opportunity. Berkeley preferred; body explicitly allows remote for the right candidate, while ATS header says On-site. Both statements preserved; no worldwide eligibility inferred. Base salary $250,000–$400,000/year and total compensation $350K–$900K including bonus/equity, but currency not explicitly named: compensation null, not assumed USD.