Control Red Team - Research Engineer/Research Scientist - Job Hub - Epelcon Global: Long Life and Prosperity for All.

Job Description

<div class="content-intro"><h2>About the AI Security Institute</h2> The AI Security Institute is the world's largest and best-funded team dedicated to understanding advanced AI risks and translating that knowledge into action. We’re in the heart of the UK government with direct lines to No. 10 (the Prime Minister's office), and we work with frontier developers and governments globally. We’re here because governments are critical for advanced AI going well, and UK AISI is uniquely positioned to mobilise them. With our resources, unique agility and international influence, this is the best place to shape both AI development and government action.</div><h2>The deadline for applying to this role is 30th September 2026, end of day, anywhere on Earth. </h2> <h2>Team Description</h2> Control measures — monitors, permission systems, sandboxing, resampling, escalation protocols — are designed to detect and prevent misaligned behaviour from advanced AI systems. Though the measures are already critical to safety, whether they would in fact catch a capable model attempting to cause harm is an empirical question that remains largely untested.   The Control Red Team at AISI is stress-testing control monitors (<a href="https://www.aisi.gov.uk/blog/how-our-new-control-red-team-is-stress-testing-frontier-monitors">including from GDM and Anthropic</a>) – finding attacks that beat monitors and attempting to design experiments to measure real-world risk. We’re based within the Red Team, about a dozen people who have spent the last two years breaking developer’s alignment and misuse safeguards, and grew out of <a href="https://www.aisi.gov.uk/research?category_equal=%5B%22Control%22%5D">AISI’s previous research into control evaluations and safety cases.</a>  We're opening roles on the Control Red Team, and we think it's an unusually good place to do this work. You'd join early, with real ownership over the team's direction; you'd have frontier model access, serious compute and strong infrastructure support from across AISI; and you'd get privileged insight into control measures across several frontier developers, working alongside some of the most experienced red teamers in the field.  Our current bet is to focus our effort on monitoring: the measures frontier companies lean on most heavily, and the ones where the science of evaluation is not yet settled.   <h2>About the Role</h2> <h2>What You'll Be Doing</h2> You’ll spend your time across two tracks of work:   1. Research: How and what should we measure to understand the efficacy of control measures?   How can we gather empirical evidence about how likely a monitor is to prevent harm — and what can we legitimately conclude from it? How do you estimate a monitor's recall against dangerous behaviours nobody has seen yet? These are difficult questions – conceptually and empirically. Day to day this looks like: designing and running ML experiments (including RL and other optimisation-heavy work), building the adversarial attacks that generate the evidence, writing arguments, and arguing them out with the rest of the team. We intend to publish this work.  2. Testing: Running evaluations of frontier labs' monitors, and reporting the implications.  Turning our research into concrete assessments of real systems: threat modelling how an AI attacker would actually operate in a frontier internal deployment; breaking monitors, sandboxes and the surrounding infrastructure; conducting security analyses; and producing reports that are decision-relevant and action-guiding for the companies and for government.  Underpinning both: <ul> <li data-leveltext="•" data-font="Arial" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"multilevel"}" data-aria-posinset="1" data-aria-level="1">Building tooling and experimental pipelines that let us go from question to result fast, at a quality bar that makes the results reusable. </li> </ul> <ul> <li data-leveltext="•" data-font="Arial" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"multilevel"}" data-aria-posinset="2" data-aria-level="1">Heavy use of LLMs to automate our own attack, evaluation and analysis loops — and getting faster as models improve. </li> </ul> <ul> <li data-leveltext="•" data-font="Arial" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"multilevel"}" data-aria-posinset="3" data-aria-level="1">Building and running the infrastructure for training and serving models at the scale our experiments need. </li> </ul> <h2>Research Scientists and Research Engineers </h2> We're looking for research science and engineering skills, and we're excited to hear from strong scientists, strong engineers, and people who are a bit of both.  We’re deliberately open on seniority. For exceptional candidates, with experience leading research teams, we’ll grow the scope to match.  <h2>What We're Looking For </h2> The experiences listed are examples of the expertise we're looking for, rather than a list of everything we expect to find in one applicant.  <h2>Essential Requirements</h2> <ul> <li>Demonstrated ability to design, build and run ML experiments on frontier models, and to work autonomously on complex research projects involving substantial engineering. This includes black-box work (API-based evaluations and attacks) and ideally some white-box work (e.g. fine-tuning open-weight models). </li> <li>Strong software engineering and ML experience: writing clean, documented, reusable code for machine learning experiments — beyond one-off research scripts — including experience with LLM finetuning and inference frameworks, or evaluation frameworks like Inspect.  </li> <li>The ability to understand and critique how an experiment does and does not support a safety claim – including an understanding of why AI safety and control are hard problems, or a clear appetite to get up to speed fast. </li> <li>Impact-driven mindset and a collaborative team player: motivated by the work that most re

Skills Required

Red Team

Job Details

Salary: Negotiable

Type: Full time

Mode: On site

Views: 3

Applications: 0

Members Only