Skip to content

Research

Reinforcement Learning & Decision Systems

Decision policies that adapt to changing conditions, reward design, training in simulation and safe transfer to the field.

Reinforcement Learning & Decision Systems

What we work on

  1. 01Reward design and detecting reward hacking
  2. 02Training in simulation and transferring to the field; closing the sim-to-real gap
  3. 03Decision policies that operate alongside language models
  4. 04Safe exploration: preventing the system from making an irreversible mistake while learning
  5. 05How success is measured across multi-step decisions, and catching policy regressions

Why we work in this area

In some problems the right answer is not fixed: the other side changes its behaviour too. A static rule set, or a classifier trained once, becomes predictable in that setting, and what is predictable gets circumvented.

Reinforcement learning answers this class of problem, but brings difficulties of its own: when the reward is designed wrongly, the system optimises the reward rather than the thing you wanted. That is why the weight of our work sits on reward design and safe exploration.

From our research projects

Both of our funded projects in this area come from the same idea: a protection strategy becomes predictable once it stays fixed. Our software protection and threat detection systems each update their strategy through reinforcement learning according to the situation they encounter.