Current Work
- Neurosymbolic robot control
- Robots typically run hand-engineered controllers that struggle in situations their designers didn’t anticipate. I’m developing methods that refine existing controllers, such as behaviour trees, with learned adaptations. The robot improves from experience while keeping an explicit decision structure that engineers can inspect and formally verify.
- Logic gate network optimization
- Logic gate networks are compact models that run very efficiently on hardware, but improving a trained circuit is hard because useful changes often couple a connection and a gate function. I’m developing a discrete optimization method that makes these joint edits practical to evaluate, with efficient approximations for when exhaustive scoring is expensive.
- Implicit bias in reinforcement learning
- When many policies are equally good under the training objective, the optimizer’s implicit preferences determine which one is learned, and with it how the policy generalizes. I’m developing theory that characterizes this implicit bias for policy-gradient methods.