Davide Mambelli

About me

I am a second-year Ph.D. Student at the Sequential Decision Making Group at Delft University of Technology under the joint supervision of Prof. Frans Oliehoek and Prof. Matthijs Spaan. I am also a member of the Mercury Machine Learning Lab, through which I am affiliated with Booking.com where I am a Machine Learning Scientist II, and I work under the supervision of Dr. Onno Zoeter.

I have obtained my MSc in Robotics, Systems, and Control from ETH Zurich (2021) with Prof. Emilio Frazzoli as tutor, and previously I graduated with a double degree in Automation Engineering from the University of Bologna (2018) and Tongji University (2019). During my Master’s degree, I have also spent time at the Empirical Inference Department of Max Planck Institute for Intelligent Systems (Tübingen) where I worked with Frederik Träuble under the supervision of Prof. Bernhard Schölkopf, Prof. Stefan Bauer and Dr. Francesco Locatello, and at Amazon (Berlin) where I worked with Dr. Sebastian Höfer.

My research interests are causality and sequential decision-making. My current area of research is counterfactual learning, where I am focusing on off-policy reinforcement learning.

Publications

• When Do Off-Policy and On-Policy Policy Gradient Methods Align?
  Davide Mambelli, Stephan Bongers, Onno Zoeter, Matthijs T.J. Spaan, Frans A. Oliehoek
  Preprint, 2024
  [PDF]
• Compositional Multi-object Reinforcement Learning with Linear Relation Networks
  Davide Mambelli^*, Frederik Träuble^*, Stefan Bauer, Bernhard Schölkopf, Francesco Locatello
  Workshop on the Elements of Reasoning: Objects, Structure and Causality @ ICLR 2022.
  [PDF]

Teaching

• CS3000 Bachelor Research Project (21-22, 22-23)
• CS4375 (prev. IN4010) Artificial Intelligence Techniques (21-22, 22-23, 23-24)
• CS4210-B Intelligent Decision Making Project (22-23)

Talks

• ELLIS Doctoral Symposium 2023 (Poster)
• Science And Analytics Conference 2023 @ Booking.com (Oral Presentation, selected 24/110)
• ELLIS Meetup Delft (October 2022, Poster)
• ELLIS Doctoral Symposium 2022 (Poster)

Organizations

• Mentee @ Lead The Future (Sept. 2020 - Present)

Powered by Jekyll and Minimal Light theme.