Quentin Gallouédec

Quentin Gallouédec

Ph.D. Student in Reinforcement Learning

École Centrale de Lyon



I am a Ph.D. student working on Reinforcement Learning at LIRIS/École Centrale de Lyon, supervised by Associate Prof. Emmanuel Dellandréa. I focus on the design of robust reinforcement learning algorithms, especially for highly sparse reward environments. I am currently exploring efficient exploration with the Go-Explore paradigm and curiosity-based methods. My driving force is my fascination for the intertwining of cognitive science and artificial intelligence. Every day I ask myself this very basic question: how do we learn so much without even realizing it?

Feel free to contact me, I would be happy to share with you my work or anything else.

  • Artificial Intelligence
  • Reinforcement Learning
  • Hard-exploration Learning
  • Robotics Learning


(2024). Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent. arXiv preprint arXiv:2402.09844.

PDF Cite Paper Code Model

(2022). Cell-Free Latent Go-Explore. Proceedings of the 40th International Conference on Machine Learning, PMLR 202:10571-10586, 2023.

PDF Cite Paper Code Poster

(2021). panda-gym: Open-source goal-conditioned environments for robotic learning. Robot Learning Workshop: Self-Supervised and LifelongLearning at NeurIPS.

PDF Cite Paper Talk


École Centrale de Lyon
Nov 2020 – Mar 2020 Lyon, France

Dissertation: Toward the Generalization of Reinforcement Learning.

Supervisor: Associate Prof. Emmanuel Dellandréa

École Centrale de Lyon
Diplôme d’Ingénieur (B.S. and M.S.)
Sep 2016 – Jun 2020 Lyon, France
Majoring in Computer Science
CPE Lyon and Université Claude Bernard Lyon 1
M.S. (Double Degree) in Electronics
CPE Lyon and Université Claude Bernard Lyon 1
Sep 2019 – Jun 2020 Lyon, France

Majoring in Energy, Electricity and Automation, embedded systems.

Dissertation: Mixed-Precision in Graphics Processing Units.

Supervisor: Prof. Ian O’Connor

Lycée Clemenceau
Classe Préparatoire (B.S.)
Lycée Clemenceau
Sep 2014 – Jun 2016 Nantes, France

Equivalent of the first two years of B.S.

Majoring in Math, Physics, Engineering Sciences


Lycée Aux Lazaristes
Mathematics Interrogator
Sep 2019 – Present Lyon, France
For students in classe préparatoire (first two years of B.S.), preparing for the entrance exams to the most prestigious French universities.
Paris Fire Brigade
Research and Development Officer
Aug 2018 – Aug 2019 Paris, France
Machine learning and indoor localization/communication system.
Université de Montréal / Polytechnique
Reasearch intern
May 2018 – Aug 2018 Montréal, Canada

Recent Posts

Reinforcement Learning review #13
Create a beautiful graph with Manim
Reinforcement Learning review #12
Reinforcement Learning review #11
Reinforcement Learning review #10