and part-time musician
Computer Science B.Sc. from the DIRO
at Université de Montréal.
Computer Science Masters from the McGill SoCS
under the supervision of
and Doina Precup
. My thesis
was on conditional computation.
Currently PhD student at the Reasoning and Learning Lab
under the supervision of Joelle Pineau
and Doina Precup
I'm mainly interested in Machine Learning
, especially Deep Learning
and Reinforcement Learning
and mixing both, compiler
design and implementation, programming
as a topic.
Reach me on gmail, my username is bengioe
Here is my curriculum vitae
, my google scholar
Research & Writings
A Closer Look at Memorization in Deep Networks
Devansh Arpit, Stanisław Jastrzębski, Nicolas Ballas, David Krueger, Emmanuel Bengio, Maxinder S. Kanwal, Tegan Maharaj, Asja Fischer, Aaron Courville, Yoshua Bengio, Simon Lacoste-Julien, ICML 2017
Independently Controllable Features
Emmanuel Bengio, Valentin Thomas, Joelle Pineau, Doina Precup, Yoshua Bengio, RLDM 2017
Deep Nets Don't Learn via Memorization
David Krueger, Nicolas Ballas, Stanislaw Jastrzebski, Devansh Arpit, Maxinder S. Kanwal, Tegan Maharaj, Emmanuel Bengio, Asja Fischer, Aaron Courville. International Conference on Learning Representations, Workshop Track (ICLR 2017)
On Reinforcement Learning for Deep Neural Architectures: conditional computation with stochastic computation policies
Emmanuel Bengio - Master's thesis, 2016
Conditional Computation in Neural Networks for faster models
Emmanuel Bengio, Pierre-Luc Bacon, Joelle Pineau, Doina Precup. International Conference on Learning Representations, Workshop Track (ICLR 2016)
> github code
[Youtube] ICML Abstraction in RL talk
Conditional computation in neural networks using a decision-theoretic approach
Pierre-Luc Bacon, Emmanuel Bengio, Joelle Pineau, Doina Precup. 2nd Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM 2015)
> github code
Combining modality specific deep neural networks for emotion recognition in video
Samira Ebrahimi Kahou et al. Proceedings of the 15th ACM on International conference on multimodal interaction. ACM, 2013.
On weight initialization of deep networks
Code & stuff
, dependency-minimal implementations of various algorithms.
, boilerplate theano code and tools I use for my experiments.
, policy driven sparse neural net, using explicit sparse dot products for speed.
Continuous component autoencoders
, an exploration of activation functions for neural nets.
, attempt at a Python-like JIT compiler.
, a Scheme Scheme-to-x64 compiler.
, a C++ class that wraps PyObject (2.x).
Pirate Story Online
, the first big game (attempt) I ever made (age 13-15).
Theano, a short practical guide
, presentation I made to introduce Theano.
Things worth reading
This is water
(the late David Foster Wallace)
How to be perfectly unhappy
Things I have composed and recorded, on Soundcloud
Things I listen to (in no particular order):
Liquid Tension Experiment