Torch Tutorial (Alex Wiltschko, Twitter)
Alex Wiltschko, Hugo Larochelle, Andrej Karpathy, Richard Socher, Sherry Moore, Ruslan Salakhutdinov, Andrew Ng, John Schulman, Pascal Lamblin, Adam Coates, Quoc Le, Yoshua Bengio, Shubho Sengupta
This presentation details the practical implementation and theoretical foundations of the Torch deep learning framework using the Lua language, developed in collaboration with experts from Facebook, Google, and Twitter. The speaker explains how Torch leverages LuaJIT for high-performance embedded deployment while utilizing its dynamic Autograd system to support flexible control flow and custom gradients without the overhead of static computation graphs. Case studies from Twitter demonstrate the framework's transition from a research tool for cutting-edge models like GANs to a production environment for serving media, highlighting its efficiency in both training via reverse-mode differentiation and inference through lightweight C++ integration.