ASPLOS'24 - Session 6C - Optimization of Tensor Programs

ASPLOS'24: The International Conference on Architectural Support for Programming Languages and Operating Systems

Session 6C: Optimization of Tensor Programs
Session Chair: Mangpo Phothilimthana (Google DeepMind)

Papers Presented:

1. Felix: Optimizing Tensor Programs with Gradient Descent
Authors: Yifan Zhao, Hashim Sharif, Vikram Adve, and Sasa Misailovic (University of Illinois Urbana-Champaign)

2. Optimizing Deep Learning Inference via Global Analysis and Tensor Expressions
Authors: Chunwei Xia, Jiacheng Zhao, and Qianqi Sun (Chinese Academy of Sciences); Zheng Wang (University of Leeds); Yuan Wen (University of Aberdeen); Teng Yu (Thewake Systems); Xiaobing Feng and Huimin Cui (Chinese Academy of Sciences)

3. PyTorch 2: Faster Machine Learning Through Dynamic Python Bytecode Transformation and Graph Compilation
Authors: Jason Ansel, Edward Yang, and Horace He (Meta); Natalia Gimelshein (OpenAI); Animesh Jain, Michael Voznesensky, Bin Bao, David Berard, Geeta Chauhan, Anjali Chourdia, Will Constable, Alban Desmaison, Zachary DeVito, Elias Ellison, and Will Feng (Meta); Jiong Gong (Intel); Michael Gschwind, Brian Hirsh, Sherlock Huang, Laurent Kirsch, Michael Lazos, Yanbo Liang, Jason Liang, Yinghai Lu, CK Luk, and Bert Maher (Meta); Yunjie Pan (University of Michigan); Christian Puhrsch, Matthias Reso, Mark Saroufim, Helen Suk, and Michael Suo (Meta); Phil Tillet (OpenAI); Eikan Wang (Intel); Xiaodong Wang, William Wen, Shunting Zhang, and Xu Zhao (Meta); Keren Zhou (OpenAI); Richard Zou, Ajit Mathews, Gregory Chanan, Peng Wu, and Soumith Chintala (Meta)

4. Optimal Kernel Orchestration for Tensor Programs with Korch
Authors: Muyan Hu (University of Illinois at Urbana-Champaign); Ashwin Venkatram (AMD); Shreyashri Biswas (Carnegie Mellon University); Balamurugan Marimuthu (Sambanova Systems); Bohan Hou and Gabriele Oliaro (Carnegie Mellon University); Haojie Wang and Liyan Zheng (Tsinghua University); Xupeng Miao (Carnegie Mellon University); Jidong Zhai (Tsinghua University); Zhihao Jia (Carnegie Mellon University)