AWS re:Invent 2022 - Train and host foundation models with PyTorch on AWS (AIM404)

Foundation models with hundreds of billions of parameters activate new applications for machine learning. Models such as OPT-175B, BLOOM, Jurassic, GPT-3, and DALL-E demonstrate exciting new use cases for text and image generation, but training and serving these models for inference poses new challenges. In this session, learn how to train and serve foundation models at scale using PyTorch on AWS. Discover how to reduce training time and cost by optimizing compute, network communication, input/output, checkpointing, and offloading from GPUs to CPUs. Also learn how to pick the right model parallelization strategies and best practices for training and serving these models.

Learn more about AWS re:Invent at https://go.aws/3ikK4dD.

Subscribe:
More AWS videos http://bit.ly/2O3zS75
More AWS events videos http://bit.ly/316g9t4

ABOUT AWS
Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts.

AWS is the world’s most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.

#reInvent2022 #AWSreInvent2022 #AWSEvents