Скачать или смотреть Adopting Python Asyncio in Large Scale Project (Instagram)｜Jimmy Lai｜PyCon Taiwan 2018

Day 1, R0 16:05–16:50

Asyncio is one of the new killer features in Python 3. It enables concurrent IOs in single thread. Adopting asyncio in an existing large project is hard because:

1. many changes needs to be made and automation is the key.
2. identify required changes is not straight forward and static analysis with profiling tools is required
3. issues like nested loop and orphan future close loop bug make adoption risky; so bug fixes and optimizations are needed.

In this talk, we share our strategy to adopt asyncio and the tools we built: including common helper library for asyncio testing/debugging/profiling, static analysis and profiling tools for identify call stack, bug fixes and optimizations for asyncio module, design patterns for asyncio, etc. Those experiences are learn from large scale project—Instagram Django Service serves more than 500 million daily active users.

The speaker did not upload his slides.

🔖 Chapters 🔖
0:00 Introduction
0:46 OUTLINE
0:53 ABOUT ME - JIMMY LAI
2:04 INSTAGRAM BACKEND
5:11 WHAT'S ASYNCIO
8:01 MYTHS ABOUT ASYNCIO
9:13 ASYNC SYNTAX
16:12 ASYNCID ADOPTION IN INSTACRAM JUST LIHE
18:08 BACHEND CLIENT LIBRARIES ASYNCID SUPPORT
19:07 MAHE ASYNCIO EASIER
20:21 ASYNC STACH MICRATION
21:25 IDENTIFY BLOCHINC CALLS
23:23 WHEN TOD MANY DEPENDENCY IN STACK
25:59 NESTED EVENT LOOP
30:07 CLOBAL VARIABLE ISSUE
32:16 CATHER DESIGN PATTERN
33:47 LINT
35:13 AUTOMATION
36:52 CPU OVERHEAD
39:34 CUSTOM OPTIMIZATION
40:42 CURRENT RESULTS

#python #pycontw #pycontw2018