Designing a Workflow Engine from First Principles

CTO Maxim Fateev explains the requirements anyone would need to build a Workflow Engine that is scalable and resilient. Transcript: https://docs.temporal.io/blog/workflo...

This talk was given as part of the Systems @ Scale 2021 conference hosted by Facebook. There was a 30 minute Q&A afterward that you can watch here: https://www.facebook.com/watch/live/?...

Timestamps:

00:00 Maxim's Intro
0:15 History of Temporal
2:52 Four Properties of a Workflow
3:40 Temporal's Programming Model
5:15 Workflow as State Machine
6:00 Using Task Queues
7:10 Timer Queue
7:35 Consistency and the importance of Transactions
10:30 Scalability Needs
12:38 Sharding
13:50 Membership and Routing
16:15 Local Transfer Queues
17:35 Workflow Visibility
19:10 System Workflows
20:10 Temporal architecture
21:00 Multi-cluster Deployment
22:15 Conclusion


Get updates via Temporal Newsletter: http://eepurl.com/hhcaaX
Conceptual Overview of Temporal: https://docs.temporal.io/docs/concept...
Temporal Forum and Slack https://community.temporal.io/