Future of DataFrames and Data Systems with Wes McKinney (creator of pandas and Apache Arrow)

Описание к видео Future of DataFrames and Data Systems with Wes McKinney (creator of pandas and Apache Arrow)

Wes McKinney, the creator of pandas, Apache Arrow, and Ibis, will discuss the future of dataframes and composable data systems. I (‪@ChipHuyen‬) am really excited about this talk, as Wes is both a really thoughtful person and a great engineer!

00:00 Intro
02:13 Presentation on composable data systems
26:05 Out of all the work you've done, what are you most proud of?
27:57 Why pandas became popular
31:43 How to decide which dataframe library to use
34:30 How close are we to a truly unified dataframe API?
36:53 How GPUs will change data engineering interface
40:45 Why CPU performance will hit a wall for data workloads
44:25 Will everything be able to run on a single node?
49:30 Biggest challenges for data engineering
53:50 What skills should data engineers and data scientists learn

Please post your questions on Discord:   / discord  
RSVP: https://lu.ma/vkd8h5nu
For more events hosted by Chip in the future: https://lu.ma/chiphuyen

Комментарии

Информация по комментариям в разработке