Скачать или смотреть Deep Learning News #5, Feb 27 2021

Sebastian's books: https://sebastianraschka.com/books/

Links mentioned in this video:

Apple's On-Device ML System for Federated Evaluation and Tuning

https://arxiv.org/abs/2102.08503

https://syncedreview.com/2021/02/19/a...

==========================================

Creating Privacy-Preserving Synthetic Data

https://cloudblogs.microsoft.com/open...

Whitepaper: https://azure.microsoft.com/en-us/res...

Code: https://github.com/opendp/smartnoise-...

==========================================

Humans Are Trying to Take Bias Out of Facial Recognition Programs

https://news.northeastern.edu/2021/02...

https://arxiv.org/abs/2102.02320

==========================================

Model Search Platform for Finding Optimal ML Models

https://ai.googleblog.com/2021/02/int...

https://pdfs.semanticscholar.org/1bca...

==========================================

TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models

https://arxiv.org/abs/2102.07988

==========================================

Gradient Checkpointing

https://github.com/rasbt/deeplearning...

https://github.com/cybertronai/gradie...

==========================================

Zero Redundancy Optimizer (ZeRO)

https://www.deepspeed.ai/tutorials/zero/

https://www.deepspeed.ai/tutorials/ze...

https://github.com/facebookresearch/f...

==========================================

FairScale

https://github.com/facebookresearch/f...