Deep Learning at Scale with Horovod feat. Travis Addair | Stanford MLSys Seminar Episode 10

Episode 10 of the Stanford MLSys Seminar Series! Horovod and the Evolution of Deep Learning at Scale Speaker: Travis Addair Abstract: Deep neural networks are pushing the state of the art in numerous machine learning research domains; from computer vision, to natural language processing, and even tabular business data. However, scaling such models to train efficiently on large datasets imposes a unique set of challenges that traditional batch data processing systems were not designed to solve. Horovod i