massOfai

Horovod

Performance

Distributed training library from Uber

What is Horovod?

Simplifies distributed training across multiple machines and frameworks with efficient allreduce implementations.

Real-World Examples

  • Large-scale TF/PyTorch training