Loading…
Monday, May 20 • 5:20pm - 5:40pm
TonY: An Orchestrator for Distributed Machine Learning Jobs

Sign up or log in to save this to your schedule and see who's attending!

Training machine learning (ML) models on large datasets requires considerable computing power. To speed up training, it is typical to distribute training across several machines, often with specialized hardware like GPUs or TPUs. Managing a distributed training job is complex and requires dealing with resource contention, distributed configurations, monitoring, and fault tolerance. In this paper, we describe TonY, an open-source orchestrator for distributed ML jobs built at LinkedIn to address these challenges.

Speakers
AH

Anthony Hsu

LinkedIn
KH

Keqiu Hu

LinkedIn
AS

Arun Suresh

LinkedIn
ZZ

Zhe Zhang

LinkedIn


Monday May 20, 2019 5:20pm - 5:40pm
Lawrence/San Tomas/Lafayette Rooms

Attendees (7)