In the past several years, based on the Apache OSS technologies, we have built a scalable and efficient ML/DL inference and training platform called MagnetTar (MT). Our MT platform has been running on top of tens of thousands of Windows servers and has been widely used across Bing, Bing Ads, and News. MT has empowered many critical large-scale offline batch and streaming scenarios.
Lukas is a developer in the Bing MT team. Lukas has been a key contributor in many areas in MT, such as HDFS, Spark, and Deep-Learning Offline Processing, etc.