Author: mk374
Allgemein, Artificial Intelligence, Deep Learning, System Architecture, System Designs, System Engineering, Ultra Large Scale SystemsAn overview of Large Scale Deep Learning
article by Annika Strauß (as426) and Maximilian Kaiser (mk374) Introduction Improving Deep Learning with ULS for superior model training Single Instance Single Device (SISD) Multi Instance Single Device (MISD) Multi Instance Multi Device (MIMD) Single Instance Multi Device (SIMD) Model parallelism Data parallelism Improving ULS and its components with the aid of Deep Learning Understanding…