Optimizing Resource Utilization, Efficiency and Scalability in Deep Learning Systems