Understanding Latency Hiding On Gpus