'I paid for the whole GPU, I am going to use the whole GPU': A high-level guide to GPU utilization Typical attire of a GPU utilization maximizer. Graphics Processing Units, or GPUs, are the hottest mathematical co-processor since the FM synthesis chips that shaped the sounds of the 1990s. Like all co-processors, they are chosen when the performance of more flexible commodity hardware, like an x86 Central Processing Unit (CPU), is insufficient. GPUs are in particular designed for problems where ...