May, 24 2025 • 16 min read • 2461 wordsPreface: A few weeks back, I implemented GPT-2 using WebGL and shaders (Github Repo) which made the front page of Hacker News (discussion). By popular demand, here is a short write-up over the main ideas behind GPU shader programming (for general-purpose computing).Table Of ContentsThe Origins of General Purpose GPU ProgrammingGraphics API vs Compute APIImplementing GPT-2 with shadersTextures & Framebuffers: The Data BusFragment Shaders as Compute KernelsCh...