News Score: Score the News, Sort the News, Rewrite the Headlines

Ask HN: How does deploying a fine-tuned model work

You still need a GPU.I'm nothing even close to a knowledgeable expert on this, but I've dabbled enough to have an idea how to answer this.The special thing about why GPU's are used to train models is that their architecture is directly applicable to parallelize the kind of vector math that goes on under the hood when adjusting weights between nodes in all the layers of a neural network.The weights files (GGUF, etc) are just data describing how the networks need to be built up to be functional. T...

Read more at news.ycombinator.com

© News Score  score the news, sort the news, rewrite the headlines