Exploring LoRA — Part 1: The Idea Behind Parameter Efficient Fine-Tuning and LoRA
“The What and Why of Adapter based Parameter Efficient Fine Tuning: Understanding Its Purpose and Significance”Table of ContentsWhat is the necessity of fine tuning?What is the conventional way of fine-tuning?How can fine-tuning be made efficient?How does fine-tuning with fewer parameters work?What are adapters and how are they used for fine-tuning?What is LoRA?The Idea Behind Low-Rank AdaptationConclusionWhat is the necessity of fine tuning?Pre-trained large language models undergo extensive tr...
Read more at medium.com