GitHub - bigcode-project/starcoder2-self-align: StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation
StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation
⭐️ About
| 🚀 Quick start
| 📚 Data generation
| 🧑💻 Training
| 📊 Evaluation
| ⚠️ Limitations
About
We introduce StarCoder2-15B-Instruct-v0.1, the very first entirely self-aligned code Large Language Model (LLM) trained with a fully permissive and transparent pipeline. Our open-source pipeline uses StarCoder2-15B to generate thousands of instruction-response pairs, which are then used to fine-tune StarCod...
Read more at github.com