Key features
- Apache 2.0 open-source licensing for commercial and research use
- Scalable model variants including 7B, 40B, and 180B parameters
- Optimized inference via Multi-Query Attention and FlashAttention
- Multilingual support for European and global languages
- Trained on the high-quality RefinedWeb curated dataset
