Gemma 2 9B

Google's efficient mid-size open-weights model with 9B parameters. Released June-July 2024, trained on 8 trillion tokens primarily from web documents, code, and mathematics. Delivers class-leading performance, outperforming Llama 3 8B and other open models in its size category. Features Grouped-Query Attention, interleaved sliding window (4096 tokens) and global attention (8192 tokens). Trained with knowledge distillation from larger 27B model for improved quality. 8K context length. Optimized to run at incredible speed on range of hardware - gaming laptops, high-end desktops, cloud setups. Commercially-friendly license. Available via Google AI Studio, Kaggle, Hugging Face.