Vicuna 33B

LMSYS's open-source chatbot fine-tuned from LLaMA with supervised instruction fine-tuning on ~125K user-shared conversations from ShareGPT.com. Auto-regressive language model based on transformer architecture with 33B parameters. Evaluated with standard benchmarks, human preference studies, and LLM-as-a-judge (MT-Bench). Achieved 1091 ELO rating on Chatbot Arena. Scores: 62.1 Arc, 83 HellaSwag, 59.2 MMLU, 56.2 TruthfulQA, 77 WinoGrande, 13.7 GSM8K. Released as part of FastChat platform for training and evaluating large language models. Represents important early work in open-source chat model fine-tuning. Non-commercial license. Part of research leading to Chatbot Arena benchmark.