LMSYS

FastChat Public
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

lm-sys/FastChat’s past year of commit activity

Python 36,548 Apache-2.0 4,505 761 (3 issues need help) 106 Updated Sep 25, 2024
lm-sys.github.io Public

lm-sys/lm-sys.github.io’s past year of commit activity

JavaScript 49 20 0 0 Updated Sep 22, 2024
copilot-arena Public

lm-sys/copilot-arena’s past year of commit activity

83 1 2 0 Updated Sep 11, 2024
arena-hard-auto Public
Arena-Hard-Auto: An automatic LLM benchmark.

lm-sys/arena-hard-auto’s past year of commit activity

Jupyter Notebook 426 Apache-2.0 57 2 2 Updated Sep 4, 2024
RouteLLM Public
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

lm-sys/RouteLLM’s past year of commit activity

Python 2,944 Apache-2.0 227 21 6 Updated Aug 10, 2024
llm-decontaminator Public
Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"

lm-sys/llm-decontaminator’s past year of commit activity

Python 271 Apache-2.0 23 4 0 Updated Dec 20, 2023
vicuna-blog-eval Public archive
The code and data for the GPT-4 based benchmark in the vicuna blog post

lm-sys/vicuna-blog-eval’s past year of commit activity

Python 33 Apache-2.0 8 0 0 Updated Aug 2, 2023

Provide feedback