FastChat

FastChat is an open source framework designed to serve, benchmark, and compare large language models. It forms the technical backend behind public model evaluation leaderboards, supporting dozens of open weights models.