Curated resources that support the use of LLMs to serve as automatic evaluators of other LLM outputs.
-
JudgeLM: Fine-tuned Large Language Models are Scalable Judges
Paper β’ 2310.17631 β’ Published β’ 35 -
Prometheus: Inducing Fine-grained Evaluation Capability in Language Models
Paper β’ 2310.08491 β’ Published β’ 57 -
Generative Judge for Evaluating Alignment
Paper β’ 2310.05470 β’ Published β’ 1 -
Calibrating LLM-Based Evaluator
Paper β’ 2309.13308 β’ Published β’ 12
