vitals-package {vitals}R Documentation

vitals: Large Language Model Evaluation

Description

logo

A port of 'Inspect', a widely adopted 'Python' framework for large language model evaluation. Specifically aimed at 'ellmer' users who want to measure the effectiveness of their large language model-based products, the package supports prompt engineering, tool usage, multi-turn dialog, and model graded evaluations.

Author(s)

Maintainer: Simon Couch simon.couch@posit.co (ORCID)

Other contributors:

See Also

Useful links:


[Package vitals version 0.1.0 Index]