Skip to content

Anthropic Claude

Use Anthropic Claude models with the anthropic: prefix.

Setup

export ANTHROPIC_API_KEY="sk-ant-..."

Available Models

Model Use Case
claude-sonnet-4-0 Latest, best quality
claude-3-5-sonnet-latest High quality, good speed
claude-3-5-haiku-latest Fast and affordable

Usage

from eval_lib import AnswerRelevancyMetric, CustomEvalMetric

metric = AnswerRelevancyMetric(
    model="anthropic:claude-3-5-sonnet-latest",
    threshold=0.7
)

custom = CustomEvalMetric(
    model="anthropic:claude-sonnet-4-0",
    threshold=0.7,
    name="ContentQuality",
    criteria="Evaluate content quality and accuracy"
)

Direct API Calls

from eval_lib import chat_complete

response, cost = await chat_complete(
    llm="anthropic:claude-3-5-sonnet-latest",
    messages=[{"role": "user", "content": "Hello!"}],
    temperature=0.0
)