Skip to content

DeepSeek

The DeepSeek provider gives access to DeepSeek's language models. Models are accessed with the deepseek: prefix.

Setup

export DEEPSEEK_API_KEY="your-api-key"

Base URL: https://api.deepseek.com/v1

Available Models

Model Use Case
deepseek-chat General-purpose chat and evaluation
deepseek-coder Code-focused tasks and evaluation

Usage

from eval_lib.metrics import AnswerRelevancyMetric

metric = AnswerRelevancyMetric(model="deepseek:deepseek-chat", threshold=0.7)