inference

Inference

DeepSeek V3-0324

Text

Model overview

Price

$1.14 - $2.75

Input - Output

Parameters

37B - 680B

Active - Total

Context window

161K

Release date

Mar 2025

DeepSeek V3-0324 is a powerful Mixture-of-Experts model designed for demanding language tasks, including comprehensive information extraction, content summarization, document analysis, and handling complex, structured textual data. It excels in balancing depth and accuracy in high-complexity scenarios.

DeepSeek

License: mit

deepseek-ai/DeepSeek-V3-0324

Use this model

import openai
import weave
# Weave autopatches OpenAI to log LLM calls to W&B
weave.init("<team>/<project>")
client = openai.OpenAI(
    # The custom base URL points to W&B Inference
    base_url='https://api.inference.wandb.ai/v1',
    # Get your API key from https://wandb.ai/authorize
    # Consider setting it in the environment as OPENAI_API_KEY instead for safety
    api_key="<your-apikey>",
    # Team and project are required for usage tracking
    project="<team>/<project>",
)
response = client.chat.completions.create(
    model="deepseek-ai/DeepSeek-V3-0324",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Tell me a joke."}
    ],
)
print(response.choices[0].message.content)

Enter to Rename, Shift+Enter to Preview