inference

Inference

Microsoft Phi 4 Mini 3.8B

Text

Model overview

Price

$0.08 - $0.35

Input - Output

Parameters

3.8B

Total

Context window

128K

Release date

Feb 2025

Phi 4 Mini is optimized for use in lightweight environments, excelling at quick interactions, and constrained-resource deployments. It supports strong mathematical and logical inference, suitable for embedded applications, mobile environments, or real-time AI assistants.

Microsoft

License: mit

microsoft/Phi-4-mini-instruct

Supported features

Reasoning

JSON mode

Structured output

Tool calling

Use this model

import openai
import weave
# Weave autopatches OpenAI to log LLM calls to W&B
weave.init("<team>/<project>")
client = openai.OpenAI(
    # The custom base URL points to W&B Inference
    base_url='https://api.inference.wandb.ai/v1',
    # Get your API key from https://wandb.ai/authorize
    # Consider setting it in the environment as OPENAI_API_KEY instead for safety
    api_key="<your-apikey>",
    # Optional: Team and project for usage tracking
    project="<team>/<project>",
)
response = client.chat.completions.create(
    model="microsoft/Phi-4-mini-instruct",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Tell me a joke."}
    ],
)
print(response.choices[0].message.content)

Enter to Rename, Shift+Enter to Preview