Cerebras PoV Guide
One stop shop for everything you need to test out during the W&B Pilot.
Created on August 8|Last edited on August 18
Comment
💡
💡
Link to Colab Notebook with helpful Weave scripts: https://colab.research.google.com/drive/1gzgU2zA9TJ5rbw41syBg0_caRo12S9L8?usp=sharing
💡
Weights and Biases (W&B) 💫PoC Workshop SessionsQuick Documentations LinksW&B Installation & AuthenticationSample Script to log First Trace (validated on Kick-off call)Use Cases / Test CasesTest Case 1: Complete Visibility into all input/output callsTest Case 2: Automate Evaluations with W&B WeaveTest Case 3: Visibility into latency, costs, and token countsFAQsW&B Weave
Weights and Biases (W&B) 💫
Weights and Biases is a ML Ops platform built to facilitate collaboration and reproducibility across the machine learning development lifecycle. Machine learning projects can quickly become a mess without some best practices in place to aid developers and scientists as they iterate on models and move them to production.
W&B is lightweight enough to work with whatever framework or platform teams are currently using, but enables teams to quickly start logging their important results to a central system of record. On top of this system of record, W&B has built visualization, automation, and documentation capabilities for better debugging, model tuning, and project management.
PoC Workshop Sessions
Date | Session | Recording Link | Topics Discussed |
---|---|---|---|
August 11, 2025 | PoV Kickoff Call | https://us-39259.app.gong.io/e/c-share/?tkn=1lmxmlge8138k92ztvzbua8vt | Align on success criteria's and PoV plan, setup Weave and log a first trace |
Quick Documentations Links
W&B Installation & Authentication
To start using W&B, you first need to install the Python package (if it's not already there)
pip install wandb weave
Once it's installed, authenticate your user account by logging in through the CLI or SDK. You should have receive an email to sign up to the platform, after which you can obtain your API token (The API token is in your "Settings" section under your profile)
wandb login --host <YOUR W&B HOST URL> <YOUR API TOKEN>
OR through Python:
Once you are logged in, you are ready to track your workflows!
Sample Script to log First Trace (validated on Kick-off call)
Following the Quickstart guide on docs but for Cerebras team
Authentication:
!pip install wandb weaveimport wandbimport weave
Script Execution:
import weavefrom openai import OpenAIclient = OpenAI()# Weave will track the inputs, outputs and code of this function@weave.op()def extract_dinos(sentence: str) -> dict:response = client.chat.completions.create(model="gpt-4o",messages=[{"role": "system","content": """In JSON format extract a list of `dinosaurs`, with their `name`,their `common_name`, and whether its `diet` is a herbivore or carnivore"""},{"role": "user","content": sentence}],response_format={ "type": "json_object" })return response.choices[0].message.content# Initialise the weave projectweave.init('<your-team>/jurassic-park')sentence = """I watched as a Tyrannosaurus rex (T. rex) chased after a Triceratops (Trike), \both carnivore and herbivore locked in an ancient dance. Meanwhile, a gentle giant \Brachiosaurus (Brachi) calmly munched on treetops, blissfully unaware of the chaos below."""result = extract_dinos(sentence)
Use Cases / Test Cases
S No | Capability & Success Criteria |
---|---|
1 | Complete Visibility into all input/output calls |
2 | Automate Evaluations with W&B Weave and produce sharable evals |
3 | Visibility into latency, costs, and token counts |
Test Case 1: Complete Visibility into all input/output calls
Test Case 2: Automate Evaluations with W&B Weave
Test Case 3: Visibility into latency, costs, and token counts
FAQs
1. Why can't I login to W&B?
Ans: Make sure you have specified host while initializing a W&B run with the script
OR set the host base URL as environment variable
W&B Weave
1. How does Tracing with W&B Weave work?
2. How can I add a custom cost for my GenAI model?
You can add a custom cost by using the add_cost method. This guide walks you through the steps of adding a custom cost. Additionally we also have this cookbook on Setting up a custom cost model with associated notebook.
3. How can I create my own custom Scorers with W&B Weave?
W&B Weave has it's own predefined scorers that you use as well as create your own Scorers. This documentation walks through creating your own scorers with W&B Weave
4. Can I control/customize the data that is logged?
Yes, If you want to change the data that is logged to weave without modifying the original function (e.g. to hide sensitive data), you can pass postprocess_inputs and postprocess_output to the op decorator.
5. How to publish prompts to W&B Weave?
W&B Weave support Prompts as first class object. You can use weave.publish() to log prompts or any object as well (eg: Datasets, Models etc.) to Weave. This guide walks into details on publishing prompts to W&B Weave
Add a comment