ServiceNow - Weave Evaluations Team Getting Started Guide with Weave
Created on August 12|Last edited on August 12
Comment
Access Weights & Biases: Go to https://wandb.ai, you should've gotten an invite to the team from Aanjaneya Shukla
For Any Questions, ask us in our shared Teams chat! We are here to help! We also have emails: tyler.dulberg@wandb.com, abraham.leal@wandb.com
Weights & Biases (W&B) Weave 💫Quick Documentation LinksSDK Installation and Authentication Start TracingTrack App Flow - Agentic BehaviorCreate Weave Models to Version Your ApplicationCreate a Dataset of Interactions with FeedbackEvaluate Your Application PerformanceEvaluate via an imperative loggerCreate your own scorersRun Online EvaluationsSee What Changes Are The Most Impactful To Your ApplicationOnce an app is running, replay prompts to test the best configurations, tools, underlying model, and more Limit Data Exposure with Data Privacy FeaturesTie your Weave Agentic Apps with your Models
Weights & Biases (W&B) Weave 💫
Quick Documentation Links
SDK Installation and Authentication
Start Tracing
Track App Flow - Agentic Behavior
Create Weave Models to Version Your Application
Create a Dataset of Interactions with Feedback
Evaluate Your Application Performance
Evaluate via an imperative logger
Create your own scorers
Run Online Evaluations
See What Changes Are The Most Impactful To Your Application
Once an app is running, replay prompts to test the best configurations, tools, underlying model, and more
Limit Data Exposure with Data Privacy Features
Tie your Weave Agentic Apps with your Models
Add a comment