model-latency-benchmarking Workspace – Weights & Biases

Skip to main content

Assets

model_generation_latency:v14

Name

model_generation_latency(16 versions)

Last updated

10 months ago

Storage size

913B (14.6kB from all versions)

TimingScorer:v6

Summary

1

Model

2

avg_token_per_sec

3

avg_token_count

4

avg_gen_timing

5

total_tokens

6

Run Date

7

Trials

8

0.00

0.00

0.00

0.00

10 months ago

1.00

Total Rows: 1