small-ml | whisper_finetuning Workspace – Weights & Biases

Skip to main content

Parambharat's group workspace

Group: small-ml

5

1-1

of 1

Tags

Notes

Author

State

Finished

Start time

December 12th, 2022 7:13:52 PM

Runtime

11h 49m 48s

Tracked hours

11h 30m 22s

Run path

parambharat/whisper_finetuning/219trr2l

OS

Linux-5.15.0-52-generic-x86_64-with-glibc2.29

Python version

3.8.10

Git repository

git clone https://github.com/parambharat/whisper-finetuning.git

Git state

git checkout -b "wandering-shape-58" 72affd4fb13fa64264e65c8f246f84359e63fd45

Command

whisper_small_ml.ipynb

System Hardware

CPU count	30
Logical CPU count	30
GPU count	1
GPU type	NVIDIA A100-SXM4-40GB

W&B CLI Version

0.13.6

Group

Job Type

fine-tuning

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 189 keys
- _name_or_path:
  "./artifacts/model-2dl0413q:v2"
- activation_dropout:
  0
- activation_function:
  "gelu"
- adafactor:
  false
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_epsilon:
  0.00000001
- add_cross_attention:
  false
- ▶
  architectures:[] 1 item
  - 0:
    "WhisperForConditionalGeneration"
- attention_dropout:
  0
- auto_find_batch_size:
  false
- bad_words_ids:
  null
- ▶
  begin_suppress_tokens:[] 2 items
  - 0:
    220
  - 1:
    50,257
- bf16:
  false
- bf16_full_eval:
  false
- bos_token_id:
  50,257
- chunk_size_feed_forward:
  0
- cross_attention_hidden_size:
  null
- d_model:
  768
- data_seed:
  "None"
- dataloader_drop_last:
  false
- dataloader_num_workers:
  0
- dataloader_pin_memory:
  true
- ddp_bucket_cap_mb:
  "None"
- ddp_find_unused_parameters:
  "None"
- ddp_timeout:
  1,800
- debug:
  "[]"
- decoder_attention_heads:
  12
- decoder_ffn_dim:
  3,072
- decoder_layerdrop:
  0
- decoder_layers:
  12
- decoder_start_token_id:
  50,258
- deepspeed:
  "None"
- disable_tqdm:
  false
- diversity_penalty:
  0
- do_eval:
  true
- do_predict:
  false
- do_sample:
  false
- do_train:
  false
- dropout:
  0
- early_stopping:
  false
- encoder_attention_heads:
  12
- encoder_ffn_dim:
  3,072
- encoder_layerdrop:
  0
- encoder_layers:
  12
- encoder_no_repeat_ngram_size:
  0
- warmup_ratio:
  0
- warmup_steps:
  500
- weight_decay:
  0
- xpu_backend:
  "None"

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 15 keys
- eval/loss:
  0.23082850873470304
- eval/runtime:
  149.6244
- eval/samples_per_second:
  0.668
- eval/steps_per_second:
  0.027
- eval/wer:
  36.73965936739659
- sample_predictions:
  "table-file"
- train/epoch:
  28.02
- train/global_step:
  3,000
- train/learning_rate:
  0
- train/loss:
  0.0276
- train/total_flos:
  55,012,457,692,200,960,000
- train/train_loss:
  0.06887441301345826
- train/train_runtime:
  40,824.8754
- train/train_samples_per_second:
  4.703
- train/train_steps_per_second:
  0.073

This run consumed these artifacts as inputs. Learn more

model-2dl0413q:v2

Loading...

This run produced these artifacts as outputs. Total: 21. Learn more