upup-ashton-wang-usc

Upup-ashton-wang's group workspace

Group: Tina-OpenR1

1-4

of 4

Tags

Notes

Author

upup-ashton-wang

State

Crashed

Start time

April 2nd, 2025 10:59:23 PM

Runtime

9h 36m 46s

Tracked hours

9h 36m 1s

Run path

upup-ashton-wang-usc/Tina/aqkmjd7n

Linux-4.18.0-553.22.1.el8_10.x86_64-x86_64-with-glibc2.28

Python version

CPython 3.10.16

Command

/home1/shangsha/workspace/reasoning/reasoning-sae/./resee/post_train_hf/grpo.py --config ./recipes/DeepSeek-R1-Distill-Qwen-1.5B/grpo/model_curated_open_r1.yaml

System Hardware

CPU count	64
Logical CPU count	64
GPU count	2
GPU type	NVIDIA L40S

W&B CLI Version

0.19.8

Group

Tina-OpenR1

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 224 keys
- _attn_implementation_autoset:
  true
- _name_or_path:
  "/project/neiswang_1391/shangsha/reasoning/reasoning-sae/ckpts/models/DeepSeek-R1-Distill-Qwen-1.5B/base"
- ▶
  accelerator_config:{} 6 keys
- adafactor:
  false
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_epsilon:
  0.00000001
- add_cross_attention:
  false
- ▶
  architectures:[] 1 item
  - 0:
    "Qwen2ForCausalLM"
- attention_dropout:
  0
- auto_find_batch_size:
  false
- average_tokens_across_devices:
  false
- bad_words_ids:
  null
- batch_eval_metrics:
  false
- begin_suppress_tokens:
  null
- beta:
  0.04
- bf16:
  true
- bf16_full_eval:
  false
- bos_token_id:
  151,643
- chunk_size_feed_forward:
  0
- cross_attention_hidden_size:
  null
- data_seed:
  null
- dataloader_drop_last:
  false
- dataloader_num_workers:
  0
- dataloader_persistent_workers:
  false
- dataloader_pin_memory:
  true
- dataloader_prefetch_factor:
  null
- ddp_backend:
  null
- ddp_broadcast_buffers:
  null
- ddp_bucket_cap_mb:
  null
- ddp_find_unused_parameters:
  null
- ddp_timeout:
  1,800
- debug:[] 0 items
- decoder_start_token_id:
  null
- deepspeed:
  null
- disable_tqdm:
  false
- dispatch_batches:
  null
- diversity_penalty:
  0
- do_eval:
  false
- do_predict:
  false
- do_sample:
  false
- do_train:
  false
- ds3_gather_for_generation:
  true
- early_stopping:
  false
- encoder_no_repeat_ngram_size:
  0
- eos_token_id:
  151,643
- vocab_size:
  151,936
- warmup_ratio:
  0
- warmup_steps:
  200
- weight_decay:
  0

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 17 keys
- completions:
  "table-file"
- train/completion_length:
  1,755.28125
- train/epoch:
  0.3425864680905541
- train/global_step:
  4,014
- train/grad_norm:
  0.8202553391456604
- train/kl:
  0.306884765625
- train/learning_rate:
  0.00000077761730355512
- train/loss:
  0.0123
- train/reward:
  2.5789918899536133
- train/reward_std:
  0.7456816211342812
- train/rewards/accuracy_reward:
  0.078125
- train/rewards/cosine_scaled_reward:
  0.0873645693063736
- train/rewards/format_reward:
  0.875
- train/rewards/len_reward:
  -0.005438145250082016
- train/rewards/reasoning_steps_reward:
  0.7604166716337204
- train/rewards/repetition_penalty_reward:
  -0.146163672208786
- train/rewards/tag_count_reward:
  0.9296875

This run produced these artifacts as outputs. Total: 5. Learn more

run_table

run-aqkmjd7n-completions:v0

run_table

run-aqkmjd7n-completions:v1

run_table

run-aqkmjd7n-completions:v2

run_table

run-aqkmjd7n-completions:v3

wandb-history

run-aqkmjd7n-history:v0

Upup-ashton-wang's group workspace

Tina-OpenR1

Tina-OpenR1-continue3