krenerd77

Krenerd77's group workspace

Group: SAM_ResNet18-lr0.1-sweep

1-2

of 2

Tags

Notes

Author

krenerd77

State

Crashed

Start time

June 29th, 2022 3:43:12 PM

Runtime

3h 48m 58s

Tracked hours

3h 48m 54s

Run path

krenerd77/CIFAR10-classification/x746t8dy

Linux-5.4.188+-x86_64-with-Ubuntu-18.04-bionic

Python version

3.7.13

Git repository

git clone https://github.com/krenerd/awesome-modular-pytorch-lightning

Git state

git checkout -b "SAM_ResNet18-lr0.1-sweep-cycle_0-training.sharpness-aware.rho_0.2-Jun29_15-42-49" ad6b7f170cdd6550299d0ba9441c299f278e12a7

Command

hyperparameter_sweep.py --name SAM_ResNet18-lr0.1-sweep -k training.sharpness-aware.rho -t float -v 0.2 0.3 --set_same_group --config configs/algorithms/sharpness-aware-minimization.yaml configs/vision/training/resnet-cifar10.yaml configs/vision/models/resnet/resnet18-custom.yaml configs/vision/data/cifar10.yaml configs/device/gpu.yaml configs/utils/wandb.yaml configs/utils/train.yaml

System Hardware

CPU count	2
GPU count	1
GPU type	Tesla T4

W&B CLI Version

0.12.20

Group

SAM_ResNet18-lr0.1-sweep

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 78 keys
- ▶
  callbacks:[] 2 items
  - ▶
    0:{} 3 keys
    - ▶
      args:{} 4 keys
      - mode:
        "max"
      - monitor:
        "epoch_val/accuracy"
      - save_last:
        true
      - save_top_k:
        5
    - file:
      "lightning"
    - name:
      "ModelCheckpoint"
  - ▶
    1:{} 3 keys
    - ▶
      args:{} 1 key
      - logging_interval:
        "epoch"
    - file:
      "lightning"
    - name:
      "LearningRateMonitor"
- ▶
  const/label_map:[] 10 items
- ▶
  const/normalization_mean:[] 3 items
  - 0:
    0.4914
  - 1:
    0.4822
  - 2:
    0.4465
- ▶
  const/normalization_std:[] 3 items
  - 0:
    0.2023
  - 1:
    0.1994
  - 2:
    0.201
- const/task:
  "image classification"
- dataloader/base_dataloader/batch_size:
  64
- dataloader/base_dataloader/num_workers:
  8
- dataloader/base_dataloader/pin_memory:
  true
- dataloader/base_dataloader/prefetch_factor:
  2
- dataloader/base_dataloader/shuffle:
  true
- dataloader/trn/shuffle:
  true
- dataloader/val/drop_last:
  false
- dataloader/val/shuffle:
  false
- dataset/dataset_base_cfg/root:
  "./cifar10"
- dataset/dataset_subset_cfg/trn/download:
  true
- dataset/dataset_subset_cfg/trn/train:
  true
- dataset/dataset_subset_cfg/val/train:
  false
- dataset/initial_transform/name:
  "TupleToClassificationData"
- dataset/MODE:
  "torchvision"
- dataset/NAME:
  "CIFAR10"
- dataset/trn_size:
  50,000
- dataset/val_size:
  10,000
- DEBUG_MODE:
  false
- ▶
  debug/network_summary/input_shape:[] 3 items
  - 0:
    3
  - 1:
    224
  - 2:
    224
- debug/view_train_augmentation/plot_size:
  5
- ▶
  debug/view_train_augmentation/resize_to:[] 2 items
  - 0:
    256
  - 1:
    256
- debug/view_train_augmentation/save_to:
  "vis/training_samples.png"
- ▶
  debug/view_train_augmentation/subplot_dim:[] 2 items
  - 0:
    4
  - 1:
    4
- model/backbone/cfg/low_res:
  true
- model/backbone/ID:
  "ResNet18"
- model/backbone/out_features:
  512
- model/backbone/TYPE:
  "custom"
- model/modules/classifier/args/dropout:
  0.2
- model/modules/classifier/args/in_features:
  512
- model/modules/classifier/args/num_classes:
  10
- model/modules/classifier/args/reduction:
  "gap"
- model/modules/classifier/args/return_logits:
  true
- model/modules/classifier/input:
  "output"
- model/modules/classifier/name:
  "ClassificationHead"
- model/modules/loss_fn/name:
  "CrossEntropyLoss"
- name:
  "SAM_ResNet18-lr0.1-sweep-cycle_0-training.sharpness-aware.rho_0.2"
- seed:
  true
- trainer/accumulate_grad_batches:
  1
- trainer/check_val_every_n_epoch:
  5
- ▶
  trainer/gpus:[] 1 item
  - 0:
    0
- trainer/precision:
  32
- ▶
  transform:[] 2 items
  - ▶
    0:[] 2 items
    - 0:
      "trn"
    - ▶
      1:[] 2 items
      - ▶
        0:{} 2 keys
        ▶
        args:{} 3 keys
        ▶
        ARGS:{} 2 keys
        padding:
        4
        size:
        32
        ▶
        const_cfg:{} 4 keys
        ▶
        label_map:[] 10 items
        ▶
        normalization_mean:[] 3 items
        0:
        0.4914
        1:
        0.4822
        2:
        0.4465
        ▶
        normalization_std:[] 3 items
        0:
        0.2023
        1:
        0.1994
        2:
        0.201
        task:
        "image classification"
        NAME:
        "RandomCrop"
        name:
        "TorchTransforms"
      - ▶
        1:{} 2 keys
        ▶
        args:{} 2 keys
        ▶
        const_cfg:{} 4 keys
        ▶
        label_map:[] 10 items
        ▶
        normalization_mean:[] 3 items
        0:
        0.4914
        1:
        0.4822
        2:
        0.4465
        ▶
        normalization_std:[] 3 items
        0:
        0.2023
        1:
        0.1994
        2:
        0.201
        task:
        "image classification"
        NAME:
        "RandomHorizontalFlip"
        name:
        "TorchTransforms"
  - ▶
    1:[] 2 items
    - 0:
      "trn,val"
    - ▶
      1:[] 2 items
      - ▶
        0:{} 2 keys
        ▶
        args:{} 1 key
        ▶
        const_cfg:{} 4 keys
        ▶
        label_map:[] 10 items
        ▶
        normalization_mean:[] 3 items
        0:
        0.4914
        1:
        0.4822
        2:
        0.4465
        ▶
        normalization_std:[] 3 items
        0:
        0.2023
        1:
        0.1994
        2:
        0.201
        task:
        "image classification"
        name:
        "ToTensor"
      - ▶
        1:{} 2 keys
        ▶
        args:{} 3 keys
        ▶
        const_cfg:{} 4 keys
        ▶
        label_map:[] 10 items
        ▶
        normalization_mean:[] 3 items
        0:
        0.4914
        1:
        0.4822
        2:
        0.4465
        ▶
        normalization_std:[] 3 items
        0:
        0.2023
        1:
        0.1994
        2:
        0.201
        task:
        "image classification"
        ▶
        mean:[] 3 items
        0:
        0.4914
        1:
        0.4822
        2:
        0.4465
        ▶
        std:[] 3 items
        0:
        0.2023
        1:
        0.1994
        2:
        0.201
        name:
        "Normalize"
- VERBOSE:
  "DEFAULT"
- wandb/group:
  "SAM_ResNet18-lr0.1-sweep"
- wandb/project:
  "CIFAR10-classification"

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 11 keys
- epoch:
  122
- epoch_trn/accuracy:
  0.9530799984931946
- ▶
  epoch_trn/confusion_matrix:{} 7 keys
- epoch_trn/loss:
  0.1860269457101822
- epoch_val/accuracy:
  0.9293000102043152
- ▶
  epoch_val/confusion_matrix:{} 7 keys
- epoch_val/loss:
  0.2225732058286667
- lr-SAM:
  0.03306310398773545
- step/main_loss:
  0.36015427112579346
- step/train_loss:
  0.36015427112579346
- trainer/global_step:
  95,949

This run produced these artifacts as outputs. Total: 1. Learn more

wandb-history

run-x746t8dy-history:v0