Skip to main content
homebrewnlp
Projects
gpt
Run groups
<null>
Logs
Group
Workspace
Runs
Logs
Files
Artifacts

Clashluke's group workspace

Timestamps visible
2023-05-14 16:42:00
        "message": "Anonymous caller does not have storage.objects.list access to the Google Cloud Storage bucket. Permission 'storage.objects.list' denied on resource (or it may not exist).",
2023-05-14 16:42:00
        "domain": "global",
2023-05-14 16:42:00
        "reason": "required",
2023-05-14 16:42:00
    '
2023-05-14 16:42:00
  when reading gs://homebrewnlp-eu/the-char-pile
2023-05-14 16:42:00
Traceback (most recent call last):
2023-05-14 16:42:00
  File "/home/lucas/PycharmProjects/Olmax/main.py", line 4, in <module>
2023-05-14 16:42:00
    main()
2023-05-14 16:42:00
  File "/home/lucas/PycharmProjects/Olmax/src/main.py", line 187, in main
2023-05-14 16:42:00
    data = init_data_and_model(wctx)
2023-05-14 16:42:00
  File "/home/lucas/PycharmProjects/Olmax/src/main.py", line 139, in init_data_and_model
2023-05-14 16:42:00
    data, inp = init_data(wctx.ctx, 0)
2023-05-14 16:42:00
  File "/home/lucas/PycharmProjects/Olmax/src/main.py", line 124, in init_data
2023-05-14 16:42:00
    np_data = timeit("Initializing dataset", text_dataset, ctx, skipped_samples)
2023-05-14 16:42:00
  File "/home/lucas/PycharmProjects/Olmax/src/main.py", line 102, in timeit
2023-05-14 16:42:00
    out = fn(*args, **kwargs)
2023-05-14 16:42:00
  File "/home/lucas/PycharmProjects/Olmax/src/data.py", line 57, in text_dataset
2023-05-14 16:42:00
    filenames = tf.io.gfile.glob(ctx.data.path)
2023-05-14 16:42:00
  File "/usr/lib/python3/dist-packages/tensorflow/python/lib/io/file_io.py", line 441, in get_matching_files_v2
2023-05-14 16:42:00
    for matching_filename in _pywrap_file_io.GetMatchingFiles(
2023-05-14 16:42:00
tensorflow.python.framework.errors_impl.PermissionDeniedError: Error executing an HTTP request: HTTP response code 401 with body '{
2023-05-14 16:42:00
  "error": {
2023-05-14 16:42:00
    "code": 401,
2023-05-14 16:42:00
    "message": "Anonymous caller does not have storage.objects.list access to the Google Cloud Storage bucket. Permission 'storage.objects.list' denied on resource (or it may not exist).",
2023-05-14 16:42:00
    "errors": [
2023-05-14 16:42:00
      {
2023-05-14 16:42:00
        "message": "Anonymous caller does not have storage.objects.list access to the Google Cloud Storage bucket. Permission 'storage.objects.list' denied on resource (or it may not exist).",
2023-05-14 16:42:00
        "domain": "global",
2023-05-14 16:42:00
        "reason": "required",
2023-05-14 16:42:00
    '
2023-05-14 16:42:00
  when reading gs://homebrewnlp-eu/the-char-pile
2023-05-14 16:42:00
data:
2023-05-14 16:42:00
    datasets_used_per_step: 2
2023-05-14 16:42:00
    deterministic: true
2023-05-14 16:42:00
    interleaved_datasets: 2
2023-05-14 16:42:00
    parallel_workers: 2
2023-05-14 16:42:00
    path: gs://homebrewnlp-eu/the-char-pile/*
2023-05-14 16:42:00
    prefetch_buffer: 2
2023-05-14 16:42:00
    seed: 0
2023-05-14 16:42:00
    shuffle_buffer_gb: 64
2023-05-14 16:42:00
dims:
2023-05-14 16:42:00
    batch: 8
2023-05-14 16:42:00
    depth: 4
2023-05-14 16:42:00
    features: 16384
2023-05-14 16:42:00
    memory_features: 128
2023-05-14 16:42:00
    memory_heads: 32
2023-05-14 16:42:00
    memory_slots: 1048576
2023-05-14 16:42:00
    memory_slots_per_head: 4
2023-05-14 16:42:00
    pointwise_features: 4096
2023-05-14 16:42:00
    sequence: 256
2023-05-14 16:42:00
    vocab: 256
2023-05-14 16:42:00
fail_on_missing_parameter: true
2023-05-14 16:42:00
global_prefix: ''
2023-05-14 16:42:00
model:
2023-05-14 16:42:00
    autoregressive: true
2023-05-14 16:42:00
    computation_dtype: bfloat16
2023-05-14 16:42:00
    norm:
2023-05-14 16:42:00
        eps: 1.0e-16
2023-05-14 16:42:00
    storage_dtype: float32
2023-05-14 16:42:00
name_cache_offsets: {}
2023-05-14 16:42:00
optimizer:
2023-05-14 16:42:00
    adam_beta1: 0.03
2023-05-14 16:42:00
    adam_beta2: 0.003
2023-05-14 16:42:00
    epsilon: 1.0e-16
2023-05-14 16:42:00
    exponential_decay: 3.0e-06
2023-05-14 16:42:00
    gradient_clip: 0.001
2023-05-14 16:42:00
    gradient_noise_factor: 0.01
2023-05-14 16:42:00
    graft_to_sign: false
2023-05-14 16:42:00
    learning_rate: 0.01
2023-05-14 16:42:00
    momentum_dtype: float32
2023-05-14 16:42:00
    momentum_type: debiased
2023-05-14 16:42:00
    warmup_end: 16384
2023-05-14 16:42:00
    weight_decay: 0.01
2023-05-14 16:42:00
parameter_usages: {}
2023-05-14 16:42:00
seed: 0
2023-05-14 16:42:00
training:
2023-05-14 16:42:00
    checkpoint_interval: 16384
2023-05-14 16:42:00
    checkpoint_load_path: ''
2023-05-14 16:42:00
    checkpoint_path: gs://homebrewnlp-eu/homebrewnlp-checkpoint
2023-05-14 16:42:00
    debug: false
2023-05-14 16:42:00
    device_steps: 4
2023-05-14 16:42:00
    device_unroll: 1
2023-05-14 16:42:00
    do_checkpoint: false
2023-05-14 16:42:00
    steps: 65536
2023-05-14 16:42:00
    trace:
2023-05-14 16:42:00
        do_trace: false
2023-05-14 16:42:00
        output_path: trace
2023-05-14 16:42:00
        start_step: 16
2023-05-14 16:42:00
        stop_step: 80
2023-05-14 16:42:00
    z_loss: 0.01
2023-05-14 16:42:00
wandb:
2023-05-14 16:42:00
    entity: homebrewnlp
2023-05-14 16:42:00
    group: null
2023-05-14 16:42:00
    id: null
2023-05-14 16:42:00
    median_sizes:
2023-05-14 16:42:00
    - 64
2023-05-14 16:42:00
    - 256
2023-05-14 16:42:00
    - 1024
2023-05-14 16:42:00
    name: null
2023-05-14 16:42:00
    project: gpt
2023-05-14 16:42:00
Initializing dataset..