Jobs
job-https___github.com_HomebrewNLP_HomebrewNLP-Jax_main.py
Job
322 versions
2 years ago
Job version
v316
Version metadata
Version path
homebrewnlp/gpt/job-https___github.com_HomebrewNLP_HomebrewNLP-Jax_main.py:v316
Description
What makes this job version special?
Aliases
v316
Creator
clashlukeCreation date
May 15th 2023 at 9:51pm
Python version
3.8.5
Entry point
python3 main.py
Arguments
N/A
Source type
Artifact link
Input types
Key
Value
data
datasets_used_per_step
number
deterministic
boolean
interleaved_datasets
number
parallel_workers
number
path
string
prefetch_buffer
number
seed
number
shuffle_buffer_gb
number
dims
batch
number
depth
number
features
number
memory_features
number
memory_heads
number
memory_slots
number
memory_slots_per_head
number
pointwise_features
number
sequence
number
vocab
number
fail_on_missing_parameter
boolean
global_prefix
string
model
autoregressive
boolean
computation_dtype
string
norm
eps
number
storage_dtype
string
name_cache_offsets
optimizer
adam_beta1
number
adam_beta2
number
epsilon
number
exponential_decay
number
gradient_clip
number
gradient_noise_factor
number
graft_to_sign
boolean
learning_rate
number
momentum_dtype
string
momentum_type
string
warmup_end
number
weight_decay
number
parameter_usages
seed
number
training
checkpoint_interval
number
checkpoint_load_path
string
checkpoint_path
string
debug
boolean
device_steps
number
device_unroll
number
do_checkpoint
boolean
steps
number
trace
do_trace
boolean
output_path
string
start_step
number
stop_step
number
z_loss
number
wandb
entity
string
group
string
id
string
median_sizes
list
name
string
project
string
Output types
Key
Value
Accuracy
Current
number
Median64
number
Median256
number
Median1024
number
Loss
Current
number
Median64
number
Median256
number
Median1024
number
Optimizer
Learning Rate
number
Speed
Batches per Second
number
Parameters * Tokens per Day
number
Tokens per Day
number
Tokens Seen
number
_runtime
number
_step
number
_timestamp
number
Files
Root
Name
Size
Type
requirements.frozen.txt
2.8KB
Plain Text
wandb-job.json
11.9KB
JSON Document
Loading...