YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
{
    "cache_dir": "/leonardo_work/EUHPC_E03_068/.cache",
    "method": "orpo",
    "dataset": "autoredteam",
    "model": "meta-llama/Meta-Llama-3-8B",
    "tokenizer": "meta-llama/Meta-Llama-3-8B",
    "lr": 0.01,
    "train_batch_size": 2,
    "eval_batch_size": 2,
    "num_epochs": 7,
    "seed": 42,
    "eval_only": false,
    "evaluation_size": 100,
    "experiment_name": "seven_epochs_train_experiment-2",
    "experiment_group": "results",
    "reference_model": "meta-llama/Meta-Llama-3-8B-Instruct",
    "context_length": 512,
    "train_summarization": "",
    "dpo_beta": 0.1,
    "orpo_beta": 0.1,
    "kl_coef": 0.0,
    "reward_model": "",
    "bestofn_size": 4,
    "train_reward_model": ""
}
Downloads last month
19
Safetensors
Model size
8.03B params
Tensor type
BF16
·
Inference API
Unable to determine this model's library. Check the docs .