Overview

Evan768/testEvan is a 7 billion parameter language model, fine-tuned from the meta-llama/Llama-2-7b-chat-hf base model. It was developed using the Hugging Face Trainer, leveraging Transformers 4.47.1 and Pytorch 2.5.1+cu118.

Training Details

The model underwent a fine-tuning process with the following key hyperparameters:

• Learning Rate: 2e-05
• Batch Size: 4 (for both training and evaluation)
• Epochs: 3
• Optimizer: AdamW with default betas and epsilon
• LR Scheduler: Linear

Key Characteristics

• Base Model: Meta Llama-2-7b-chat-hf
• Parameter Count: 7 billion
• Context Length: 4096 tokens

Limitations

Specific details regarding the training dataset, intended uses, and limitations are not provided in the model card. Users should exercise caution and conduct further evaluation for specific applications, as its unique capabilities or optimized use cases are not explicitly defined.