Akshata777/code-llama-3-1-8b-text-to-sql
Akshata777/code-llama-3-1-8b-text-to-sql is a 1 billion parameter language model fine-tuned from meta-llama/Llama-3.2-1B. This model is specifically designed for text-to-SQL generation, leveraging its Llama-3.2 architecture for efficient performance. It is optimized for converting natural language queries into SQL commands, making it suitable for database interaction tasks.
Loading preview...
Overview
This model, Akshata777/code-llama-3-1-8b-text-to-sql, is a specialized language model fine-tuned from the meta-llama/Llama-3.2-1B base model. It is designed with 1 billion parameters and a context length of 32768 tokens, making it capable of processing substantial input for its intended task. The primary focus of this fine-tuned version is to excel in text-to-SQL conversion.
Key Capabilities
- Text-to-SQL Generation: Converts natural language prompts into executable SQL queries.
- Llama-3.2 Architecture: Benefits from the underlying architecture of the Llama-3.2 series for language understanding and generation.
- Efficient Parameter Count: With 1 billion parameters, it offers a balance between performance and computational efficiency for specific tasks.
Training Details
The model was trained using the following key hyperparameters:
- Learning Rate: 0.0002
- Optimizer: Adam with betas=(0.9, 0.999) and epsilon=1e-08
- Epochs: 3
- Batch Size: 1 (with gradient accumulation steps of 8, totaling 8)
Good for
- Applications requiring natural language interaction with databases.
- Automating SQL query generation from user input.
- Developers looking for a compact yet capable model for text-to-SQL tasks.