defog/llama-3-sqlcoder-8b

Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:8BQuant:FP8Ctx Length:8kPublished:May 9, 2024License:cc-by-sa-4.0Architecture:Transformer0.3K Open Weights Warm

defog/llama-3-sqlcoder-8b is an 8 billion parameter language model developed by Defog, Inc., fine-tuned from Meta-Llama-3-8B-Instruct. This model is specifically optimized for text-to-SQL generation, excelling in converting natural language questions into SQL queries for PostgreSQL, Redshift, and Snowflake databases. It offers performance on par with leading generalist frontier models for SQL generation tasks, making it highly effective for database interaction. The model has a context length of 8192 tokens.

Loading preview...

Overview

defog/llama-3-sqlcoder-8b is an 8 billion parameter language model developed by Defog, Inc., specifically fine-tuned from Meta-Llama-3-8B-Instruct for text-to-SQL generation. It is designed to translate natural language questions into accurate SQL queries for various database systems.

Key Capabilities

  • Text-to-SQL Generation: Converts user questions into SQL queries.
  • Database Support: Optimized for PostgreSQL, Redshift, and Snowflake.
  • Performance: Achieves performance comparable to highly capable generalist frontier models in its specialized domain.
  • Evaluation: Evaluated using SQL-Eval, a PostgreSQL-based framework developed by Defog for testing and aligning model capabilities.

Ideal Usage

This model is best utilized with a temperature setting of 0 and without sampling to ensure deterministic and accurate SQL query generation. The recommended prompt structure includes the user's question, optional instructions, and DDL statements to provide necessary schema context.

Good For

  • Developers and data professionals needing to automate SQL query generation from natural language.
  • Applications requiring robust and accurate database interaction for PostgreSQL, Redshift, or Snowflake.
  • Integrating natural language interfaces with SQL databases.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p