tomasonjo/text2cypher-demo-16bit
Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:8BQuant:FP8Ctx Length:8kPublished:May 17, 2024License:apache-2.0Architecture:Transformer0.0K Open Weights Warm

The tomasonjo/text2cypher-demo-16bit is an 8 billion parameter Llama-3 instruction-tuned model developed by tomasonjo, fine-tuned using Unsloth for accelerated training. This model specializes in converting natural language questions into Cypher queries based on a provided Neo4j graph schema. It is optimized for efficient inference, making it suitable for applications requiring programmatic interaction with graph databases.

Loading preview...

Overview

The tomasonjo/text2cypher-demo-16bit is an 8 billion parameter language model, developed by tomasonjo, specifically fine-tuned for generating Cypher queries from natural language questions. It is based on the unsloth/llama-3-8b-Instruct model and leverages Unsloth and Huggingface's TRL library for efficient training, resulting in a 2x speed improvement during the finetuning process.

Key Capabilities

  • Natural Language to Cypher Conversion: Translates user questions into executable Cypher queries, given a Neo4j graph schema.
  • Optimized Inference: Utilizes Unsloth's FastLanguageModel.for_inference for enhanced inference speed.
  • Llama-3 Chat Template: Employs the Llama-3 chat template for structured input and output.

Good For

  • Graph Database Interaction: Ideal for applications that require users to query Neo4j graph databases using natural language.
  • Developer Tools: Can be integrated into tools that automate Cypher query generation, reducing manual query writing.
  • Educational Purposes: Useful for demonstrating how LLMs can interface with structured data query languages like Cypher.
Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p