Aspik101/vicuna-13b-v1.5-PL-lora_unload

Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:13BQuant:FP8Ctx Length:4kPublished:Aug 3, 2023License:otherArchitecture:Transformer0.0K Warm

Aspik101/vicuna-13b-v1.5-PL-lora_unload is a 13 billion parameter language model based on the Llama-2 architecture, fine-tuned specifically for Polish language text generation. This model leverages a LoRA adaptation of Vicuna v1.5, focusing on instruction-following in Polish. Its primary strength lies in generating coherent and contextually relevant text in Polish, making it suitable for applications requiring native Polish language understanding and generation.

Loading preview...

Aspik101/vicuna-13b-v1.5-PL-lora_unload Overview

This model is a 13 billion parameter language model built upon the robust Llama-2 architecture, specifically the Vicuna v1.5 variant. It has undergone a LoRA (Low-Rank Adaptation) fine-tuning process, with a distinct focus on the Polish language. The training utilized the Lajonbot/alpaca-dolly-chrisociepa-instruction-only-polish dataset, indicating an optimization for instruction-following tasks within a Polish linguistic context.

Key Capabilities

  • Polish Language Generation: Excels at producing natural and contextually appropriate text in Polish.
  • Instruction Following: Designed to understand and respond to instructions given in Polish, leveraging its fine-tuning on instruction-based datasets.
  • Llama-2 Foundation: Benefits from the strong base capabilities of the Llama-2 model family, providing a solid foundation for general language understanding.

Good For

  • Polish-centric Applications: Ideal for chatbots, content generation, or summarization tools where the primary language requirement is Polish.
  • Research in Polish NLP: Useful for researchers exploring fine-tuning techniques and performance of large language models on less-resourced languages like Polish.
  • Custom Polish Language Tasks: Developers can further fine-tune this model for specific Polish language tasks that require instruction adherence.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p