freewheelin/free-solar-evo-v0.11

Hugging Face
TEXT GENERATIONConcurrent Unit Cost:1Model Size:10.7BQuant:FP8Context Size:4kPublished:Apr 24, 2024License:mitArchitecture:Transformer Open Weights Featherless Exclusive Warm

The freewheelin/free-solar-evo-v0.11 is a 10.7 billion parameter language model developed by Freewheelin AI Technical Team. This model is based on the free-solar-evo-model and was developed using a method inspired by the Sakana project's evolutionary model merge. It features a 4096-token context length, making it suitable for tasks requiring moderate context understanding.

Loading preview...

Overview

freewheelin/free-solar-evo-v0.11 is a 10.7 billion parameter language model developed by the Freewheelin AI Technical Team. This model builds upon the free-solar-evo-model as its base. Its development methodology was notably inspired by the Sakana project's evolutionary model merge approach, suggesting a focus on combining or evolving model capabilities.

Key Characteristics

  • Parameter Count: 10.7 billion parameters.
  • Base Model: Utilizes free-solar-evo-model as its foundation.
  • Development Method: Inspired by evolutionary model merging techniques, potentially leading to unique performance characteristics or specialized capabilities.
  • Context Length: Supports a context window of 4096 tokens.

Potential Use Cases

Given its parameter count and development inspiration, this model could be suitable for:

  • General text generation and understanding tasks where a 10B-class model is appropriate.
  • Exploration of tasks that benefit from models developed via evolutionary merging, potentially offering novel solutions or improved robustness in specific domains.
  • Applications requiring moderate context processing due to its 4096-token context window.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p