Kquant03/Samlagast-7B-laser-bf16

TEXT GENERATIONConcurrency Cost:1Model Size:7BQuant:FP8Ctx Length:8kPublished:Feb 16, 2024License:apache-2.0Architecture:Transformer0.0K Open Weights Cold

Kquant03/Samlagast-7B-laser-bf16 is a 7 billion parameter language model created by Kquant03, merged using the task arithmetic method with paulml/NeuralOmniBeagleMBX-v3-7B as its base. This model integrates components from flemmingmiguel/MBX-7B-v3, paulml/NeuralOmniWestBeaglake-7B, and FelixChao/Faraday-7B. It is designed to explore the effects of merging multiple pre-trained models, offering a unique blend of their capabilities within an 8192 token context length.

Loading preview...

Samlagast-7B-laser-bf16: A Merged Language Model

Samlagast-7B-laser-bf16 is a 7 billion parameter language model developed by Kquant03, leveraging the "laser" technique by NeuralNovel. This model was constructed using the task arithmetic merge method, with paulml/NeuralOmniBeagleMBX-v3-7B serving as the foundational base model.

Key Merged Components

The model integrates the strengths of several distinct pre-trained language models, combined with equal weighting during the merge process. The constituent models include:

  • flemmingmiguel/MBX-7B-v3
  • paulml/NeuralOmniWestBeaglake-7B
  • FelixChao/Faraday-7B

This merging strategy aims to synthesize the diverse capabilities present in each of these models into a single, cohesive unit. The merge configuration utilized int8_mask and normalize parameters, with the output dtype set to float16.

Purpose and Use

The primary purpose of Samlagast-7B-laser-bf16 is to investigate the outcomes and potential synergies of combining multiple models through advanced merging techniques. Developers can explore its performance across various tasks, benefiting from the blended characteristics of its source models. It offers an 8192 token context length, suitable for a range of generative and analytical applications.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p