Sakalti/magro-7B

TEXT GENERATIONPricing:Input $0.4 / Cached $0.08 / Output $0.8Concurrent Unit Cost:1Model Size:7BQuant:FP8Context Size:4kTool Calling:SupportedPublished:Dec 11, 2024License:mitArchitecture:Transformer0.0K Open Weights Featherless Exclusive Cold

Sakalti/magro-7B is a 7 billion parameter Mistral-based language model developed by Sakalti, fine-tuned from HuggingfaceH4/zephyr-7b-beta. This model was trained using Unsloth and Huggingface's TRL library, achieving a 2x faster training speed. It is designed for general language generation tasks, offering efficient performance due to its optimized training process.

Loading preview...

Overview

Sakalti/magro-7B is a 7 billion parameter language model developed by Sakalti, building upon the HuggingfaceH4/zephyr-7b-beta model. This model leverages the Mistral architecture and was fine-tuned with a focus on training efficiency.

Key Capabilities

  • Efficient Training: Achieved 2x faster training speeds by utilizing Unsloth and Huggingface's TRL library.
  • General Language Generation: Suitable for a wide range of natural language processing tasks.
  • Mistral-based Architecture: Benefits from the robust and performant Mistral model family.

Good for

  • Developers seeking a 7B parameter model with an optimized training history.
  • Applications requiring efficient language generation based on the Mistral architecture.
  • Experimentation with models fine-tuned using Unsloth for faster iteration.

Finetunes
2 models