EtherealAurora-12B by yamatazen is a ChatML-compatible language model created through a merge of several pre-trained models using the Model Stock method. It leverages yamatazen/Aurora-SCE-12B as its base, integrating yamatazen/Ayla-Light-12B-Stock, yamatazen/EtherealLight-12B, and yamatazen/Aurora-SCE-12B-v2. This model is designed for general chat applications, combining the strengths of its constituent models for diverse conversational capabilities.
Loading preview...
Overview
yamatazen/EtherealAurora-12B is a ChatML-compatible language model developed by yamatazen. It is a product of a sophisticated merge operation, utilizing the Model Stock method, which combines multiple pre-trained language models to enhance overall performance and capabilities. The base model for this merge was yamatazen/Aurora-SCE-12B.
Merge Details
This model was constructed by merging the following components:
- Base Model: yamatazen/Aurora-SCE-12B
- Merged Models:
The merge process was configured to use bfloat16 data type and included parameter normalization, as specified in the mergekit configuration. This approach aims to consolidate the strengths of its constituent models into a single, versatile ChatML-ready model.
Intended Use
EtherealAurora-12B is primarily intended for ChatML-based conversational applications. Its merged architecture suggests a broad range of general-purpose chat capabilities, making it suitable for various interactive text generation tasks.
Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.