Overview

yamatazen/EtherealAurora-12B is a ChatML-compatible language model developed by yamatazen. It is a product of a sophisticated merge operation, utilizing the Model Stock method, which combines multiple pre-trained language models to enhance overall performance and capabilities. The base model for this merge was yamatazen/Aurora-SCE-12B.

Merge Details

This model was constructed by merging the following components:

• Base Model: yamatazen/Aurora-SCE-12B
• Merged Models:
  • yamatazen/Ayla-Light-12B-Stock
  • yamatazen/EtherealLight-12B
  • yamatazen/Aurora-SCE-12B-v2

The merge process was configured to use bfloat16 data type and included parameter normalization, as specified in the mergekit configuration. This approach aims to consolidate the strengths of its constituent models into a single, versatile ChatML-ready model.

Intended Use

EtherealAurora-12B is primarily intended for ChatML-based conversational applications. Its merged architecture suggests a broad range of general-purpose chat capabilities, making it suitable for various interactive text generation tasks.