cathuriges/tigerlily-r3

VISIONConcurrency Cost:1Model Size:12BQuant:FP8Ctx Length:32kArchitecture:Transformer0.0K Cold

The cathuriges/tigerlily-r3 is a 12 billion parameter language model created by cathuriges, merged using the Task Arithmetic method. Based on grimjim/gemma-3-12b-it-norm-preserved-biprojected-abliterated, it combines 'tame-tiger' and 'withered-calla' models. This model is a result of an iterative merging process, aiming for improved performance over its predecessor, R2.

Loading preview...

Overview

The cathuriges/tigerlily-r3 model is a 12 billion parameter language model developed by cathuriges. It was created through a merging process using mergekit, specifically employing the Task Arithmetic method.

Merge Details

This model is an iteration building upon an unpublished 'R2' version, indicating a continuous development effort. The base model for this merge was grimjim/gemma-3-12b-it-norm-preserved-biprojected-abliterated.

Constituent Models

The tigerlily-r3 model integrates components from two distinct pre-trained language models:

  • tame-tiger
  • withered-calla

These models were combined with specific weighting parameters (0.75 for tame-tiger and 1 for withered-calla) to achieve the desired characteristics. The merge process also included normalization of parameters.

Use Cases

As a merged model, tigerlily-r3 is intended for general language generation and understanding tasks, leveraging the combined strengths of its constituent models and the base model.