modrill/mhm_ties__merge_experiments_math_think_11_ties_density_0p50

TEXT GENERATIONConcurrency Cost:1Model Size:4BQuant:BF16Ctx Length:32kTool Calling:SupportedPublished:May 21, 2026License:cc-by-nc-4.0Architecture:Transformer Open Weights Cold

modrill/mhm_ties__merge_experiments_math_think_11_ties_density_0p50 is a 4 billion parameter language model. This model is an upload from a local merge matrix, specifically from the 'math_think_11' experiment using the TIES merging method with a density of 0.50. Its primary characteristic is being a result of a specific merging experiment, indicating a focus on exploring model combination techniques.

Loading preview...

Overview

This model, modrill/mhm_ties__merge_experiments_math_think_11_ties_density_0p50, is a 4 billion parameter language model. It represents an upload from a local merge matrix, originating from the math_think_11 experiment. The model was created using the TIES merging method with a density of 0.50, suggesting it is an experimental artifact designed to explore the effects of model merging strategies.

Key Characteristics

  • Parameter Count: 4 billion parameters.
  • Context Length: 32768 tokens.
  • Origin: Derived from a local merge matrix experiment.
  • Merging Method: Utilizes the TIES (Trimmed, Iterative, and Selective) merging technique.
  • Density: Specifically configured with a 0.50 density during the TIES merge.

Potential Use Cases

  • Research: Ideal for researchers studying model merging techniques, particularly the TIES method and its impact on model performance and characteristics.
  • Experimentation: Can be used as a base for further experiments in model combination and optimization.
  • Analysis: Suitable for analyzing the effects of different merging densities on language model capabilities.

Finetunes
1 models