cuong1692001/Terminal-16k-bottom80

TEXT GENERATIONPricing:Input $0.468 / Output $1.82Concurrent Unit Cost:1Model Size:8BQuant:FP8Context Size:32kTool Calling:SupportedPublished:Aug 18, 2026License:otherArchitecture:Transformer Featherless Exclusive Cold

Terminal-16k-bottom80 is an 8 billion parameter language model developed by cuong1692001, fine-tuned from Terminal_complete_8k. This model was trained on the nemotron_complete_bottom_80_16k dataset, extending its context window to 16k tokens. It is designed for tasks requiring a larger context understanding, building upon its base model's capabilities.

Loading preview...

Model Overview

Terminal-16k-bottom80 is an 8 billion parameter language model, fine-tuned by cuong1692001. It is a specialized iteration of the Terminal_complete_8k base model, specifically adapted using the nemotron_complete_bottom_80_16k dataset. This fine-tuning process has extended its effective context window to 16,000 tokens, making it suitable for processing longer sequences of text.

Key Training Details

The model was trained with the following hyperparameters:

  • Learning Rate: 1e-05
  • Batch Sizes: train_batch_size of 1, eval_batch_size of 8 (total effective batch sizes of 4 and 32 respectively across 4 devices)
  • Optimizer: AdamW_Torch with default betas and epsilon
  • Scheduler: Cosine learning rate scheduler
  • Epochs: 2.0

Intended Use Cases

While specific intended uses and limitations are not detailed in the provided information, its extended 16k context window suggests potential applications in:

  • Long-form content analysis: Summarization, question answering, or generation over extensive documents.
  • Code understanding: Processing larger codebases or complex programming logic.
  • Conversational AI: Maintaining coherence and context over extended dialogues.

Finetunes
1 models