zjunlp/OceanGPT-o-7B

VISIONPricing:Input $0.4 / Output $0.8Concurrent Unit Cost:1Model Size:7BQuant:FP8Context Size:32kPublished:Apr 25, 2024License:mitArchitecture:Transformer0.0K Open Weights Featherless Exclusive Cold

OceanGPT-o-7B by zjunlp is a 7 billion parameter large language model based on Qwen2.5-VL, specifically fine-tuned for ocean science tasks. It has been trained on a specialized English and Chinese dataset within the ocean domain, offering a 32768 token context length. This model excels at processing and generating natural language related to oceanography, including the interpretation of certain sonar and ocean science images.

Loading preview...

OceanGPT-o-7B: Specialized LLM for Ocean Science

OceanGPT-o-7B, developed by zjunlp, is a 7 billion parameter large language model built upon the Qwen2.5-VL architecture. It is uniquely specialized for ocean science tasks, having undergone training on a dedicated English and Chinese dataset focused on the ocean domain. This model supports a substantial context length of 32768 tokens.

Key Capabilities

  • Ocean Domain Expertise: Fine-tuned with extensive ocean-related data, enabling it to understand and generate content pertinent to ocean science.
  • Multimodal Input: Based on Qwen2.5-VL, it can process visual inputs, specifically certain types of sonar and ocean science images, alongside text.
  • Natural Language Generation: Capable of generating natural language responses for queries within the oceanographic field.

Limitations and Considerations

  • Hallucination: Like many LLMs, it may exhibit hallucination issues.
  • Image Support: Currently, it primarily supports natural language generation for specific types of sonar and ocean science images due to resource constraints.
  • Identity: The model's identity may reflect characteristics of its base models (Qwen/MiniCPM/LLaMA/GPT series).
  • Prompt Sensitivity: Output can be influenced by prompt tokens, potentially leading to inconsistent results across attempts.

For more details, refer to the project page and the associated research paper.