codellama/CodeLlama-70b-Instruct-hf

TEXT GENERATIONConcurrency Cost:4Model Size:69BQuant:FP8Ctx Length:32kPublished:Jan 29, 2024License:llama2Architecture:Transformer0.2K Open Weights Cold

CodeLlama-70b-Instruct-hf is a 69 billion parameter instruction-tuned generative text model developed by Meta, part of the Code Llama family. This model is specifically designed for general code synthesis and understanding, excelling at code completion and following instructions for code-related tasks. It utilizes an optimized transformer architecture with a context length of 32768 tokens, making it suitable for complex programming challenges.

Loading preview...

CodeLlama-70b-Instruct-hf Overview

CodeLlama-70b-Instruct-hf is a 69 billion parameter instruction-tuned model from Meta's Code Llama collection, optimized for code-related tasks. This specific variant is fine-tuned for instruction following and safer deployment in code assistant and generation applications. It is built upon an optimized transformer architecture and supports a substantial context length of 32768 tokens.

Key Capabilities

  • Code Completion: Generates relevant code snippets to complete partial code.
  • Instruction Following: Responds to natural language instructions for coding tasks, making it suitable for chat-based code assistants.
  • Code Understanding: Designed for general comprehension of programming logic and structure.

Intended Use Cases

This model is intended for commercial and research use in English and relevant programming languages. It is particularly well-suited for:

  • Developing code assistant tools.
  • Generating code based on natural language prompts.
  • Assisting with code understanding and synthesis tasks.

Meta developed the Code Llama family, with this 70B Instruct version being one of the largest and most capable. More details can be found in the research paper "Code Llama: Open Foundation Models for Code".