codestral

Codestral: The Latest LLM from Mistral AI Revolutionizing Code Generation

Tal Peretz

— 1 min read
Codestral: The Latest LLM from Mistral AI Revolutionizing Code Generation

Mistral AI's newest large language model, Codestral, is making waves in the world of code generation. Designed specifically for coding tasks, Codestral boasts impressive features and capabilities that set it apart from other models.

Model Size and Training

Codestral is a 22 billion parameter open-weight generative AI model. Trained on a diverse dataset encompassing over 80 programming languages, including Python, Java, C, C++, JavaScript, Swift, Fortran, and Bash, Codestral is equipped to handle a wide range of coding scenarios.

Capabilities

Whether you're looking to generate code from scratch, complete coding functions, write tests, or fill in partial code, Codestral has you covered. Its fill-in-the-middle mechanism is particularly noteworthy for completing partial code snippets efficiently.

Endpoints and Usage

Two main endpoints are available for accessing Codestral:

  • codestral.mistral.ai: Ideal for integrating into IDE plugins or applications where users bring their own API keys. This endpoint is currently free during an 8-week beta period, with a rate limit of 30 requests per minute and a daily limit of 2000 requests.
  • api.mistral.ai: Suited for research, batch queries, or third-party application development. It supports existing API keys and offers higher rate limits.

Licensing

Codestral operates under the Mistral AI Non-Production License, making it perfect for research and testing. Commercial licenses are available upon request for those needing commercial use.

Performance

Codestral outperforms other code-centric models like CodeLlama 70B, Deepseek Coder 33B, and Llama 3 70B across several benchmarks, including RepoBench, HumanEval, and CruxEval. Its prowess in generating code for multiple programming languages, such as Python, Java, C, C++, and SQL, is particularly impressive.

Availability

Codestral can be downloaded from HuggingFace, accessed through the dedicated endpoint codestral.mistral.ai, or the general API endpoint api.mistral.ai. Additionally, it is available via Le Chat, Mistral AI's free conversational interface.

Community Feedback

Industry partners like JetBrains, SourceGraph, and Tabnine have praised Codestral for its performance, speed, and accuracy in code generation tasks. Their positive feedback underscores the model's potential to revolutionize coding workflows.

Read more