cohere

Unveiling Cohere Chat/Command-R-08-2024: The Future of Generative AI

Tal Peretz

Sep 11, 2024 — 2 min read

The latest update to Cohere's generative AI model series, Cohere Chat/Command-R-08-2024, brings a host of new features and improvements designed to elevate the performance and utility of AI. Here's what you need to know about this groundbreaking model.

Model Overview

Model Size: 35 billion parameters
Context Length: 128K
Languages: Trained on 23 languages and evaluated in 10 languages
Developers: Developed by Cohere and Cohere For AI

Key Features and Improvements

Performance Enhancements

Improved performance for multilingual retrieval-augmented generation (RAG) and tool use
Enhanced capabilities in math, code, and reasoning, competitive with the previous Command R+ model
50% higher throughput and 20% lower latencies compared to the previous Command R version, with a reduced hardware footprint

Tool Use Capabilities

Enhanced decision-making around tool use, including the ability to abstain from using tools when necessary
Supports Hugging Face's tool use API

Safety Modes

Introducing Safety Modes (currently in beta) with two distinct modes:

STRICT: Avoids all sensitive topics, ideal for general and enterprise use
CONTEXTUAL: Allows wide-ranging interactions with fewer constraints while maintaining core protections, suitable for entertainment, creative, and educational use

Other Improvements

Improved instruction following in the preamble
Enhanced multilingual RAG searches
Better structured data analysis and creation
Improved robustness to non-semantic prompt changes
Models decline unanswerable questions and have improved citation quality

Usage and Integration

The model can be easily integrated using the Hugging Face Transformers library, with a specific template for tool use prompts. Pricing is set at $0.15 per million input tokens and $0.60 per million output tokens.

Licensing and Access

The model is licensed under CC-BY-NC and adheres to C4AI's Acceptable Use Policy. It is hosted on Hugging Face and can be accessed via the `transformers` library.

Technical Details

Model ID: CohereForAI/c4ai-command-r-08-2024
Required Library Version: transformers version 4.39.1 or higher

Cohere Chat/Command-R-08-2024 is designed to excel in various tasks, including reasoning, summarization, and question answering, with significant advancements in tool use and safety features. This model is a valuable asset for developers looking to leverage state-of-the-art generative AI capabilities.

Introducing Gemini 1.5 Flash: A High-Speed, Efficient LLM from Google

Google has unveiled the latest addition to its Gemini family, the Gemini 1.5 Flash model. This new large language model (LLM) is designed to offer high-speed and efficient performance, tailored for high-volume applications. Here's a closer look at what makes this model stand out. Key Features and

Introducing Claude 3.5 Sonnet: The Pinnacle of Intelligence in the Claude Family

Introducing Claude 3.5 Sonnet: The Pinnacle of Intelligence in the Claude Family The Claude 3.5 Sonnet is the latest marvel from Anthropic, setting a new standard in the realm of large language models. Let's delve into why this model stands out. Model Description Claude 3.5

Introducing OpenAI's O1-Preview-2024-09-12: The Next Leap in AI Reasoning

OpenAI has unveiled a groundbreaking series of AI models, the O1, designed to enhance reasoning capabilities and tackle complex tasks more effectively. The O1-preview and O1-mini models are now available starting September 12, 2024, for ChatGPT Plus and Team subscribers, with ChatGPT Enterprise and Edu users gaining access next week.

Introducing OpenAI o1: The Next Generation Language Model

OpenAI has recently unveiled its latest language model, known as o1 or Strawberry, which brings a host of new features and capabilities to the field of artificial intelligence. In this blog post, we'll explore the key aspects of this cutting-edge model and its potential applications. Key Features and