ai21-labs

Introducing Bedrock's AI21 Jamba 1.5 Mini: Advanced LLM for Efficient Long-Context Tasks

Tal Peretz

— 1 min read
Introducing Bedrock's AI21 Jamba 1.5 Mini: Advanced LLM for Efficient Long-Context Tasks

The AI21 Labs' Jamba 1.5 models, now available on Amazon Bedrock, represent a significant advancement in handling long-context language tasks. Among these, the ai21.jamba-1.5-mini-v1:0 stands out for its efficiency and speed, making it ideal for developers looking to maximize performance in applications like document summarization and retrieval-augmented generation (RAG) workflows.

Key Features

  • Long Context Handling: With a 256K token context window, the Jamba 1.5 Mini is perfectly suited for tasks involving lengthy documents, ensuring comprehensive analysis and summarization capabilities.
  • Multilingual Support: Seamlessly operate across multiple languages including English, Spanish, French, and more, offering expansive versatility for global applications.
  • Developer-Friendly: Supports structured JSON output and function calling, facilitating easy integration into existing workflows and enhancing developer productivity.
  • Speed and Efficiency: Delivers up to 2.5 times faster inference on long contexts compared to similar models, reducing latency and accelerating task completion.

Model Architecture

The Jamba 1.5 Mini employs a hybrid architecture, combining transformer models with Structured State Space model (SSM) technology. This approach optimizes handling of extensive context windows without sacrificing performance.

Availability and Configuration

Available in the Amazon Bedrock console in the US East (N. Virginia) AWS Region, accessing the Jamba 1.5 Mini is straightforward. Navigate to the console, select "Model access," and request access. Test the model via the "Text" or "Chat" playgrounds to witness its capabilities firsthand. Configuration options include adjusting max_tokens, temperature, top_p, and more to tailor the model's output to specific needs.

Use Cases

Ideal for applications such as compliance analysis and paired document analysis, the Jamba 1.5 Mini excels at understanding and processing long documents. Whether comparing multiple sources or verifying adherence to guidelines, it ensures precise and reliable results.

In summary, the AI21 Jamba 1.5 Mini on Amazon Bedrock offers a powerful solution for developers seeking an efficient, multilingual model capable of handling extensive text contexts with speed and accuracy. Explore its potential today and enhance your long-context AI applications.

Read more