claude-3-haiku

Introducing Claude 3 Haiku: The Fastest and Most Compact Model in the Claude 3 Family

Tal Peretz

— 1 min read
Introducing Claude 3 Haiku: The Fastest and Most Compact Model in the Claude 3 Family

We are excited to introduce Claude 3 Haiku, the latest and most advanced model in the Claude 3 family, now available on Amazon Bedrock. This model, identified by anthropic.claude-3-haiku-20240307-v1:0, is designed for near-instant responsiveness and seamless generative AI experiences.

Here’s a quick overview of Claude 3 Haiku:

Key Features

  • Speed: As the fastest model in the Claude 3 family, Claude 3 Haiku can read a data-dense research paper (approximately 10,000 tokens) with charts and graphs in less than three seconds.
  • Steerability: It offers increased steerability with a 200,000 context window, allowing for more controlled and precise outputs.
  • Image-to-Text Vision: Like other Claude 3 models, Haiku includes image-to-text vision capabilities and supports multiple languages besides English.
  • Use Cases: Ideal for customer interactions, content moderation, optimized logistics, inventory management, and fast knowledge extraction from unstructured data.

Usage

To start using Claude 3 Haiku, follow these steps:

  1. Set up an AWS profile and configure the AWS CLI.
  2. Request access to the model through the AWS Bedrock console.
  3. Ensure you have the necessary permissions: bedrock:InvokeModel, bedrock:InvokeModelWithResponseStream, bedrock:ListFoundationModels, and bedrock:GetFoundationModel.
  4. Use AWS SDKs (like boto3 for Python) or the Anthropic client SDKs to make API calls. Here’s an example using Python:
from anthropic import AnthropicBedrock

client = AnthropicBedrock(
    aws_access_key="<access key>",
    aws_secret_key="<secret key>",
    aws_region="us-west-2",
)

message = client.messages.create(
    model="anthropic.claude-3-haiku-20240307-v1:0",
    max_tokens=256,
    messages=[{"role": "user", "content": "Hello, world"}]
)

print(message.content)

Additional Information

Availability: Claude 3 Haiku is available on Amazon Bedrock and its availability varies by region. Access to the model must be requested through the AWS Bedrock console.

Comparison: Claude 3 Haiku is smarter, faster, and more affordable than other models in its intelligence category, making it suitable for quick and accurate targeted performance.

For detailed setup and usage instructions, refer to the AWS documentation and the Anthropic client SDKs.

Read more