together-ai

Introducing Together AI/together-ai-8.1b-21b: A New Era in Large Language Models

Tal Peretz

— 1 min read
Introducing Together AI/together-ai-8.1b-21b: A New Era in Large Language Models

Together AI is excited to unveil its latest advancements in the realm of large language models with the introduction of Together AI/together-ai-8.1b-21b. This new model is designed to provide exceptional performance for a variety of AI-driven tasks, while maintaining cost-efficiency and scalability.

Key Features:

  • Cost-Effective: Both input and output are priced at $0.30 per 1 million tokens, ensuring that high-quality AI capabilities are accessible without breaking the bank.
  • High Capacity: The model supports up to 1,000 tokens in a single interaction, making it suitable for complex conversational tasks.
  • Versatile Deployment: Like other models offered by Together AI, Together AI/together-ai-8.1b-21b can be deployed in any environment—whether it's on the cloud or on-premise.

Performance and Optimization:

  • Speed and Efficiency: The Together Enterprise Platform allows for 2-3 times faster inference and up to 50% lower operational costs, thanks to advanced optimization techniques.
  • Together Inference Engine 2.0: This engine delivers decoding throughput 4x faster than open-source alternatives and includes new Turbo and Lite endpoints for varying needs.

Advanced Features:

  • Model Flexibility: The platform supports over 200 models, including custom and open-source options like LLaMA, Platypus2, and WizardLM.
  • Quality and Precision: Features like speculative decoding and quality-preserving quantization ensure high performance without sacrificing quality.

Deployment and Infrastructure:

  • High-Performance Computing: In partnership with Applied Digital, Together AI leverages top-tier hardware like H100 GPUs and NVLink technology.
  • Secure Deployment: Options for deployment in virtual private clouds (VPC), on-premise, or on Together AI's cloud ensure data security and compliance.

With Together AI/together-ai-8.1b-21b, businesses can achieve faster, more efficient, and cost-effective AI operations. For more information or to get started, visit Together AI's official website or contact their support team.

Read more