vertex-ai

Introducing Vertex AI's New LLM: Code-Bison32k

Tal Peretz

Jun 27, 2024 — 1 min read

Google Cloud's Vertex AI has unveiled a new addition to its PaLM family of models: the Vertex AI PaLM 2 for Text 32k (text-bison-32k). This model is designed to handle a variety of language tasks, including classification, summarization, and extraction, all while following natural language instructions with precision.

Key Features

Maximum Tokens: With the ability to support up to 32,768 tokens (input + output), and a maximum output of 8,192 tokens, text-bison-32k is primed for complex tasks requiring extensive input and output.
Training Data: The model has been trained on data up to August 2023, ensuring it incorporates the latest linguistic trends and information.

Tuning and Usage

The model supports supervised tuning, allowing you to fine-tune it for specific tasks. However, it does not support reinforcement learning from human feedback (RLHF) or distillation at this stage.

To use this model via the Python SDK, import it from the vertexai.preview.language_models module:

from vertexai.preview.language_models import text_bison_32k

This step is crucial to avoid errors related to its preview status.

Important Considerations

Currently, the model is in the preview stage, which may mean limited stability and support across different environments. While it is not yet classified as a legacy model, it belongs to a model family that could eventually be discontinued in favor of more stable versions.

Conclusion

Vertex AI's text-bison-32k offers a robust solution for various language tasks, backed by the latest training data and capable of handling large token counts. For more detailed guidance, refer to the official Vertex AI documentation and tutorials.

Unleashing Creativity with Stability.SD3-Large-V1:0 on Amazon Bedrock

The advent of Stability.SD3-Large-V1:0, a revolutionary text-to-image model, marks a significant milestone in the realm of generative AI. Integrated into Amazon Bedrock, this model is designed to transform how digital assets are created, offering unparalleled performance and quality in image generation. Model Architecture and Performance At the heart

Unlocking the Potential of Bedrock/Meta-Textgeneration-Llama-2-7B with AWS SageMaker

The Bedrock/Meta-Textgeneration-Llama-2-7B is a cutting-edge Large Language Model (LLM) developed by Meta as part of the Llama 2 series. This series ranges from 7 billion to 70 billion parameters, with the 7B model offering a balance of size and capability. Its development involved Supervised Fine-Tuning (SFT) and Reinforcement Learning

Exploring Azure AI's Phi-3-Medium-128K-Instruct: A Revolutionary LLM

Azure AI's Phi-3-Medium-128K-Instruct is a breakthrough in the field of language models, bringing forth a dense decoder-only Transformer model with 14 billion parameters. This model, part of Microsoft's Phi-3 family, stands out for its impressive performance across a wide range of benchmarks, making it a go-to

Unlocking the Potential of Azure AI's Phi-3.5-MoE-Instruct: A New Era in Artificial Intelligence

The Azure AI Phi-3.5-MoE-Instruct model, a groundbreaking addition to Microsoft's Phi-3.5 series, is revolutionizing the landscape of artificial intelligence with its innovative architecture and impressive capabilities. Model Architecture At the heart of the Phi-3.5-MoE-Instruct is the Mixture-of-Experts (MoE) model architecture, which includes 16 experts, each