Search the Community

Agents for Amazon Bedrock enable developers to create generative AI-based applications that can complete complex tasks for a wide range of use cases and deliver answers based on company knowledge sources. In order to complete complex tasks, with high accuracy, reasoning capabilities of the underlying foundational model (FM) play a critical role. View the full article

Earlier this month, we shared the news that Anthropic’s Claude 3 family of models would soon be available to Google Cloud customers on Vertex AI Model Garden. Today, we’re announcing that Claude 3 Sonnet and Claude 3 Haiku are generally available to all customers on Vertex AI. Claude 3 Opus, Anthropic’s most capable and intelligent model to date, will also be available on Vertex AI in the coming weeks. Claude 3 Sonnet can help save time writing code or parsing text from images, excels at data-processing tasks like search and retrieval, and supports use cases like product recommendations, forecasting, and targeted marketing. Claude 3 Haiku is a great option for building quick and accurate customer interactions, applying content moderation, optimizing logistics, managing inventory, extracting knowledge from unstructured data, and more. In this blog post, we'll share how Google Cloud simplifies working with Anthropic’s newest models, highlight what our customers are saying, and provide a guide for getting started with Claude 3 on Vertex AI. Why use Claude 3 models on Google Cloud Vertex AI Model Garden includes over 130 models, from cutting-edge frontier models like Claude 3 and Google’s Gemini model family, to open models such as Llama 2 from Meta, Mixtral 8x7B from Mistral AI, and many more. This variety of leading models, in addition to a deep set of model development and deployment tools, makes Vertex AI the comprehensive, enterprise-ready destination for working at scale with generative foundation models like Claude 3: Flexibility and choice: Experimentation and optionality are crucial when balancing generative AI capabilities against budgetary constraints. Through Vertex AI, we are committed to providing customers a range of models and tools to enable greater flexibility and choice. Whether customers need large models for complex analysis, lighter models for powering conversational experiences at scale, or anything in between, Vertex AI allows customers to test, compare, and build with generative AI applications for their specific use case. Built-in data privacy, security, and governance: With Vertex AI, data privacy and security are built-in. Customers control their data — which Google Cloud has committed to not use for model training, and is not shared with model providers. Google Cloud offers robust regional availability to meet various data residency requirements, Identity and Access Management (IAM) tools to create and manage permissions for access to foundational models, and a host of other enterprise-grade features. Customers interact with Claude 3 API endpoints on Vertex AI the same way they interact with other Vertex AI endpoints, making Anthropic's newest offerings simple for customers to integrate. Ease of use: Claude 3 is offered as a serverless, managed API on Vertex AI, meaning customers don't have to worry about managing the underlying infrastructure. The pay-as-you-go pricing model and auto-scaling abilities help organizations optimize costs and easily go from experimentation to deploying production-grade generative AI applications at speed. Hear what customers are saying Enterprises are excited to adopt Claude 3 on Vertex AI for a wide range of use cases, including enhancing customer chats, automating task handling, generating code, and much more: GitLab: “GitLab’s AI-powered DevSecOps platform embeds AI throughout the entire software development lifecycle with a privacy- and transparency-first approach,” said Hillary Benson, senior director, product management at GitLab. “By leveraging Anthropic’s Claude models on Vertex AI, we look forward to helping customers harness the benefits of AI to deliver secure software faster.” Poe by Quora: “At Poe, we’re helping shape how people interact with AI, providing millions of global users with one place to chat, explore and build with a wide variety of AI-powered bots,” said Spencer Chan, Product Lead at Poe by Quora. “Claude has become very popular on Poe due to its strengths in multiple areas, including creative writing and image understanding. Our users describe Claude's answers as detailed and easily understood, and they like that exchanges feel like natural conversations. With millions of messages exchanged between our users and Anthropic’s Claude-based bots daily, we’re excited to work with Anthropic’s Claude 3 models on Vertex AI.” How to get started with Claude 3 on Vertex AI Get access to the Claude 3 Sonnet and Claude 3 Haiku models by following these simple steps: Visit the Vertex AI Model Garden console and select the model tile for Claude 3 Sonnet or Claude 3 Haiku. Click on the “Enable” button and follow the proceeding instructions. That’s it – you now have immediate access to the selected Claude 3 model. Click the “View code” button to obtain sample code or use the built-in colab notebook to start querying Claude 3 models on Vertex AI. To learn more about Anthropic's Claude 3 models on Google Cloud, explore the Claude 3 on Vertex AI documentation. Customers can also find the Claude 3 Sonnet and Claude 3 Haiku models on Google Cloud Marketplace. View the full article

Last week, Anthropic announced their Claude 3 foundation model family. The family includes three models: Claude 3 Haiku, the fastest and most compact model for near-instant responsiveness; Claude 3 Sonnet, the ideal balanced model between skills and speed; and Claude 3 Opus, the most intelligent offering for top-level performance on highly complex tasks. AWS also announced the general availability of Claude 3 Sonnet in Amazon Bedrock. Today, we are announcing the availability of Claude 3 Haiku on Amazon Bedrock. The Claude 3 Haiku foundation model is the fastest and most compact model of the Claude 3 family, designed for near-instant responsiveness and seamless generative artificial intelligence (AI) experiences that mimic human interactions. For example, it can read a data-dense research paper on arXiv (~10k tokens) with charts and graphs in less than three seconds. With Claude 3 Haiku’s availability on Amazon Bedrock, you can build near-instant responsive generative AI applications for enterprises that need quick and accurate targeted performance. Like Sonnet and Opus, Haiku has image-to-text vision capabilities, can understand multiple languages besides English, and boasts increased steerability in a 200k context window. Claude 3 Haiku use cases Claude 3 Haiku is smarter, faster, and more affordable than other models in its intelligence category. It answers simple queries and requests with unmatched speed. With its fast speed and increased steerability, you can create AI experiences that seamlessly imitate human interactions. Here are some use cases for using Claude 3 Haiku: Customer interactions: quick and accurate support in live interactions, translations Content moderation: catch risky behavior or customer requests Cost-saving tasks: optimized logistics, inventory management, fast knowledge extraction from unstructured data To learn more about Claude 3 Haiku’s features and capabilities, visit Anthropic’s Claude on Amazon Bedrock and Anthropic Claude models in the AWS documentation. Claude 3 Haiku in action If you are new to using Anthropic models, go to the Amazon Bedrock console and choose Model access on the bottom left pane. Request access separately for Claude 3 Haiku. To test Claude 3 Haiku in the console, choose Text or Chat under Playgrounds in the left menu pane. Then choose Select model and select Anthropic as the category and Claude 3 Haiku as the model. To test more Claude prompt examples, choose Load examples. You can view and run examples specific to Claude 3 Haiku, such as advanced Q&A with citations, crafting a design brief, and non-English content generation. Using Compare mode, you can also compare the speed and intelligence between Claude 3 Haiku and the Claude 2.1 model using a sample prompt to generate personalized email responses to address customer questions. By choosing View API request, you can also access the model using code examples in the AWS Command Line Interface (AWS CLI) and AWS SDKs. Here is a sample of the AWS CLI command: aws bedrock-runtime invoke-model \ --model-id anthropic.claude-3-haiku-20240307-v1:0 \ --body "{\"messages\":[{\"role\":\"user\",\"content\":[{\"type\":\"text\",\"text\":\"Write the test case for uploading the image to Amazon S3 bucket\\n\"}]}],\"anthropic_version\":\"bedrock-2023-05-31\",\"max_tokens\":2000,\"temperature\":1,\"top_k\":250,\"top_p\":0.999,\"stop_sequences\":[\"\\n\\nHuman:\"]}" \ --cli-binary-format raw-in-base64-out \ --region us-east-1 \ invoke-model-output.txt To make an API request with Claude 3, use the new Anthropic Claude Messages API format, which allows for more complex interactions such as image processing. If you use Anthropic Claude Text Completions API, you should upgrade from the Text Completions API. Here is sample Python code to send a Message API request describing the image file: def call_claude_haiku(base64_string): prompt_config = { "anthropic_version": "bedrock-2023-05-31", "max_tokens": 4096, "messages": [ { "role": "user", "content": [ { "type": "image", "source": { "type": "base64", "media_type": "image/png", "data": base64_string, }, }, {"type": "text", "text": "Provide a caption for this image"}, ], } ], } body = json.dumps(prompt_config) modelId = "anthropic.claude-3-haiku-20240307-v1:0" accept = "application/json" contentType = "application/json" response = bedrock_runtime.invoke_model( body=body, modelId=modelId, accept=accept, contentType=contentType ) response_body = json.loads(response.get("body").read()) results = response_body.get("content")[0].get("text") return results To learn more sample codes with Claude 3, see Get Started with Claude 3 on Amazon Bedrock, Diagrams to CDK/Terraform using Claude 3 on Amazon Bedrock, and Cricket Match Winner Prediction with Amazon Bedrock’s Anthropic Claude 3 Sonnet in the Community.aws. Now available Claude 3 Haiku is available now in the US West (Oregon) Region with more Regions coming soon; check the full Region list for future updates. Claude 3 Haiku is the most cost-effective choice. For example, Claude 3 Haiku is cheaper, up to 68 percent of the price per 1,000 input/output tokens compared to Claude Instant, with higher levels of intelligence. To learn more, see Amazon Bedrock Pricing. Give Claude 3 Haiku a try in the Amazon Bedrock console today and send feedback to AWS re:Post for Amazon Bedrock or through your usual AWS Support contacts. — Channy View the full article