Amazon Bedrock Guardrails now supports cross-region inference

Amazon Bedrock Guardrails announces support for cross-region inference, an optional feature that enables customers to seamlessly manage traffic bursts by utilizing compute across different AWS regions.

Bedrock Guardrails provides configurable safeguards to help detect and block harmful content and prompt attacks, define topics to deny and disallow specific topics, and helps redact personally identifiable information (PII) such as personal data from input prompts and model responses. Additionally, Bedrock Guardrails helps detect and block model hallucinations, and identify, correct, and explain factual claims in model responses using Automated Reasoning checks. Guardrails can be applied across any foundation model including those hosted with Amazon Bedrock, self-hosted models, and third-party models outside Bedrock using the ApplyGuardrail API, providing a consistent user experience and helping to standardize safety and privacy controls.

By using cross-region inference, Amazon Bedrock Guardrails customers will be able to get consistent throughput and enhanced resilience during periods of peak demand. By opting in, customers no longer have to spend time and effort predicting demand fluctuations. Instead, cross-region inference dynamically routes traffic across multiple regions, ensuring optimal availability for each request and smoother performance during high-usage periods.

There's no additional routing cost for using cross-region inference with Amazon Bedrock Guardrails. Please find the list of supported regions here.

To learn more about the feature and how to get started, refer to the technical documentation.
 

View the full article