Amazon Web Services (AWS)

Today we’re excited to announce the release of Research and Engineering Studio (RES) on AWS Version 2024.06. This latest release brings support for Ubuntu 22.04, the ability to designate users of your RES environment as project owners, and a new demo experience. RES on AWS 2024.06 now offers users the ability to launch virtual desktops with Ubuntu (22.04.3 - LTS). Users can use either the base image available through RES or create their own Ubuntu RES Ready AMI to preload their custom dependencies and applications. This latest release also allows RES administrators to designate certain individuals in their environment as project owners. Project owners can assist in the…

Amazon SageMaker Canvas now supports deploying Foundation Models (FMs) to SageMaker real-time inference endpoints, allowing you to bring generative AI capabilities into production and consume them outside the Canvas workspace. SageMaker Canvas is a no-code workspace that enables analysts and citizen data scientists to generate accurate ML predictions and use generative AI capabilities. SageMaker Canvas provides access to FMs powered by Amazon Bedrock and SageMaker JumpStart, supports RAG-based customization, and fine-tuning of FMs. Starting today, you can deploy FMs powered by SageMaker JumpStart such as Falcon-7B, Llama-2, and more to SageMaker endpoints making it eas…

In today’s data-driven world, organizations are continually confronted with the task of managing extensive volumes of data securely and efficiently. Whether it’s customer information, sales records, or sensor data from Internet of Things (IoT) devices, the importance of handling and storing data at scale with ease of use is paramount. A common use case that we see amongst customers is to search and visualize data. In this post, we show how to ingest CSV files from Amazon Simple Storage Service (Amazon S3) into Amazon OpenSearch Service using the Amazon OpenSearch Ingestion feature and visualize the ingested data using OpenSearch Dashboards. OpenSearch Service is a ful…

We are excited to announce that Amazon OpenSearch Serverless now offers customers the option to use Internet Protocol version 6 (IPv6) addresses for the endpoint of your OpenSearch Serverless collection. Customers moving to IPv6 can simplify their network stack by enabling their OpenSearch Serverless endpoints with both IPv4 and IPv6 addresses. The continued growth of the internet is exhausting available Internet Protocol version 4 (IPv4) addresses. IPv6 increases the number of available addresses by several orders of magnitude, so customers will no longer need to manage overlapping address spaces in their VPCs. Customers can also standardize their applications on the new…

Today, Amazon Simple Email Service (SES) released a new feature to give customers control over parts of the auto-generated Feedback-ID header in messages sent through SES. This feature provides additional details to help customers identify deliverability trends. Customers can use products like PostMaster Tools by Gmail to see complaint rates by identifiers of their choice, such as sender identity or campaign ID. This makes it easier to track deliverability performance associated with independent workloads and campaigns, and accelerates troubleshooting when diagnosing complaint rates. Previously, SES automatically generated a Feedback-ID header when sending emails on be…

Amazon Connect now provides color coding for shift activities in agent scheduling, enabling a simplified experience for contact center managers and agents. With this launch, you can now configure colors for agent shift activities, such as red for breaks and lunches, green for team meetings, and purple for trainings. With customizable colors, managers can quickly see how different activities are placed in agent schedules (e.g. is more than half the team doing a training at the same time, does the team meeting include everyone, etc.). This launch also simplifies the experience for agents as they can easily understand their schedule at-a-glance for the week without having to…

AWS announces generative AI-powered natural language query generation in AWS CloudTrail Lake (preview), enabling you to simply analyze your AWS activity events without having to write complex SQL queries. Now you can ask questions in plain English about your AWS API and user activity, such as “How many errors were logged during the past week for each service and what was the cause of each error?” or “Show me all users who logged in using console yesterday”, and AWS CloudTrail will generate a SQL query, which you can run as is or fine-tune to meet your use case. This new feature empowers users who are not experts in writing SQL queries or who don’t have a deep understan…

This post is co-written with Praveen Nischal and Mulugeta Mammo from Intel. Amazon OpenSearch Service is a managed service that makes it straightforward to secure, deploy, and operate OpenSearch clusters at scale in the AWS Cloud. In an OpenSearch Service domain, the data is managed in the form of indexes. Based on the usage pattern, an OpenSearch cluster may have one or more indexes, and their shards are spread across the data nodes in the cluster. Each data node has a fixed disk size and the disk usage is dependent on the number of index shards stored on the node. Each index shard may occupy different sizes based on its number of documents. In addition to the number o…

Today, Amazon Web Services (AWS) announces the general availability of Amazon GuardDuty Malware Protection for Amazon S3. This expansion of GuardDuty Malware Protection allows you to scan newly uploaded objects to Amazon S3 buckets for potential malware, viruses, and other suspicious uploads and take action to isolate them before they are ingested into downstream processes. GuardDuty helps customers protect millions of Amazon S3 buckets and AWS accounts. GuardDuty Malware Protection for Amazon S3 is fully managed by AWS, alleviating the operational complexity and overhead that normally comes with managing a data-scanning pipeline, with compute infrastructure operated o…

AWS Identity and Access Management (IAM) Access Analyzer guides customers toward least privilege by providing tools to set, verify, and refine permissions. IAM Access Analyzer now offers actionable recommendations to guide you to remediate unused access. For unused roles, access keys, and passwords, IAM Access Analyzer provides quick links in the console to help you delete them. For unused permissions, IAM Access Analyzer reviews your existing policies and recommends a refined version tailored to your access activity. As a central security team member, you can use IAM Access Analyzer to gain visibility into unused access across your AWS organization and automate how yo…

AWS Private Certificate Authority (AWS Private CA) launches the Connector for SCEP, which lets you use a managed and secure cloud certificate authority (CA) to enroll mobile devices securely and at scale. Simple Certificate Enrollment Protocol (SCEP) is a protocol widely adopted by mobile device management (MDM) solutions for getting digital identity certificates from a CA and enrolling corporate-issued and bring-your-own-device (BYOD) mobile devices. With the Connector for SCEP, you use a managed private CA with a managed SCEP solution to reduce operational costs, simplify processes, and optimize your public key infrastructure (PKI). Additionally, the Connector for SCEP …

AWS Identity and Access Management (IAM) now supports passkeys for multi-factor authentication to provide easy and secure sign-ins across your devices. Based on FIDO standards, passkeys use public key cryptography, which enables strong, phishing-resistant authentication that is more secure than passwords. IAM now allows you to secure access to AWS accounts using passkeys for multi-factor authentication (MFA) with support for built-in authenticators, such as Touch ID on Apple MacBooks and Windows Hello facial recognition on PCs. Passkeys can be created with a hardware security key or with your chosen passkey provider using your fingerprint, face, device PIN, and they are s…

AWS Identity and Access Management (IAM) Access Analyzer guides customers toward least privilege by providing tools to set, verify, and refine permissions. IAM Access Analyzer now extends custom policy checks to proactively detect nonconformant updates to policies that grant public access or grant access to critical AWS resources ahead of deployments. Security teams can use these checks to streamline their IAM policy reviews, automatically approving policies that conform with their security standards and inspecting more deeply when policies don’t conform. Custom policy checks use the power of automated reasoning to provide the highest levels of security assurance backed b…

Available today, the AWS Audit Manager generative AI best practices framework now includes Amazon SageMaker in addition to Amazon Bedrock. Customers can use this prebuilt standard framework to gain visibility into how their generative AI implementation on SageMaker or Amazon Bedrock follows AWS recommended best practices and start auditing their generative AI usage and automating evidence collection. The framework provides a consistent approach for tracking AI model usage and permissions, flagging sensitive data, and alerting on issues. This framework includes 110 controls across areas such as governance, data security, privacy, incident management, and business contin…

Today AWS announces Service Insertion, a new feature of AWS Cloud WAN that simplifies the integration of security and inspection services into the Cloud WAN based global networks. Using this feature, you can easily steer your global network traffic between Amazon VPCs (Virtual Private Cloud), AWS Regions, on-premises locations, and Internet via security appliances or inspection services using central Cloud WAN policy or the AWS management console. Customers deploy inspection services or security appliances such as firewalls, intrusion detection/protection systems (IDS/IPS) and secure web gateways to inspect and protect their global Cloud WAN traffic. With Service Inser…

Amazon Elastic Container Service (Amazon ECS) and AWS Fargate now allow you to use customer managed keys in AWS Key Management Service (KMS) to encrypt data stored in Fargate task ephemeral storage. Ephemeral storage for tasks running on Fargate platform version 1.4.0 or higher is encrypted with AWS owned keys by default. This feature allows you to add a self-managed security layer which can help you meet compliance requirements. Customers who run applications that deal with sensitive data often need to encrypt data using self-managed keys to meet security or regulatory requirements and also provide encryption visibility to auditors. To meet these requirements you can …

Today, AWS announces the general availability of Amazon CloudWatch Application Signals, an OpenTelemetry (OTeL) compatible application performance monitoring (APM) feature in CloudWatch, that makes it easy to automatically instrument and track application performance against their most important business or service level objectives (SLOs) for applications on AWS. With no manual effort, no custom code, and no custom dashboards, Application Signals provides service operators with a pre-built, standardized dashboard showing the most important metrics for application performance – volume, availability, latency, faults, and errors – for each of their applications on AWS. By…

Starting today, Amazon Elastic Compute Cloud (Amazon EC2) M6in and M6idn instances are available in AWS Regions Asia Pacific (Mumbai), Canada (Central). These sixth-generation network optimized instances, powered by 3rd Generation Intel Xeon Scalable processors and built on the AWS Nitro System, deliver up to 200Gbps network bandwidth, 2x more network bandwidth, and up to 2x higher packet-processing performance over comparable fifth-generation instances. Customers can use M6in and M6idn instances to scale the performance and throughput of network-intensive workloads such as high-performance file systems, distributed web scale in-memory caches, caching fleets, real-time bi…

Amazon CloudWatch announces the general availability of natural language query generation powered by generative AI for Logs Insights and Metrics Insights. This feature enables you to quickly generate queries in context of your logs and metrics data using plain language. By simplifying the query generation process, you can accelerate gathering insights from your observability data without needing extensive knowledge of the query language. Query Generator simplifies your CloudWatch Logs and Metrics Insights experience through natural language querying. You can ask questions in plain English, such as "Show me the 10 slowest Lambda requests in the last 24 hours" or "Which …

Amazon Security Lake is now available in the AWS GovCloud (US) Regions. You can now centralize security data from AWS environments, SaaS providers, on premises, and cloud sources into a purpose-built data lake stored in your Amazon S3 account. Security Lake makes it easier to analyze security data, gain a more comprehensive understanding of security across your entire organization, and improve the protection of your workloads, applications, and data. Security Lake automates the collection and management of your security data across accounts and AWS Regions so that you can use your preferred analytics tools while retaining control and ownership over your security data. …

AWS CloudFormation launches a new property for custom resources called ServiceTimeout. This new property allows customers to set a maximum timeout for the execution of the provisioning logic in a custom resource, enabling faster feedback loops in dev-test cycles. CloudFormation custom resources allow customers to write their own provisioning logic in CloudFormation templates and have CloudFormation run the logic during a stack operation. Custom resources use a callback pattern where the custom resource must respond to CloudFormation within a timeout of 1 hour. Previously, this timeout value was not configurable, so code bugs in the customer's custom resource logic resu…

In the last AWS Weekly Roundup, Channy reminded us on how life has ups and downs. It’s just how life is. But, that doesn’t mean that we should do it alone. Farouq Mousa, AWS Community Builder, is fighting brain cancer and Allen Helton, AWS Serverless Hero, his daughter is fighting leukemia. If you have a moment, please visit their campaign pages and give your support. Meanwhile, we’ve just finished a few AWS Summits in India, Korea and also Thailand. As always, I had so much fun working together at Developer Lounge with AWS Heroes, AWS Community Builders, and AWS User Group leaders. Here’s a photo from everyone here. Last Week’s Launches Here are some launches t…

This post is co-written with Amit Gilad, Alex Dickman and Itay Takersman from Cloudinary. Enterprises and organizations across the globe want to harness the power of data to make better decisions by putting data at the center of every decision-making process. Data-driven decisions lead to more effective responses to unexpected events, increase innovation and allow organizations to create better experiences for their customers. However, throughout history, data services have held dominion over their customers’ data. Despite the potential separation of storage and compute in terms of architecture, they are often effectively fused together. This amalgamation empowers vend…

Amazon Verified Permissions expanded support for securing Amazon API Gateway APIs, with fine grained access controls when using an Open ID connect (OIDC) compliant identity provider. Developers can now control access based on user attributes and group memberships, without writing code. For example, say you are building a loan processing application. Using this feature, you can restrict access to the “approve_loan” API to only users in the “loan_officer” group. Amazon Verified Permissions is a scalable fine-grained authorization service for the applications that you build. Verified Permissions launched a new feature to secure API Gateway REST APIs for customers using an…

Amazon CodeCatalyst now supports the use of source code repositories hosted in Bitbucket Cloud in CodeCatalyst projects. This allows customers to use Bitbucket Cloud repositories with CodeCatalyst’s features such as its cloud IDE (Development Environments), Generative AI features such as Q feature development, and custom blueprints. Customers can also trigger CodeCatalyst workflows based on events in Bitbucket Cloud, view the status of CodeCatalyst workflows back in Bitbucket Cloud , and even block Bitbucket Cloud pull request merges based on the status of CodeCatalyst workflows. Customers want the flexibility to use source code repositories hosted in Bitbucket Cloud, …

Today, we are making it easier for AWS Organizations customers to centrally manage the root email address of member accounts across their Organization using the AWS Command Line Interface (CLI), AWS Software Development Kit (SDK), and AWS Organizations console. We previously released the Accounts SDK that enables Organizations customers to centrally and programmatically manage both primary and alternate contact information as well as the enabled AWS Regions for their accounts. In order to manage the root email address, customers were forced to login as root to manage the root email address of member accounts. Starting today, customers can use the same SDK to update the ro…

Amazon FSx for Lustre, a service that provides high-performance, cost-effective, and scalable file storage for compute workloads, is increasing the maximum level of metadata IO operations per second (IOPS) you can drive on a file system by up to 15x, and now allows you to provision metadata IOPS independently of your file system’s storage capacity. A file system’s level of metadata IOPS determines the number of files and directories that you can create, list, read, and delete per second. By default, the metadata IOPS of an FSx for Lustre file system scales with its storage capacity. Starting today, you can provision up to 15x higher metadata performance per file system…

AWS AppFabric, a no-code service that quickly integrates with software-as-a-service (SaaS) applications to enhance an organization’s security posture, now supports JumpCloud. AppFabric provides aggregated and normalized audit logs from popular SaaS applications like Slack, Zoom, Salesforce, Atlassian Jira suite, Google Workspace, and Microsoft 365. By centralizing SaaS application data, AppFabric helps teams gain greater visibility into vulnerabilities in a customer's SaaS environment, enabling them to monitor threats more effectively and respond to incidents faster. IT and security teams no longer need to manage point-to-point SaaS integrations that take time away from h…

Starting today, Amazon Elastic Compute Cloud (Amazon EC2) C6id instances are available in the South America (Sao Paulo) Region. These instances are powered by 3rd generation Intel Xeon Scalable Ice Lake processors with an all-core turbo frequency of 3.5 GHz and up to 7.6 TB of local NVMe-based SSD block-level storage. C6id instances are built on AWS Nitro System, a combination of dedicated hardware and lightweight hypervisor, which delivers practically all of the compute and memory resources of the host hardware to your instances for better overall performance and security. Customers can take advantage of access to high-speed, low-latency local storage for compute-intensi…

Amazon Inspector now offers native integration with Amazon CodeCatalyst and GitHub actions for container image scanning, allowing customers to assess their container images for software vulnerabilities within their Continuous Integration and Continuous Delivery (CI/CD) tools, pushing security earlier in the software development lifecycle. With this expansion, Inspector now natively integrates with four developer tools including, Jenkins, TeamCity, GitHub actions, and Amazon CodeCatalyst for container image scanning. This feature works with CI/CD tools hosted anywhere in AWS, as well as in on-premise environments and hybrid clouds, providing consistency for developers to u…

AWS Audit Manager has introduced a common control library that simplifies the process of automating risk and compliance assessments against enterprise controls. This new library enables Governance, Risk, and Compliance (GRC) teams to efficiently map their controls into Audit Manager for evidence collection. The new common control library provides pre-defined and pre-mapped AWS data sources, eliminating the need to identify which AWS resources to assess for various controls. It defines AWS-managed common controls based on extensive mapping and reviews by AWS certified auditors, determining the appropriate data sources for evidence collection. With this launch, Audit Man…

Today AWS launches AWS Tax Settings API, a new public API service that enables customers to programmatically view, set, and modify tax registration information and associated business legal name and address. This launch allows you to automate tax registration updates as an enhanced offering to the AWS Tax Settings page. Previously, customers managing tax registration information could only update tax information from the Tax Settings Page on the AWS Billing Console. Now, the API enables customers to automate setting their tax information while creating bulk accounts instead of manually setting tax registration information for accounts manually. This programmatic suppor…

Amazon OpenSearch Ingestion now allows you to ingest streaming data from Amazon Managed Streaming for Apache Kafka (MSK) Serverless, enabling you to seamlessly index the data from Amazon MSK Serverless clusters in Amazon OpenSearch Service managed clusters or Serverless collections without the need for any third-party data connectors. With this integration, you can now use Amazon OpenSearch Ingestion to perform near- real-time aggregations, sampling and anomaly detection on data ingested from Amazon MSK Serverless, helping you to build efficient data pipelines to power your complex observability and analytics use cases. Amazon OpenSearch Ingestion pipelines can consume …

Amazon Location Service launches enhanced location integrity features, which offer tools to help developers evaluate the accuracy and authenticity of user-reported locations. With enhanced location integrity features, customers can now use predictive tools that anticipate user movements into or out of customer-specified areas, using criteria like time-to-breach and proximity to enhance monitoring and security measures. For instance, a retailer can utilize improved location integrity features to gauge the proximity of a curbside pickup user and optimize operations for a superior customer experience. Customers can also use new validation capabilities to help confirm user …

Amazon CloudWatch now supports AWS CloudTrail data event logging for the GetMetricData and GetMetricWidgetImage APIs. With this launch, customers have greater visibility into metric retrieval activity from their AWS account for best practices in security and operational troubleshooting. CloudTrail captures API activities related to Amazon CloudWatch GetMetricData and GetMetricWidgetImage APIs as events. Using the information that CloudTrail collects, you can identify a specific request to CloudWatch GetMetricData or GetMetricWidgetImage APIs, the IP address of the requester, the requester's identity, and the date and time of the request. Logging CloudWatch GetMetricDat…

Amazon CodeCatalyst now supports the use of source code repositories hosted in GitHub Cloud with its blueprints capability. This allows customers to create a project from a CodeCatalyst blueprint into a GitHub Cloud source repository and add a blueprint into an existing project's GitHub Cloud source repository. It also enables customers to create custom blueprints in a GitHub Cloud repository. Customers can use CodeCatalyst blueprints to create a project with a source repository and sample source code, CI/CD workflows, build and test reports, and integrated issue tracking tools. As the blueprint gets updated with the latest best practices or new options, it can regener…

Today, Amazon Web Services, announced the availability of Amazon EC2 instance type finder, enabling you to select the ideal Amazon EC2 instance types for your workload. It uses machine learning to help customers make quick and cost-effective selections for instance types, before provisioning workloads. Using the AWS Management Console, customers can specify their workload requirements and get trusted recommendations. Amazon EC2 instance type finder is integrated with Amazon Q, allowing customers to use natural language to specify requirements and get instance family suggestions. EC2 has more than 750 instance types and EC2 instance type finder enables customers to easi…

Today, AWS IoT Device Management announced the launch of a new connectivity metrics dashboard, enabling customers to easily identify connectivity patterns and configure operational alarms for their device fleet through a unified view. AWS IoT Device Management is a fully managed cloud service that helps you register, organize, monitor, and remotely manage Internet of Things (IoT) devices at scale. With this launch, you can now select and view a range of connectivity metrics sourced from AWS IoT Core and AWS IoT Device Management on a single page. The connectivity metrics dashboard consolidates frequently used metrics from AWS IoT Core, such as successful connections, i…

Amazon SageMaker now integrates Model Cards into Model Registry, making it easier for customers to manage governance information for specific model versions directly in Model Registry in just a few clicks. Today, customers register ML models in Model Registry to manage their models. Now, with this launch, they can register ML model versions early in the development lifecycle, including essential business details and technical metadata. This integration allows customers to seamlessly review and govern models across their lifecycle from a single place. By enhancing the discoverability of model governance information, this update offers customers greater visibility into t…

Introduction Galaxy is a scientific workflow, data integration, and digital preservation platform that aims to make computational biology accessible to research scientists that do not have computer programming or systems administration experience. Although it was initially developed for genomics research, it is largely domain agnostic and is now used as a general bioinformatics workflow management system, running on everything from academic mainframes to personal computers. BioNTech has been using Galaxy for running experiments across research teams, and over time was adopted by a large number of scientists. With the growth, they were faced with the challenge of experi…

Generative AI has the potential to transform every industry and line of business, revolutionizing sectors and enabling companies to unlock new opportunities. To ensure your organization maintains its competitive edge and keeps pace with innovation, mid-to-senior level leaders need to build the knowledge and skills to understand and maximize the full potential of generative AI. The new learning program, Unlocking Generative AI Opportunities with AWS, is a six-week learning experience developed in collaboration with the Udemy Business Leadership Academy. It is uniquely designed to equip leaders across all industries with the generative AI knowledge and change management s…

We are excited to announce the general availability of Amazon OpenSearch Service zero-ETL integration with Amazon Simple Storage Service (Amazon S3) for domains running 2.13 and above. The integration is new way for customers to query operational logs in Amazon S3 and Amazon S3-based data lakes without needing to switch between tools to analyze operational data. By querying across OpenSearch Service and S3 datasets, you can evaluate multiple data sources to perform forensic analysis of operational and security events. The new integration with OpenSearch Service supports AWS’s zero-ETL vision to reduce the operational complexity of duplicating data or managing multiple ana…

We are excited to offer a new lower entry point for Amazon OpenSearch Serverless, which makes it affordable to run small-scale search and analytics workloads. Opensearch Serverless’ compute capacity for indexing and searching data are measured in OpenSearch Compute Units (OCUs). Prior to this update, highly-available production deployments required a minimum of 4 OCUs with redundancy for protection against Availability Zone outages and infrastructure failures. With the introduction of fractional 0.5 OCU, OpenSearch Serverless can be deployed starting at just 2 OCUs for production workloads. This includes 1 OCU for primary and standby indexing nodes at 0.5 OCU each, and…

Amazon Connect now provides time zone support for forecasts, making it easier for contact center managers to analyze future demand. With this launch, you can now generate, view, and download forecasts for the time zone in which your business operates. This feature will also automatically adjust forecasts to account for daylight saving changes (e.g., if a contact center receives contacts from 8am-8pm US Eastern time, then forecasts will automatically switch from 8am-8pm Eastern Daylight Time (EDT) to 8am-8pm Eastern Standard Time (EST) on November 3, 2024). Time zone support in forecasts simplifies the day-to-day experience for managers. View the full article

AWS HealthImaging now supports event-driven architectures by sending event notifications to Amazon EventBridge. By subscribing to HealthImaging events in EventBridge, you can automatically kick-off application workflows such as image quality assessment or de-identification based upon changes to resources in the data store. With EventBridge, developers can take advantage of a serverless event bus to easily connect and route events between many AWS services and third-party applications. Developers working with HealthImaging can now receive state changes for asynchronous tasks, such as DICOM import jobs and image set copy and update operations. Events are delivered to EventB…

Starting today, Amazon Elastic Compute Cloud (Amazon EC2) C6id instances are available in Canada (Central) Region. These instances are powered by 3rd generation Intel Xeon Scalable Ice Lake processors with an all-core turbo frequency of 3.5 GHz and up to 7.6 TB of local NVMe-based SSD block-level storage. C6id instances are built on AWS Nitro System, a combination of dedicated hardware and lightweight hypervisor, which delivers practically all of the compute and memory resources of the host hardware to your instances for better overall performance and security. Customers can take advantage of access to high-speed, low-latency local storage for compute-intensive workloads,…

Genomics workflows process petabyte-scale datasets on large pools of compute resources. In this blog post, we discuss how life science organizations can use Amazon Web Services (AWS) to run transcriptomic sequencing data analysis using public datasets. This allows users to quickly test research hypotheses against larger datasets in support of clinical diagnostics. We use AWS HealthOmics and AWS Step Functions to orchestrate the entire lifecycle of preparing and analyzing sequence data and remove the associated heavy lifting. Use case In genomics, transcription relates to the process of making a ribonucleic acid (RNA) copy from a gene’s deoxyribonucleic acid (DNA). Usua…

Amazon API Gateway now enables customers to increase their integration timeout beyond the prior limit of 29 seconds. This setting represents the maximum amount of time API Gateway will wait for a response from the integration to complete. You can raise the integration timeout to greater than 29 seconds for Regional REST APIs and private REST APIs, but this might require a reduction in your account-level throttle quota limit. With this launch, customers with workloads requiring longer timeouts, such as Generative AI use cases with Large Language Models (LLMs), can leverage API Gateway. Amazon API Gateway is a fully managed service that makes it easy for developers to cr…

Starting today, you can enable Route 53 Profiles in the AWS GovCloud (US-East) and AWS GovCloud (US-West) Regions to define a standard DNS configuration, in the form of a Profile, that may include Route 53 private hosted zone (PHZ) associations, Route 53 Resolver rules, and Route 53 Resolver DNS Firewall rule groups, and apply this configuration to multiple VPCs in your account. Profiles can also be used to enforce DNS settings for your VPCs, with configurations for DNSSEC validations, Resolver reverse DNS lookups, and the DNS Firewall failure mode. Your can share Profiles with AWS accounts in your organization using AWS Resource Access Manager (RAM). Route 53 Profiles si…

Amazon Titan Text Embeddings V2, a new embeddings model in the Amazon Titan family of models, is now available for use with Knowledge Bases for Amazon Bedrock. Using Titan Text Embeddings V2, customers can embed their data into a vector database and use it to retrieve relevant information for tasks such as questions and answers, classification, or personalized recommendations. Amazon Text Embeddings V2 is optimized for retrieval augmented generation (RAG) and is an efficient model ideal for high accuracy retrieval tasks at different dimensions. The model supports flexible embeddings sizes (1024, 512 , 256) and maintains accuracy at smaller dimension sizes, helping to r…

The Amazon Connect agent workspace now features an updated user interface to improve productivity and focus for your agents. The new user interface is designed to be more intuitive, highly responsive, and increase visual consistency across capabilities, providing your agents with a streamlined user experience. With this launch, you can also easily build and embed third-party applications that have a consistent look and feel with the agent workspace by using Cloudscape Design System components. View the full article

Today, Amazon Q Developer launches AI-powered inline completions in the command line. As developers type in their command line, Q Developer will provide real-time AI-generated code suggestions. For instance, if a developer types `git`, Q Developer might suggestion `push origin main`. Developers can accept the suggestion by simply pressing the right arrow. To generate accurate suggestions, Q Developer looks at your current shell context and your recent shell history. You can learn more about how Q Developer manages your data here. View the full article

Amazon TimeStream for LiveAnalytics is now an Amazon EventBridge Pipes target, simplifying the ingestion of time-series data from sources such as Amazon Kinesis, Amazon DynamoDB, Amazon SQS, and more. Pipes provides a fully-managed experience, enabling you to easily ingest time-series data into Timestream for LiveAnalytics without the need to write undifferentiated integration code. Amazon Timestream for LiveAnalytics is fast, scalable, purpose-built time series database that makes it easy to store and analyze trillions of time series data points per day. Amazon EventBridge Pipes provides a simple, consistent, and cost-effective way to create point-to-point integration…

We are excited to announce streaming CLI support for Amazon CloudWatch Logs Live Tail, making it possible to view, search and filter relevant log events in real-time. You can now view your logs interactively in real-time as they’re ingested via AWS CLI or programmatically within your own custom dashboards inside or outside of AWS. In CloudWatch Logs, Live Tail console has been providing customers a rich out-of-the-box experience to view and detect issues in their incoming logs. Additionally, it provides fine-grained controls to filter and highlight analytics of interest while investigating issues relating to deployments or incidents. By using the streaming CLI for Live…

Today, AWS Backup announces support for EBS Snapshots Archive in the AWS GovCloud (US) Regions, allowing customers to automatically move EBS Snapshots created by AWS Backup to EBS Snapshots Archive. EBS Snapshots Archive is low-cost, long-term storage tier meant for your rarely-accessed snapshots that do not need frequent or fast retrieval, allowing you to save up to 75% on storage cost. You can now use AWS Backup to transition your EBS Snapshots to EBS Snapshots Archive and manage their lifecycle, alongside AWS Backup’s other supported resources in the AWS GovCloud (US) Regions. EBS Snapshots are incremental, storing only the changes since the last snapshot and making…

AWS Elastic Beanstalk now supports .NET 8 on AL2023 Elastic Beanstalk environments. Elastic Beanstalk .NET 8 on AL2023 environments come with .NET 8.0 installed by default. See Release Notes for additional details. AWS Elastic Beanstalk is a service that provides the ability to deploy and manage applications in AWS without worrying about the infrastructure that runs those applications. .NET 8 on AL2023 runtime adds security improvements, such as support for the SHA-3 hashing algorithm, along with other updates including enhanced dynamic profile-guided optimization (PGO) that can lead to runtime performance improvements, and better garbage collection with the ability to …

AWS CloudFormation Hooks is now generally available in the AWS GovCloud (US) Regions. With this launch, customers can deploy Hooks in these newly supported AWS Regions to help keep resources secure and compliant. With CloudFormation Hooks, you can invoke custom logic to automate actions or inspect resource configurations prior to a create, update or delete CloudFormation stack operation. Today’s launch extends this capability to GovCloud customers and partners to help keeping resources secure and compliant. With this launch, CloudFormation Hooks is available in 31 AWS regions globally: US East (Ohio, N. Virginia), US West (N. California, Oregon), Canada (Central, Ca…

AWS Transfer Family support for the Applicability Statement (AS2) protocol has increased its default message size limit from 50 MB to 1 GB and throughput limit from 30 to 100 message transfers per second. You will find these increased limits reflected on the AWS Transfer Family page within the Service Quotas console. These increased limits enable you to reliably connect with trading partners that frequently transmit sizable batches of AS2 messages. The increased message size and throughput limits for AS2 are available in all AWS Regions where the service is available. To learn more about the AS2 quotas and limitations, visit the documentation. To get started with Trans…

Introduction Freddie Mac has a mission to provide a stable US housing Market. Freddie Mac identified the need for faster application delivery, scalable performance, increased resiliency, and cost optimization of their existing application portfolio. To achieve their mission goals, Freddie Mac undertook a migration from on-premises Kubernetes to Amazon Elastic Kubernetes Service (Amazon EKS). As a result of this migration Freddie Mac saw an 80% reduction in application delivery time, from weeks to hours. Freddie also realized a disaster recovery (DR) return to operations (RTO) efficiency from hours to minutes by using the Amazon Web Services (AWS) DR mechanisms, auto-scal…

Life is not always happy, there are difficult times. However, we can share our joys and sufferings with those we work with. The AWS Community is no exception. Jeff Barr introduced two members of the AWS community who are dealing with health issues. Farouq Mousa is an AWS Community Builder and fighting brain cancer. Allen Helton is an AWS Serverless Hero and his young daughter is fighting leukemia. Please donate to support Farauq and Olivia, Allen’s daughter to overcome their disease. Last week’s launches Here are some launches that got my attention: Amazon EC2 high memory U7i Instances – These instances with up to 32 TiB of DDR5 memory and 896 vCPUs are powered b…

The AWS SDK for SAP ABAP – BTP edition is now available in preview, making it easier for SAP Business Technology Platform (BTP) users to connect to AWS services, including the latest generative AI capabilities. With this new edition, SAP customers can develop and run powerful SAP extensions and standalone applications in SAP BTP that use AWS services. These capabilities help SAP customers innovate faster while keeping their ERP core clean, including customers using SAP’s RISE and GROW offerings, or self-managed deployments on AWS or other cloud providers. Whether seeking to streamline invoice generation with Amazon Bedrock, improve sales forecasts with Amazon Forecast,…

Amazon Connect Chat now supports Apple Messages for Business, enabling you to deliver personalized customer experiences on Apple Messages, the default messaging application on all iOS devices, increasing customer satisfaction and reducing costs. Rich messaging features such as link previews, quick replies, forms, attachments, customer authentication, iMessage apps, and Apple Pay allow customers to browse product recommendations, check shipments, schedule appointments, or make a payment. Amazon Connect’s integration with Apple Messages for Business makes it easy for your customers to chat with you anytime they tap your registered phone number on an Apple device, reducin…

Vendor Lead Time (VLT) Insights increases lead time deviation awareness, focusing on critical factors such as the vendor’s transportation mode and source locations. Users can identify lead time deviations at a more granular level and view them through the ASC Insights UI. Additionally, users can easily export all lead time deviations to combine with external sources for further analysis. Customers lack timely visibility of vendor lead time deviations (actual lead times vs contractual lead times). Identifying and incorporating these deviations is crucial for improving planning accuracy and avoiding stock out situations. Traditional data analysis methods are time-consumi…

AWS Marketplace announces the general availability of amendments for annual agreements on Amazon Machine Image (AMI) products purchased on AWS Marketplace. This allows customers with annual agreements to switch the Elastic Cloud Compute (EC2) instance types for the AMI solution they purchased from AWS Marketplace. AWS customers who run AMI software from AWS Marketplace for extended periods choose to use annual plans which offer discounts over on-demand pricing. Previously, annual agreements only provided discounts on the initially selected EC2 instance types, and if customers later needed to support additional users by adding more instances or upgrading to larger insta…

Designing a full stack search application requires addressing numerous challenges to provide a smooth and effective user experience. This encompasses tasks such as integrating diverse data from various sources with distinct formats and structures, optimizing the user experience for performance and security, providing multilingual support, and optimizing for cost, operations, and reliability. Amazon OpenSearch Serverless is a powerful and scalable search and analytics engine that can significantly contribute to the development of search applications. It allows you to store, search, and analyze large volumes of data in real time, offering scalability, real-time capabiliti…

We’re thrilled to announce that AWS has been named a Leader in the IDC MarketScape: Worldwide Analytic Stream Processing Software 2024 Vendor Assessment (doc #US51053123, March 2024). We believe this recognition validates the power and performance of Apache Flink for real-time data processing, and how AWS is leading the way to help customers build and run fully managed Apache Flink applications. You can read the full report from IDC. Unleashing real-time insights for your organization Apache Flink’s robust architecture enables real-time data processing at scale, making it a favored choice among organizations for its efficiency and speed. With its advanced features fo…

Amazon QuickSight now supports the ability to sort by multiple columns in Tables. This allows both authors and readers to sort by two or more columns simultaneously in a nested fashion (e.g., first by column A, then B, then C) using the new sorting pop over. They can add, remove, reorder and reset sort on a table. Readers can also perform multi column sort using hidden and off visual field as defined by the author or opt for single column sort from column header context menu as well. For more details refer to documentation. View the full article

Amazon AppStream 2.0 announces support for real-time audio conferencing on multi-session fleets. Additionally, you can now launch multi-session fleets powered by Microsoft Windows Server 2022 operating system and take the advantage of latest operating systems features. Multi-session fleets enable IT admins to host multiple end-user sessions on a single AppStream 2.0 instance, helping customers to make better use of instance resources. By providing your users with access to streaming applications and audio conferencing, you can help improve team collaboration for remote workers. Your users don't need to exit their AppStream 2.0 sessions to interact using well-known audi…

AWS AppSync now allows customers to invoke their Lambda functions, configured as AppSync data sources, in an event-driven manner. This new capability enables asynchronous execution of Lambda functions, providing more flexibility and scalability for serverless and event-driven applications. Previously, customers could only invoke Lambda functions synchronously from AppSync, which meant that the GraphQL API would wait for the Lambda function to complete before returning a response. With support for Event mode, AppSync can now trigger Lambda functions asynchronously, decoupling the API response from the Lambda execution. This is particularly beneficial for long-running op…

In December 2023, Amazon Cognito user pools announced the ability to enrich identity and access tokens with custom attributes in the form of OAuth 2.0 scopes and claims. Today, we are expanding this functionality to support complex custom attributes such as arrays, maps and JSON objects in both identity and access tokens. You can now make fine-grained authorization decisions using complex custom attributes in the token. This feature enables you to offer enhanced personalization and increased access control. You can also simplify migration and modernization of your applications to use Amazon Cognito with minimal or no changes to your applications. Amazon Cognito is a se…

Amazon QuickSight, which lets you easily create and publish interactive dashboards across your organization and embed data visualizations into your apps, is now available in Milan, Zurich, Cape Town and Jakarta Regions. New accounts are able to sign up for QuickSight with Milan, Zurich, Cape Town or Jakarta as their primary region, making SPICE capacity available in the region and ensuring proximity to AWS and on-premises data sources. Users on existing QuickSight accounts can now switch regions with the region switcher and create SPICE datasets in the new regions. With this launch, QuickSight expands to Africa for the first time and is now available in all continents …

Amazon EventBridge Scheduler now emits 12 new Amazon CloudWatch metrics allowing you to monitor API request rates for create, delete, get, list, and update API calls for Schedules and ScheduleGroups. You can now more effectively monitor your application’s performance when making calls to Scheduler’s APIs and proactively identify when you may need to increase your Scheduler service quotas. EventBridge Scheduler allows you to create millions of scheduled events and tasks to run across more than 270 AWS services without provisioning or managing the underlying infrastructure. EventBridge Scheduler supports one time and recurring schedules that can be created using cron exp…

Today, Amazon Bedrock announces the new Converse API, which provides developers a consistent way to invoke Amazon Bedrock models removing the complexity to adjust for model-specific differences such as inference parameters. This API also simplifies managing multi-turn conversations by enabling developers to provide conversational history in a structured way as part of the API request. Furthermore, Converse API supports Tool use (function calling), which for supported models (Anthropic's Claude 3 model family including Claude 3 Opus, Claude 3 Sonnet, and Claude 3 Haiku; Mistral Large; and Cohere’s Command R and R+), will enable developers to perform a wide variety of tasks…

AWS WAF now allows you to select specific versions of Bot Control and Fraud Control managed rule groups within your web ACLs. This provides greater control over managing traffic when AWS makes new managed rule groups updates available to you. With versioning, you gain the flexibility to test new and updated bot and fraud rules before deploying them to production. For example, you can apply a new version of a managed rule group to a staging environment to validate efficacy. You can then incrementally roll out the version across production to closely monitor impact before fully enabling it. If a new version inadvertently causes issues, you can swiftly roll back to the pr…

Powertools for AWS Lambda (Python), an open-source developer library, launched a new feature to ease the creation of Agents for Amazon Bedrock. With this release, Powertools for AWS Lambda (Python) handles the automatic generation of OpenAPI schemas directly from the business logic code, validates inputs and outputs according to that schema, and drastically reduces the boilerplate necessary to manage requests and responses from Agents for Amazon Bedrock. By abstracting away the complexities, Powertools for AWS Lambda (Python) allows developers to focus their time and efforts directly on writing business logic, thereby boosting productivity and accelerating development …

A data-driven approach empowers businesses to make informed decisions based on accurate predictions and forecasts, leading to improved operational efficiency and resource optimization. Machine learning (ML) systems have the remarkable ability to continuously learn and adapt, improving their performance over time as they are exposed to more data. This self-learning capability ensures that organizations can stay ahead of the curve, responding dynamically to changing market conditions and customer preferences, ultimately driving innovation and enhancing competitiveness. By leveraging the power of machine learning on AWS, businesses can unlock benefits that enhance efficien…

Beginning today, customers in the Europe (Frankfurt) region can access Claude 3 Sonnet and Haiku in Amazon Bedrock to easily build and scale generative AI applications. Amazon Bedrock is a fully managed service that offers a choice of high-performing large language models (LLMs) and other FMs from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, as well as Amazon via a single API. Amazon Bedrock also provides a broad set of capabilities customers need to build generative AI applications with security, privacy, and responsible AI built in. These capabilities help you build tailored applications for multiple use cases across differe…

Everyone can build, use, and share generative AI powered apps for fun and for boosting personal productivity using PartyRock. PartyRock uses foundation models from Amazon Bedrock to turn your ideas into working PartyRock apps. PartyRock apps are composed of UI elements called widgets. Widgets display content, accept input, connect with other widgets, and generate outputs like text, images, and chats using foundation models. Now available is the Document widget, allowing you to integrate text content from files and documents directly into a PartyRock app. The Document widget supports common file types including PDF, MD, TXT, DOCX, HTML, and CSV, with a limit of 120,000 …

Amazon Web Services is announcing general availability for Amazon EC2 High Memory U7i instances, the first DDR5 memory based 8-socket offering by a leading cloud provider, offering up to 32TiB of memory and 896 vCPUs. Powered by 4th Generation Intel Xeon Scalable processors (Sapphire Rapids), U7i instances have twice as many vCPUs, delivering more than 135% compute performance and up to 45% better price performance versus existing U-1 instances. Combining the largest memory sizes with the highest vCPU count in the AWS cloud, these instances are ideal to run large in-memory databases such as SAP HANA, Oracle, and SQL Server and compute-intensive workloads such as large lan…

Customers can now create Amazon FSx for Lustre file systems in the AWS US East (Atlanta) Local Zone. Amazon FSx makes it easier and more cost effective to launch, run, and scale feature-rich, high-performance file systems in the cloud. It supports a wide range of workloads with its reliability, security, scalability, and broad set of capabilities. Amazon FSx for Lustre provides fully managed shared storage built on the world’s most popular high-performance file system, designed for fast processing of workloads such as machine learning, high performance computing (HPC), video processing, financial modeling, and electronic design automation (EDA). To learn more about …

Amazon SageMaker Canvas announces up to 10x faster startup time, enabling users to achieve faster business outcomes using a visual, no-code interface for machine learning (ML). With a faster startup time, you can now quickly prepare data, build, customize, and deploy machine learning (ML) and generative AI (Gen AI) models in SageMaker Canvas, without writing a single line of code. SageMaker Canvas can be launched using multiple methods including using your corporate credentials with a single sign-on portal such as AWS IAM Identity Center (IdC), Amazon SageMaker Studio, the AWS Management Console, or a pre-signed URL set up by IT administrators. Now, launching Canvas is …

The AWS Network Firewall service quota limit for stateful rules is now adjustable. The default limit is still 30,000 stateful rules per firewall policy in a Region, but you can request an increase up to 50,000. This firewall rule limit increase helps customers strengthen their security posture on AWS and mitigate emerging threats more effectively. A higher rule limit provides flexibility to customers with large-scale deployments to define their firewall policy with different combinations of AWS managed and customer defined rules. Starting today, you can implement a broader range of rules to defend against various threats and scale as you grow on AWS. View the full arti…

Amazon CloudWatch extended the duration during which customers can access their alarm history. Now, customers can view the history of their alarm state changes for up to 30 days prior. Previously, CloudWatch provided 2 weeks of alarm history. Customers rely on alarm history to review previous triggering events, alarming trends, and noisiness. This extended history makes it easier to observe past behavior and review incidents over a longer period of time. View the full article

Large language models (LLMs) such as Anthropic Claude and Amazon Titan have the potential to drive automation across various business processes by processing both structured and unstructured data. For example, financial analysts currently have to manually read and summarize lengthy regulatory filings and earnings transcripts in order to respond to Q&A on investment strategies. LLMs could automate the extraction and summarization of key information from these documents, enabling analysts to query the LLM and receive reliable summaries. This would allow analysts to process the documents to develop investment recommendations faster and more efficiently. Anthropic Claude …

Last week, Dr. Matt Wood, VP for AI Products at Amazon Web Services (AWS), delivered the keynote at the AWS Summit Los Angeles. Matt and guest speakers shared the latest advancements in generative artificial intelligence (generative AI), developer tooling, and foundational infrastructure, showcasing how they come together to change what’s possible for builders. You can watch the full keynote on YouTube. Announcements during the LA Summit included two new Amazon Q courses as part of Amazon’s AI Ready initiative to provide free AI skills training to 2 million people globally by 2025. The courses are part of the Amazon Q learning plan. But that’s not all that happened l…

AWS Billing and Cost Management console now supports a console-based simplified migration experience for affected policies containing retired IAM actions (aws-portal). Customers, who are not migrated to using fine-grained IAM actions, can trigger this experience by clicking on Update IAM Policies recommended action available on the Billing and Cost Management home page. The experience identifies affected policies, suggests equivalent new actions to match customers’ current access, provides testing options, and completes the migration of all affected policies across the organization. The experience automatically identifies required new fine-grained actions, making it ea…

AWS Chatbot now enables customers to tag AWS Chatbot resources. Tags are simple key-value pairs that customers can assign to AWS resources such as AWS Chatbot channel configurations to easily organize, search, identify resources, and control access. Prior to today, customers could not tag AWS Chatbot resources. As a result, they could not use tag-based controls to manage access to AWS Chatbot resources. By tagging AWS Chatbot resources, customers can now enforce tag-based controls in their environments. Customers can manage tags for AWS Chatbot resources using the AWS CLI, SDKs, or AWS Management Console. AWS Chatbot support for tagging Chatbot resources is availabl…

Today, we are excited to announce that Amazon EMR Serverless now supports endpoints for Apache Livy. Customers can now securely connect their Jupyter notebooks and manage Apache Spark workloads using Livy’s REST interface. Amazon EMR Serverless is a serverless option in Amazon EMR that makes it simple and cost effective for data engineers and analysts to run petabyte-scale data analytics in the cloud. With the Livy endpoints, setting up a connection is easy - just point your Livy client in your on-premises notebook running Sparkmagic kernels to the EMR Serverless endpoint URL. You can now interactively query, explore and visualize data, and run Spark workloads using Ju…

The Mistral Small foundation model from Mistral AI is now generally available in Amazon Bedrock. You can now access four high-performing models from Mistral AI in Amazon Bedrock including Mistral Small, Mistral Large, Mistral 7B, and Mixtral 8x7B, further expanding model choice. Mistral Small is a highly efficient large language model optimized for high-volume, low-latency language-based tasks. It provides outstanding performance at a cost-effective price point. Key features of Mistral Small include retrieval-augmented generation (RAG) specialization, coding proficiency, and multilingual capabilities. Mistral Small is perfectly suited for straightforward tasks that can…

Container based Telco workloads use Multus CNI primarily for traffic or network segmentation. Amazon Elastic Kubernetes Service (Amazon EKS) supports Multus CNI enabling users to attach multiple network interfaces, apply advanced network configuration and segmentation to Kubernetes-based applications running on AWS. One of the many benefits of running applications on AWS is resource elasticity (scaling out and scaling in). Node elasticity can be made possible by a cluster autoscaler such as Karpenter. Karpenter automatically launches the right compute resources to handle application demand. It is designed to use the cloud with fast and simple compute provisioning for Kube…

The Amazon Web Services (AWS) Advanced Python Wrapper driver is now generally available for use with Amazon RDS and Amazon Aurora PostgreSQL and MySQL-compatible edition database clusters. This database driver provides support for faster switchover and failover times, and authentication with AWS Secrets Manager or AWS Identity and Access Management (IAM). The AWS Advanced Python Wrapper driver wraps the open-source Psycopg and the MySQL Connector/Python drivers and supports Python versions 3.8 or newer. You can install the aws-advanced-python-wrapper package using the pip command along with either the psycpg or mysql-connector-python open-source packages. The wrapper d…

AWS CloudFormation launches a new parameter called DeletionMode for the DeleteStack API. This new parameter allows customers to safely delete their CloudFormation stacks that are in DELETE_FAILED state. Today, customers create, update, delete, and re-create CloudFormation stacks when iterating on their cloud infrastructure in their dev-test environments. Customers can use the DeleteStack CloudFormation API to successfully delete their stacks and stack resources. However, certain stack resources can prevent the DeleteStack API to successfully complete for e.g. when customers attempt to delete non-empty Amazon S3 buckets. The DeleteStack API can enter into the DELETE_FAI…

Starting today, Amazon Elastic Compute Cloud (Amazon EC2) M7i-flex, M7i, C7i are available in the AWS GovCloud (US-East) Region. In addition, Amazon EC2 M7i-flex, M7i and R7i instances are available in the AWS GovCloud (US-West) Region. These instances are powered by powered by custom 4th Generation Intel Xeon Scalable processors (code-named Sapphire Rapids)custom processors, available only on AWS, and offer up to 15% better performance over comparable x86-based Intel processors utilized by other cloud providers. M7i-flex instances are the easiest way for you to get price-performance benefits for a majority of general-purpose workloads, and deliver up to 19% better pri…

Today, AWS announced the opening of a new AWS Direct Connect location within the Coresite CH1 data center in Chicago, Illinois. By connecting your network to AWS at the new Illinois location, you gain private, direct access to all public AWS Regions (except those in China), AWS GovCloud Regions, and AWS Local Zones. This is the fourth AWS Direct Connect site within Chicago Metropolitan area and the 44th site in the United States. The Direct Connect service enables you to establish a private, physical network connection between AWS and your data center, office, or colocation environment. These private connections can provide a more consistent network experience than tho…

AWS re:Post Private is now available in five new regions: US East (N. Virginia), Europe (Ireland), Canada (Central), Asia Pacific (Sydney), and Asia Pacific (Singapore). re:Post Private is a secure, private version of the AWS re:Post, designed to help organizations increase speed to get started with the cloud, remove technical roadblocks, accelerate innovation, and improve developer productivity. With re:Post Private, it is easier for organizations to build an organizational cloud community that drives efficiencies at scale and provides access to valuable knowledge resources. Additionally, re:Post Private centralizes trusted AWS technical content and offers private dis…

For existing users of Amazon Managed Service for Apache Flink who are excited about the recent announcement of support for Apache Flink runtime version 1.18, you can now statefully migrate your existing applications that use older versions of Apache Flink to a more recent version, including Apache Flink version 1.18. With in-place version upgrades, upgrading your application runtime version can be achieved simply, statefully, and without incurring data loss or adding additional orchestration to your workload. Apache Flink is an open source distributed processing engine, offering powerful programming interfaces for both stream and batch processing, with first-class suppo…

In today’s data-driven world, organizations often deal with data from multiple sources, leading to challenges in data integration and governance. AWS Glue, a serverless data integration service, simplifies the process of discovering, preparing, moving, and integrating data for analytics, machine learning (ML), and application development. One critical aspect of data governance is entity resolution, which involves linking data from different sources that represent the same entity, despite not being exactly identical. This process is crucial for maintaining data integrity and avoiding duplication that could skew analytics and insights. AWS Glue is based on the Apache Sp…

AWS CloudFormation enhances the troubleshooting experience for stack operations with a new AWS CloudTrail deep-link integration. This feature enables quicker resolution of stack provisioning errors. It directly links stack operation events in the CloudFormation Console to relevant CloudTrail events. These links provide detailed visibility into the errors, thus speeding up the dev-test cycle for developers. When you create, update, or delete a stack, your operation can encounter provisioning errors, such as missing required parameters for an EC2 instance or inadequate permissions. Previously, troubleshooting a stack provisioning error in the CloudFormation Console was a…

Amazon OpenSearch Ingestion is a fully managed serverless pipeline that allows you to ingest, filter, transform, enrich, and route data to an Amazon OpenSearch Service domain or Amazon OpenSearch Serverless collection. OpenSearch Ingestion is capable of ingesting data from a wide variety of sources and has a rich ecosystem of built-in processors to take care of your most complex data transformation needs. In this post, we walk you through the new UI enhancements and blueprint discovery features that are now available with OpenSearch Ingestion for a richer user experience. Blueprint discovery Rather than create a pipeline definition from scratch, you can use configura…

AWS Glue now supports SaaS connectivity with out-of-the-box support for Salesforce enabling users to quickly preview and transfer their CRM data, query, detect schema and schedule jobs. As enterprises increasingly rely on data to make business decisions, they face the challenge of collecting data from a growing ecosystem of data stores into a centralized location for analytics, AutoML, ML training, and business intelligence. With the new Salesforce connector, customers can easily ingest and aggregate their CRM data to any of Glue's supported destinations including Apache Iceberg, Delta Lake and Apache Hudi formats on Amazon S3; data warehouses such as Amazon Redshift a…