Monitoring & Observability

Amazon OpenSearch Service now supports tag-based authorization for HTTP methods, making it easier for you to manage access control for data read and write operations. You can use Identity policies in AWS Identity and Access Management (IAM) to define permissions for read and write HTTP methods, allowing coarse-grained access control of data on your Amazon OpenSearch Service domains. View the full article

Amazon Keyspaces (for Apache Cassandra), a scalable, highly available, and fully managed Apache Cassandra-compatible database service, now helps you monitor your table-level storage costs through Amazon CloudWatch. View the full article

Amazon OpenSearch Service now supports cross-cluster search across regions, enabling you to perform searches, aggregations, and visualizations across multiple domains in different regions with a single query. View the full article

Amazon Lookout for Metrics announces the launch of backtesting when using Amazon CloudWatch as a data source connector. Backesting is a new anomaly detection mode you can now select when setting up your detector. You can seamlessly connect to your data in CloudWatch to set up a highly accurate anomaly detector across metrics, dimensions, and namespaces of your choice. Amazon Lookout for Metrics uses machine learning (ML) to automatically detect and diagnose anomalies (outliers from the norm) without requiring any prior ML experience. Amazon CloudWatch provides you with actionable insights to monitor your applications, respond to system-wide performance changes, optimize r…

Amazon CloudWatch now supports AWS Elemental MediaTailor logs as part of Vended Logs. Vended logs are specific AWS service logs natively published by AWS services on behalf of the customer and available at volume discount pricing. View the full article

Amazon Managed Grafana now supports a new API for creating Grafana API tokens, as well as support for new plugins, Grafana version 8.4, and workspace tags. With CreateWorkspaceApiKey, customers can create Grafana API tokens without having to log into the Grafana workspace console, enabling users to programmatically create, delete, and manage Grafana resources such as dashboards, alerts, and data sources. Amazon Managed Grafana adds support for Github, Moogsoft, Pixie, and Windrose plugins, enabling customers to connect, query, and visualize data from additional data sources. Existing and new Amazon Managed Grafana workspaces now support Grafana version 8.4, with no action…

Amazon CloudWatch is introducing enhancements to the console experience, which improve dashboard data visualizations and console navigation. The enhancements include new dashboard widgets as well as more options to access frequently used dashboards, log groups and alarms. View the full article

Amazon CloudWatch Synthetics now supports deletion of underlying canary resources along with the canary deletion. When you delete a canary you can choose whether to also delete related resources created by the canary, thus making canary resources management easier and efficient. Synthetics canaries that run on a defined frequency to monitor the health and performance of your endpoints and APIs creates these resources as part of canary creation step. View the full article

AWS Secrets Manager now publishes a metric to Amazon CloudWatch for the number of secrets in your account. With this feature, you can easily review how many secrets you are using in Secrets Manager. You can also set alarms for an unexpected increase or decrease in number of secrets. View the full article

AWS Step Functions now provides a new console experience for viewing and debugging your workflow executions that makes it easier to search, filter, and root cause issues in your executions. View the full article

Amazon Managed Service for Prometheus usage metrics are now available in Amazon CloudWatch at no additional charge. Amazon Managed Service for Prometheus is a fully managed Prometheus-compatible monitoring service that makes it easy to monitor and alarm on operational metrics at scale. Prometheus is a popular Cloud Native Computing Foundation open-source project for monitoring and alerting that is optimized for container environments. With Amazon CloudWatch usage metrics, you can check your Amazon Managed Service for Prometheus workspace usage, and can start to proactively manage your quotas. View the full article

CloudWatch Synthetics now supports the use of environment variables with canaries. This allows you to save time by using a single canary script to create different canaries that have a similar task. View the full article

Amazon CloudWatch Lambda Insights, now available in preview, enables you to monitor, troubleshoot, and optimize the performance of AWS Lambda functions. With this preview, you have access to automated dashboards summarizing the performance and health of your Lambda functions that provide visibility into issues such as memory leaks or performance changes caused by new function versions. View the full article

You can now send logs from AWS Lambda functions directly to a destination of your choice by using AWS Lambda Extensions. AWS Lambda Extensions are a new way for monitoring, observability, security, and governance tools to integrate with Lambda, and today, you can use extensions that send logs to the following providers: Datadog, New Relic, Sumo Logic, Honeycomb, Lumigo, and Coralogix. View the full article

When using CloudWatch Synthetics, you can now get a snapshot of the canary health with a prebuilt monitoring dashboard. The new monitoring dashboard provides canary data trends over time for latency, availability, and error counts. The dashboard also provides expected latency based on historical data of the previous canary runs. This helps you spot anomalies sooner which in turn allows you to respond faster to ensure a better end user experience. View the full article

CloudWatch Synthetics now supports customizing the default launch settings on the Chrome browser with a new minor runtime version, syn-nodejs-2.1. This allows for more flexibility in the canary launched browser settings such as viewport, setting chromium flags, and handling errors. With syn-nodejs-2.1, you can also configure canary scripts to not take screenshots on a canary step, thereby reducing costs, and avoiding screenshots for sensitive data. View the full article

CloudWatch Embedded Metric Format enables you to ingest complex high-cardinality application data in the form of logs and easily generate actionable metrics from them. It has traditionally been hard to generate actionable custom metrics from your ephemeral resources such as Lambda functions, and containers. By sending your logs in the Embedded Metric Format, you can now easily create custom metrics without having to instrument or maintain separate code, while gaining powerful analytical capabilities on your log data. View the full article

Amazon CloudWatch Resource Health is a new feature that enables you to automatically discover, manage, and visualize the health and performance of Amazon Elastic Compute Cloud (Amazon EC2) hosts across your applications in a single view. With Resource Health, you can visualize the health of your Amazon EC2 hosts in a map (or list) view by performance dimension such as CPU or Memory, and slice and dice hundreds of hosts using tags and available filters such as instance type, instance state, and status check. This helps in reducing your Mean time to resolution (MTTR) by easily isolating EC2 hosts that are performing sub-optimally. View the full article

Amazon CloudWatch Logs announces Dimension support for Metric Filters. CloudWatch Logs Metric Filters allow you to create filter patterns to search for and match terms, phrases, or values in your CloudWatch Logs log events, and turn these into metrics that you can graph in CloudWatch Metrics or use to create a CloudWatch Alarm. Now with Dimension support for Metric Filters you can create metrics from JSON or space-delimited logs with up to 3 dimensions, where a dimension is a key-value pair that is part of the identity of a metric. View the full article

CloudWatch Synthetics, a feature that supports monitoring your REST APIs, URLs, and website content every minute, 24/7, is now available in the AWS Asia Pacific (Osaka) Region. With CloudWatch Synthetics, you can continually verify your customer experience even when there is no customer traffic on your applications. This helps you discover issues before your customers do and react quickly to fix them. View the full article

You can now view and manage all Amazon CloudWatch Logs transactional API service quotas with Service Quotas. Service Quotas consolidates the default values and your account specific quotas for CloudWatch Logs in one single view with the Service Quotas console. With the CloudWatch Logs and Service Quotas integration you can now easily view and adjust your quotas. View the full article

Now you can easily setup monitoring, alarms and dashboards for your applications deployed in Amazon Elastic Container Service (ECS), Amazon Elastic Kubernetes Service (EKS) and Kubernetes on EC2 containers running on AWS with CloudWatch Application Insights. CloudWatch Application Insights is a capability that helps customers monitor and troubleshoot their enterprise applications running on AWS resources. The new feature adds monitoring tier options for capturing the metrics, telemetry and logs for monitoring the health and wellness of applications running in containers on AWS. View the full article

Amazon Elasticsearch Service now offers instances from the AWS Graviton2 instance family. Instance types include general purpose (M6g), compute optimized (C6g), and memory optimized (R6g, R6gd). Customers can enjoy up to 38% improvement in indexing throughput, 50% reduction in indexing latency, and 30% improvement in query performance when compared to the corresponding x86-based instances from the current generation (M5, C5, R5). View the full article

We’re excited to announce the launch of Amazon CloudWatch Monitoring Framework, a reference architecture that makes it easier for customers to set up Amazon CloudWatch dashboards to monitor Apache workloads running on AWS. View the full article

You can now publish the Redis slow log from your Amazon ElastiCache for Redis clusters to Amazon CloudWatch Logs and Amazon Kinesis Data Firehose. The Redis slow log provides visibility into the execution time of commands in your Redis cluster, enabling you to continuously monitor the performance of these operations. You can choose to send these logs in either JSON or text format to Amazon CloudWatch Logs and Amazon Kinesis Data Firehose. View the full article

Amazon Elasticsearch Service now supports open source Elasticsearch 7.10 and its corresponding version of Kibana. This minor release includes bug fixes and enhancements. View the full article

Amazon Elasticsearch Service now supports Asynchronous Search. Asynchronous Search lets you submit a query that gets executed asynchronously, monitor the progress of the request, and retrieve results at a later stage. You can also retrieve partial results as they become available even before the search has fully completed. Once the search completes, it can be stored for consumption at a later time up to an expiry duration. View the full article

Amazon Elasticsearch Service now supports integrating with Microsoft Power BI, a business analytics service that delivers insights to enable fast, informed decisions. Powered by the Open Distro for Elasticsearch ODBC Driver you can now integrate your Microsoft Power BI environment with you Amazon Elasticsearch Service domains using the Open Distro for Elasticsearch SQL Engine. View the full article

You can now use Amazon CloudWatch Lambda Insights to monitor, troubleshoot, and optimize the performance of AWS Lambda functions which are packaged and deployed as container images. With CloudWatch Lambda Insights you have access to automated dashboards summarizing the performance and health of your Lambda functions. View the full article

Amazon CloudWatch Logs now supports two subscription filters per log group, enabling you to deliver a real-time feed of log events from CloudWatch Logs to an Amazon Kinesis Data Stream, Amazon Kinesis Data Firehose, or AWS Lambda for custom processing, analysis, or delivery to other systems. View the full article

Amazon Elasticsearch Service now supports automated memory management of Elasticsearch clusters with the new Auto-Tune feature. Auto-Tune is an adaptive resource management system that automatically adjusts Elasticsearch internal settings to handle dynamic workloads, optimizing cluster resources to improve efficiency and performance. With Auto-Tune, you can achieve performance boost in ingestion throughput for log analytics workloads, and reduced tail latencies for search queries. View the full article

Amazon Elasticsearch Service now publishes events to Amazon CloudWatch and Amazon EventBridge to provide better visibility into the service. Events to indicate the availability of a service software update for a domain, the start of an update, and the completion of an update will be included in the initial release. You will also be able to view these events under the new ‘Notifications’ view in the Amazon Elasticsearch Service console. View the full article

Amazon Elasticsearch Service now supports tag-based authorization for easy management of access to configuration APIs that are used for operations such as creating, modifying, or updating Amazon Elasticsearch Service domains. View the full article

CloudWatch Synthetics now supports storing your canary run artifacts, including log files, screenshots, and HAR files, in an Amazon Simple Storage Service (S3) bucket in another Region with a new major runtime version, syn-nodejs-puppeteer-3.0. CloudWatch Synthetics now also supports upgraded major versions of the Puppeteer, Chromium, and Node.js dependencies. View the full article

Amazon CloudWatch Contributor Insights for Amazon DynamoDB now supports AWS CloudFormation, enabling you to manage Contributor Insights settings for DynamoDB with CloudFormation templates. View the full article

Amazon Elasticsearch Service adds Trace Analytics, a new feature for distributed tracing that enables developers and IT operators to find and fix performance problems in distributed applications, leading to faster problem resolution times. View the full article

Amazon CloudWatch Synthetics adds support to create canaries for your Amazon API Gateway APIs using the API blueprint. This simplifies your canary setup time and makes it easy to monitor your API Gateway APIs. View the full article

AWS announces the availability of Fluent Bit support for Amazon CloudWatch, a fully managed, pay-as-you-go monitoring and observability service for resources running on AWS and on-premises. CloudWatch Container Insights and Log Insights enables you to explore, analyze, and visualize your container logs collected from the Fluent Bit processor. Container Insights also provides access to the automated dashboards that summarize the performance and availability of the FluentBit Daemon set running on Amazon Elastic Kubernetes Service (EKS) and Kubernetes. View the full article

Amazon Elasticsearch Service now supports encryption of data at rest and node-to-node encryption on existing domains, enabling organizations hosting sensitive workloads to meet stringent security and compliance requirements. View the full article

Now enterprises with Oracle databases can easily setup monitoring, alerting and dashboards for their EC2 and RDS Oracle instances on AWS with CloudWatch Application Insights. CloudWatch Application Insights is a capability that helps customers simply setup monitoring and enhanced observability for their enterprise applications running on AWS resources. The new feature automatically setups the metrics, telemetry and logs for monitoring the health and wellness of Oracle databases running in AWS. View the full article

Today, AWS and Grafana Labs launched the AWS IoT SiteWise plugin for Grafana. This plugin lets you easily visualize your AWS IoT SiteWise data in your Grafana dashboards. With this plugin, you can easily visualize and monitor your equipment data in near-real time using the wide range of visualization options in Grafana dashboards. You can also easily combine data from multiple sources (e.g., AWS IoT SiteWise, Amazon Timestream, Amazon CloudWatch) and monitor them all using a single Grafana dashboard. You can also embed these Grafana dashboards into your custom applications. View the full article

Amazon Elasticsearch Service now supports Piped Processing Language (PPL), a new feature that enables users to explore, discover and find data stored in Amazon ES, using a set of commands delimited by pipes (|). PPL extends Elasticsearch to support a standard set of commands that is easy for system developers, DevOps engineers, support engineers, site reliability engineers (SREs), and IT managers who are proficient with Linux or Unix to learn. PPL enables these users to begin extracting insights from their log, monitoring and observability data on day one. View the full article

Amazon Elasticsearch Service now offers anomaly detection for high cardinality datasets. This new feature enables you to sift through thousands of metrics from millions of events to accurately pinpoint individual entities with abnormal patterns. By leveraging machine learning, Amazon Elasticsearch Service now provides reliable and actionable insights to drastically reduce the time to isolate and remediate issues. High cardinality anomaly detection can be invaluable for a number of operational, security and business use cases like identifying hosts with high CPU and memory consumption, finding services with most error rates, isolating suspicious users or IP addresses acces…

Amazon Elasticsearch Service now offers support for Remote Reindex, enabling you to migrate data from a remote cluster into Amazon Elasticsearch Service. With this feature, you can simply copy data from one cluster to another, making it easier to migrate from legacy versions of Elasticsearch. Remote Reindex also supports migrating indexes from self-managed Elasticsearch onto Amazon Elasticsearch Service, providing a simple mechanism to onboard onto the service. View the full article

CloudWatch Synthetics now supports canary scripts in Python programming language with the Selenium open source web automation testing framework. This gives you more choice in the programming language and framework to use when creating canaries in CloudWatch Synthetics. View the full article

Amazon Elasticsearch Service now supports Gantt charts, a new visualization in Kibana. Users can now embed Gantt charts into dashboards to enable visualization of events, steps and tasks as horizontal bars. The length of the bars shows the amount of time associated with an event, step or a task. Gantt charts are used to represent a series of events that contain a parent-child relationship. This can be particularly useful in trace analytics, telemetry, and monitoring use cases, in which the users need to understand the overall interaction between traces or events. Gantt charts help users manage their resources by getting an overview of the events or tasks and understanding…

Amazon Elasticsearch Service has introduced several security enhancements to the fine-grained access control feature that include a revamped and improved security workflow in Kibana, and integration with Open Distro for Elasticsearch Alerting and Anomaly Detection features. View the full article

Amazon Elasticsearch Service has introduced several security enhancements to the fine-grained access control feature that include a revamped and improved security workflow in Kibana, and integration with Open Distro for Elasticsearch Alerting and Anomaly Detection features. View the full article

Amazon Elasticsearch Service now supports open source Elasticsearch 7.9 and its corresponding version of Kibana. This minor release includes bug fixes and enhancements. View the full article

Setting up monitoring for your enterprise applications got even easier with Amazon CloudWatch Application Insights new ability to automatically detect applications and setup monitoring based on the detected applications. CloudWatch Application Insights is a capability that helps customers easily setup monitoring and enhanced observability for their enterprise applications running on AWS resources. The new feature automatically populates the applications detected into the setup process for a simple and efficient configuration of application monitoring View the full article

CloudWatch Synthetics now supports monitoring multiple APIs in a single canary and viewing detailed HTTP request reports by using the new minor runtime version, syn-nodejs-2.2. This gives you flexibility to test multiple HTTP requests together and individually monitor metrics of each request. View the full article

Amazon CloudWatch Application Insights today announces the ability to easily add monitoring for Java applications for your enterprise applications. CloudWatch Application Insights is a simple to use capability that with just a few clicks guides customers through setting up monitoring and enhanced observability for enterprise applications running on AWS resources. The new feature monitors metrics emitted by Java along with pertinent application related metrics. View the full article

Session Manager, a capability of AWS Systems Manager, now offers customers greater control over howlong sessions remain idle before being terminated automatically. This feature can help you meetcompliance requirements, such as PCI Requirement 8.1.8, which requires that users reauthenticate if a session is idle for more than 15 minutes. View the full article

Amazon Elasticsearch Service now supports the ability to reload dictionary files without reindexing your data. Elasticsearch uses analyzers to convert string data into terms or tokens that power its search capabilities. These analyzers can do things like remove white space and stop words, perform stemming, handle compound words, and add synonyms. Previously, on Amazon Elasticsearch Service these analyzers could only process data as it was indexed. If you wanted to add some additional synonyms at a later time, you had to reindex your data with the new dictionary file. View the full article

Amazon CloudWatch launches Metrics Explorer – a tag-based dashboard tool that enables customers to filter, aggregate, and visualize operational health and performance metrics by tags. Metrics Explorer provides customers with a flexible troubleshooting experience, allowing them to build their tag-based application health dashboards, identify correlations, and quickly analyse their operational data to pinpoint issues. These tag-based dashboards will stay up to date as resources come and go, and they will help customers to identify the root cause and quickly isolate the issues when an alarm occurs on an application or environment. View the full article

AWS IoT SiteWise, a managed service that makes it easy to collect, store, organize and monitor data from industrial equipment at scale, now supports three new visualization options in SiteWise Monitor: AWS IoT SiteWise Monitor now supports Status charts, a chart type that visualizes data that has a small number of well-defined states. With Status charts, you can now visualize live equipment status as a grid, or view historical status as a timeline simply by configuring conditional thresholds using <, >, ≤, ≥, and = operators and assigning colors to the thresholds. For example, for a temperature sensor, you can define a temperature value greater than, say, 80° F…

Amazon Elasticsearch Service now supports open source Elasticsearch 7.8 and its corresponding version of Kibana. This minor release includes bug fixes and enhancements. View the full article

Amazon launches CloudWatch Synthetics Recorder, a Chrome browser extension, to help you create canaries more easily. The Recorder records your click and type actions on a website and automatically generates a script that you can use to create a canary that follows the same user click and type actions. View the full article

Amazon CloudWatch Application Insights, working closely with customers, has introduced an enhanced user interface to make setting up and managing your enterprise application monitoring even more straight forward. CloudWatch Application Insights is a capability that helps enterprise customers easily setup application monitoring and enhanced observability for AWS resources. The user interface improvements streamline the steps for doing this in a more intuitive and consistent approach. View the full article

We are excited to announce that Amazon Lookout for Metrics now allows you to detect anomalies on your Amazon CloudWatch data. Amazon Lookout for Metrics uses machine learning (ML) to automatically detect and diagnose anomalies (outliers from the norm) without requiring any prior ML experience. Amazon CloudWatch provides you with actionable insights to monitor your applications, respond to system-wide performance changes, optimize resource utilization, and get a unified view of operational health. View the full article

Amazon Elasticsearch Service now supports cold storage, a fully-managed storage tier that makes it easy for customers to securely store and analyze their infrequently accessed data on-demand, at a lower cost than other storage tiers. You pay for compute only when you need it. Cold storage allows you to retain any amount of data in your Amazon Elasticsearch Service domain while reducing cost per GB to near Amazon S3 storage prices. View the full article

Amazon Elasticsearch Service introduces index rollups that lets you summarize high granularity data and preserve feature-rich aggregations over large data sets for analytics while reducing the storage costs. View the full article

Amazon Elasticsearch Service now supports Reporting, a new feature that enables Kibana users to generate and download reports. They can now generate reports directly from the Dashboard, Visualize and Discover panels, and export them to PDF, CSV and PNG file formats. View the full article