Monitoring & Observability

Amazon Elasticsearch Service adds Trace Analytics, a new feature for distributed tracing that enables developers and IT operators to find and fix performance problems in distributed applications, leading to faster problem resolution times. View the full article

Amazon CloudWatch Synthetics adds support to create canaries for your Amazon API Gateway APIs using the API blueprint. This simplifies your canary setup time and makes it easy to monitor your API Gateway APIs. View the full article

AWS announces the availability of Fluent Bit support for Amazon CloudWatch, a fully managed, pay-as-you-go monitoring and observability service for resources running on AWS and on-premises. CloudWatch Container Insights and Log Insights enables you to explore, analyze, and visualize your container logs collected from the Fluent Bit processor. Container Insights also provides access to the automated dashboards that summarize the performance and availability of the FluentBit Daemon set running on Amazon Elastic Kubernetes Service (EKS) and Kubernetes. View the full article

Amazon Elasticsearch Service now supports encryption of data at rest and node-to-node encryption on existing domains, enabling organizations hosting sensitive workloads to meet stringent security and compliance requirements. View the full article

Now enterprises with Oracle databases can easily setup monitoring, alerting and dashboards for their EC2 and RDS Oracle instances on AWS with CloudWatch Application Insights. CloudWatch Application Insights is a capability that helps customers simply setup monitoring and enhanced observability for their enterprise applications running on AWS resources. The new feature automatically setups the metrics, telemetry and logs for monitoring the health and wellness of Oracle databases running in AWS. View the full article

Today, AWS and Grafana Labs launched the AWS IoT SiteWise plugin for Grafana. This plugin lets you easily visualize your AWS IoT SiteWise data in your Grafana dashboards. With this plugin, you can easily visualize and monitor your equipment data in near-real time using the wide range of visualization options in Grafana dashboards. You can also easily combine data from multiple sources (e.g., AWS IoT SiteWise, Amazon Timestream, Amazon CloudWatch) and monitor them all using a single Grafana dashboard. You can also embed these Grafana dashboards into your custom applications. View the full article

Amazon Elasticsearch Service now supports Piped Processing Language (PPL), a new feature that enables users to explore, discover and find data stored in Amazon ES, using a set of commands delimited by pipes (|). PPL extends Elasticsearch to support a standard set of commands that is easy for system developers, DevOps engineers, support engineers, site reliability engineers (SREs), and IT managers who are proficient with Linux or Unix to learn. PPL enables these users to begin extracting insights from their log, monitoring and observability data on day one. View the full article

Amazon Elasticsearch Service now offers anomaly detection for high cardinality datasets. This new feature enables you to sift through thousands of metrics from millions of events to accurately pinpoint individual entities with abnormal patterns. By leveraging machine learning, Amazon Elasticsearch Service now provides reliable and actionable insights to drastically reduce the time to isolate and remediate issues. High cardinality anomaly detection can be invaluable for a number of operational, security and business use cases like identifying hosts with high CPU and memory consumption, finding services with most error rates, isolating suspicious users or IP addresses acces…

Amazon Elasticsearch Service now offers support for Remote Reindex, enabling you to migrate data from a remote cluster into Amazon Elasticsearch Service. With this feature, you can simply copy data from one cluster to another, making it easier to migrate from legacy versions of Elasticsearch. Remote Reindex also supports migrating indexes from self-managed Elasticsearch onto Amazon Elasticsearch Service, providing a simple mechanism to onboard onto the service. View the full article

CloudWatch Synthetics now supports canary scripts in Python programming language with the Selenium open source web automation testing framework. This gives you more choice in the programming language and framework to use when creating canaries in CloudWatch Synthetics. View the full article

Amazon Elasticsearch Service now supports Gantt charts, a new visualization in Kibana. Users can now embed Gantt charts into dashboards to enable visualization of events, steps and tasks as horizontal bars. The length of the bars shows the amount of time associated with an event, step or a task. Gantt charts are used to represent a series of events that contain a parent-child relationship. This can be particularly useful in trace analytics, telemetry, and monitoring use cases, in which the users need to understand the overall interaction between traces or events. Gantt charts help users manage their resources by getting an overview of the events or tasks and understanding…

Amazon Elasticsearch Service has introduced several security enhancements to the fine-grained access control feature that include a revamped and improved security workflow in Kibana, and integration with Open Distro for Elasticsearch Alerting and Anomaly Detection features. View the full article

Amazon Elasticsearch Service has introduced several security enhancements to the fine-grained access control feature that include a revamped and improved security workflow in Kibana, and integration with Open Distro for Elasticsearch Alerting and Anomaly Detection features. View the full article

Amazon Elasticsearch Service now supports open source Elasticsearch 7.9 and its corresponding version of Kibana. This minor release includes bug fixes and enhancements. View the full article

Setting up monitoring for your enterprise applications got even easier with Amazon CloudWatch Application Insights new ability to automatically detect applications and setup monitoring based on the detected applications. CloudWatch Application Insights is a capability that helps customers easily setup monitoring and enhanced observability for their enterprise applications running on AWS resources. The new feature automatically populates the applications detected into the setup process for a simple and efficient configuration of application monitoring View the full article

CloudWatch Synthetics now supports monitoring multiple APIs in a single canary and viewing detailed HTTP request reports by using the new minor runtime version, syn-nodejs-2.2. This gives you flexibility to test multiple HTTP requests together and individually monitor metrics of each request. View the full article

Amazon CloudWatch Application Insights today announces the ability to easily add monitoring for Java applications for your enterprise applications. CloudWatch Application Insights is a simple to use capability that with just a few clicks guides customers through setting up monitoring and enhanced observability for enterprise applications running on AWS resources. The new feature monitors metrics emitted by Java along with pertinent application related metrics. View the full article

Session Manager, a capability of AWS Systems Manager, now offers customers greater control over howlong sessions remain idle before being terminated automatically. This feature can help you meetcompliance requirements, such as PCI Requirement 8.1.8, which requires that users reauthenticate if a session is idle for more than 15 minutes. View the full article

Amazon Elasticsearch Service now supports the ability to reload dictionary files without reindexing your data. Elasticsearch uses analyzers to convert string data into terms or tokens that power its search capabilities. These analyzers can do things like remove white space and stop words, perform stemming, handle compound words, and add synonyms. Previously, on Amazon Elasticsearch Service these analyzers could only process data as it was indexed. If you wanted to add some additional synonyms at a later time, you had to reindex your data with the new dictionary file. View the full article

Amazon CloudWatch launches Metrics Explorer – a tag-based dashboard tool that enables customers to filter, aggregate, and visualize operational health and performance metrics by tags. Metrics Explorer provides customers with a flexible troubleshooting experience, allowing them to build their tag-based application health dashboards, identify correlations, and quickly analyse their operational data to pinpoint issues. These tag-based dashboards will stay up to date as resources come and go, and they will help customers to identify the root cause and quickly isolate the issues when an alarm occurs on an application or environment. View the full article

AWS IoT SiteWise, a managed service that makes it easy to collect, store, organize and monitor data from industrial equipment at scale, now supports three new visualization options in SiteWise Monitor: AWS IoT SiteWise Monitor now supports Status charts, a chart type that visualizes data that has a small number of well-defined states. With Status charts, you can now visualize live equipment status as a grid, or view historical status as a timeline simply by configuring conditional thresholds using <, >, ≤, ≥, and = operators and assigning colors to the thresholds. For example, for a temperature sensor, you can define a temperature value greater than, say, 80° F…

Free Courses (here) Paid Courses Linux Academy DevOps Monitoring Deep Dive

Amazon Elasticsearch Service now supports open source Elasticsearch 7.8 and its corresponding version of Kibana. This minor release includes bug fixes and enhancements. View the full article

Here is a list of monitoring tools for DevOps, we will be reviewing each of these; Datadog Prometheus SignalFx Splunk VictorOps

Amazon launches CloudWatch Synthetics Recorder, a Chrome browser extension, to help you create canaries more easily. The Recorder records your click and type actions on a website and automatically generates a script that you can use to create a canary that follows the same user click and type actions. View the full article

Amazon CloudWatch Application Insights, working closely with customers, has introduced an enhanced user interface to make setting up and managing your enterprise application monitoring even more straight forward. CloudWatch Application Insights is a capability that helps enterprise customers easily setup application monitoring and enhanced observability for AWS resources. The user interface improvements streamline the steps for doing this in a more intuitive and consistent approach. View the full article

We are excited to announce that Amazon Lookout for Metrics now allows you to detect anomalies on your Amazon CloudWatch data. Amazon Lookout for Metrics uses machine learning (ML) to automatically detect and diagnose anomalies (outliers from the norm) without requiring any prior ML experience. Amazon CloudWatch provides you with actionable insights to monitor your applications, respond to system-wide performance changes, optimize resource utilization, and get a unified view of operational health. View the full article

Amazon Elasticsearch Service now supports cold storage, a fully-managed storage tier that makes it easy for customers to securely store and analyze their infrequently accessed data on-demand, at a lower cost than other storage tiers. You pay for compute only when you need it. Cold storage allows you to retain any amount of data in your Amazon Elasticsearch Service domain while reducing cost per GB to near Amazon S3 storage prices. View the full article

Amazon Elasticsearch Service introduces index rollups that lets you summarize high granularity data and preserve feature-rich aggregations over large data sets for analytics while reducing the storage costs. View the full article

Amazon Elasticsearch Service now supports Reporting, a new feature that enables Kibana users to generate and download reports. They can now generate reports directly from the Dashboard, Visualize and Discover panels, and export them to PDF, CSV and PNG file formats. View the full article