Using this event template

Welcome slide

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Implementing application

observability

Surbhi Dangi

COP322

(she/her)

Sr. Manager, Product Management,

Observability

AWS

Rodrigue Koffi

(he/him)

Sr. Specialist Solutions Architect,

Observability

AWS

Agenda

01

Understanding application observability

02

Application observability in Amazon CloudWatch

03

Application observability demo

04

Questions

Understanding application

observability

Evolving systems at Example Corp

SQL

database

Java

Evolving systems at Example Corp

NoSQL

DB

SQL

database

Go

Django

External

API

Node.js

Rust

.NET

Java

Go

Vue.js

Message

broker

NoSQL DB

SQL database

Go

Django

External API

Node.js

Rust

.NET

Java

Go

Vue.js

Message

broker

Example Corp

subscription

service

NoSQL DB

SQL Database

Go

Django

External API

Node.js

Rust

.NET

Java

Go

Vue.js

Message

broker

NoSQL DB

SQL database

Go

Django

External API

Node.js

Rust

.NET

Java

Go

Vue.js

Message

broker

Example Corp

recommendation

service

NoSQL DB

SQL database

Go

Django

External API

Node.js

Rust

.NET

Java

Go

Vue.js

Message

broker

Example Corp

internal

redirect

service

NoSQL DB

Node.js

Rust

.NET

Java

Go

Vue.js

Message

broker

Example Corp

metering

service

Evolving systems at Example Corp

The complexity issue

Example Corp builders are

spending more time to resolve

production issues root causes

Observability

Observability describes how

well you can understand what is

happening in a system, often by

instrumenting it to collect metrics,

logs, or traces

AWS observability maturity model

Capability

Maturity

Stage 1: Foundational

monitoring

Stage 2: Intermediate

monitoring

Stage 3: Advanced

observability

Stage 4: Proactive

observability

Collecting logs and metrics

Instrumentation, telemetry

analysis, and insights

Correlation and anomaly

detection

Automatic and proactive root

cause identification

Application

performance

monitoring

Observability on AWS

Amazon CloudWatch AWS X-Ray

Improve your end-

user experience

Reduce operational costsImprove performance

and availability

Understand application health

RUM

Breadth and depth observability

Amazon CloudWatch

Digital Experience

Monitoring

Visualizations

Insights and analysis

Foundations

Partners and

integrations

Instrumentation and collection

Synthetics

Metrics

Internet Monitor

Logs

Traces

Container insights

Lambda insights

Contributor insights

Application insights

Metrics streams

CloudWatch embedded metric format

Metrics explorer

Dashboards

Live Tail

Logs insights

Cross-account

observability

OpenTelemetry

CloudWatch agent

We were looking to consolidate all our monitoring,

logging, metrics, and alerting under one tool.

CloudWatch has helped us alleviate the operational

burden to set up, configure, and learn third-party

systems. Our teams use CloudWatch extensively to

monitor error rates and status codes for multiple

high-profile workloads.

Mapbox

We have been using Amazon CloudWatch RUM to

monitor our website performance, specifically page

load times, JavaScript errors, and other core web

vital metrics. Using RUM has helped our team

collect and measure real-world performance

metrics of our websites, while also giving us a

unified way to collect and analyze that data.

Booking.com

Application performance

monitoring in Amazon CloudWatch

How can Example Corp improve?

1/ Setup instrumentation 2/ Collect telemetry

5/ Setup alarms

3/ Setup service health

dashboards

4/ Setup end-user

experience monitoring

Step 1: Setup instrumentation

Structure your logs

Use log levels appropriately

Filter logs close to the source

Avoid double-ingestion anti-patterns

Log to stdout

Logs

Troubleshooting across incidents,

configuration changes, and deployments

Real-time visibility of streaming log data

with a single click

Filter, explore, and analyze streaming

log data

Search and highlight terms

NEW IN GA

Amazon CloudWatch Logs Live Tail

Amazon CloudWatch Logs infrequent access

New Logs class with lower cost ingestion

Supports managed ingestion, encryption and

cross-account log analytics

Ideal for ad-hoc querying and after-the-fact

forensic analysis

NEW IN GA

Enables you to ask questions in plain

language

Generate your query and analyze your

data faster

Powered by generative AI technology

Supports CloudWatch Logs Insights and

Metrics Insights

Amazon CloudWatch natural language

query generation

NEW IN PREVIEW

Summarizing thousands of logs into

handful patterns

Quickly see what changed with new

Compare mode in Logs Insights

Automated insights for known and

unknown behavior

Faster and richer insights at scale

Amazon CloudWatch Logs anomaly detection

NEW IN GA

Step 1: Setup instrumentation

Define your business objectives

Define baselines

Leverage anomaly detection

Derive metrics from your logs

Metrics

Easy getting started experience

Out-of-the-box Kube-State metrics, Control

Plane metrics, and Container level metrics

Opinionated observability highlighting risky

components enabling proactive mitigation

End-to-end infra and app monitoring with

impact analysis to define severity and priority

Amazon CloudWatch Container Insights with

enhanced observability for Amazon EKS

NEW IN GA

EKS add-on for Amazon CloudWatch Agent

Easily operate the

Amazon CloudWatch

Agent with the new

Amazon EKS add-on

Step 1: Setup instrumentation

Leverage distributed tracing

Leverage automatic instrumentation libraries

Leverage annotations and metadata on

AWS X-Ray

Consider adopting OpenTelemetry as

a standard

Traces

Step 2: Collect telemetry

1/ Setup instrumentation 2/ Collect telemetry

5/ Setup alarms

3/ Setup service health

dashboards

4/ Setup end-user

experience monitoring

New CloudWatch Agent

Amazon CloudWatch

AWS X-Ray

Metrics

StatsD

collectd

Prometheus

EMF

CloudWatch Agent

Logs

Traces

OTel

X

-Ray SDK

Collection for AWS workloads and on-premises

Amazon

CloudWatch

Amazon EC2

Amazon Elastic Container Service

Amazon Elastic Kubernetes Service

Amazon CloudWatch

Agent

AWS X-Ray

Installation and lifecycle

management

Standardized telemetry and

best practices

Agent health and performance

monitoring

Configuration via Workload

Discovery

Step 3: Setup service health dashboards

1/ Setup instrumentation 2/ Collect telemetry

5/ Setup alarms

3/ Setup service health

dashboards

4/ Setup end-user

experience monitoring

Demo

Application observability demo

Amazon ECS

Amazon SQS

AWS Lambda

Users

Application Load

Balancer

AWS Amplify app

CloudWatch RUM

Amazon SNS

AWS DynamoDB

Amazon Bedrock

Votes service

Haiku service

Demo architecture

Diving into the CloudWatch console

One more thing…

Out-of-the-box best practice alarm

recommendations enable you to quickly

set up essential monitoring for your AWS

resources

See metric description of your AWS

resources in dashboards across the AWS

console for faster troubleshooting

Amazon CloudWatch Out-of-the-box best

practice alarms

NEW IN GA

Single monitoring location for hybrid,

multicloud, and 3

rd

-party metrics data

Configure a data source in minutes and

query metrics for faster insights

Create your own connector via AWS

Lambda

Amazon CloudWatch multi data source querying

NEW IN GA

Recap: Operational readiness at Example Corp

1/ Setup instrumentation 2/ Collect telemetry

5/ Setup alarms

3/ Setup service health

dashboards

4/ Setup end-user

experience monitoring

S K I L L B U I L D E R -

A W S

O B S E R V A B I L I T Y

A W S

O B S E R V A B I L I T Y

A C C E L E R A T O R

O B S E R V A B I L I T Y

B E S T

P R A C T I C E S

O N E

O B S E R V A B I L I T Y

W O R K S H O P

Observability resources

Cloud Ops Kiosks

VR

EXP E R I E N C E

ME E T T HE

EXPERT S

SWA G

VI SIT US @ T H E KIOS K I N T HE A W S V ILL AGE

Related sessions

Today (11/29)

• COP326 - Get actionable insights from Amazon CloudWatch Logs, this venue! | Breakout session

• COP328 - How to manage applications at scale and innovate faster with AWS | Breakout session

Tomorrow (11/30)

• COP309-R3 - Monitor end user experience with Amazon CloudWatch | Hands-on Builder’s session

• COP319 - Best practices for container observability | Breakout session

• COP345 - Hands-on experience with AWS managed open source observability | Hands-on workshop

Thank you!

Please complete the session

survey in the mobile app

Thank you!

Please complete the session

survey in the mobile app

Surbhi Dangi

LinkedIn: /in/surbhidangi

Rodrigue Koffi

LinkedIn: /in/grkoffi