aws

Monitoring And Logging

EventBridge:

Overview

• Cloudwatch events are renamed to EventBridge with additional functionality
• It provides all the functionality like cloudwatch events, and it also supports custom events
• Key elements:
  • Event buses: Event buses receive events from a variety of sources and match them to rules in your account
  • Event
  • EventBridge Rule
  • Target

CloudWatch Alarms:

Overview

• Key elements:
  • Alarm notification: notifying when an alarm is triggered
  • Alarm action: performing some action when an alarm is triggered

CloudWatch Logs and Metrics:

Overview

• Metrics:
  • Some are provided by aws, and we can create our own custom metrics and namespaces as well
  • They are regional
  • Namespace is a container for metrics
    • example: AWS/EBS, AWS/ELB, AWS/EC2 etc –> Remember the format
  • Can’t be deleted but will expire after 15 months
  • Cloudwatch dimension: K:V pair that uniquely identifies a metric
  • Metrics streams: Stream metrics to s3 or firehose
• Logs:
  • Log groups
  • Log streams
  • Logs
  • Log events
  • Log agent
  • Retention policies
  • Metric filters

CloudTrail:

Overview

• Used for auditing on AWS –> CloudTrail records API activity
• CloudTrail logs are stored in S3
• Enable log file validation: To determine whether a log file was modified, deleted, or unchanged after AWS CloudTrail delivered it
• CloudTrail can send logs to CloudWatch

Kinesis:

Overview

• When you see real time data flow think of Kinesis
• Collect, process, analyze, stream data real time
• Types of Kinesis
  • Kinesis Video stream:
    • stream videos real time
  • Kinesis Data stream:
    • Collect gigabytes of data per second and make it available for processing and analyzing in real time
  • Kinesis Data Firehose:
    • Process and deliver data streams
    • Amazon Kinesis Data Firehose is the easiest way to capture, transform, and load data streams into AWS data stores for near real-time analytics with existing business intelligence tools
    • Does ETL for the data
    • Stream data to aws redshift, s3, Elastic search and splunk
  • Kinesis Data Analytics :
    • Analyze streaming data and gain actionable insights in real time

XRay:

Overview

• AWS X-Ray makes it easy for developers to analyze the behavior of their distributed applications by providing request tracing, exception collection, and profiling capabilities
• Implementation:
  • XRAY SDK -> XRAY DAEMON -> XRAY API
• XRAY Color codes
  • Green - success
  • Red - server fault
  • Yellow - client fault
  • Purple - Throttling error

AWS OpenSearch (Elasticsearch):

Overview

• Amazon OpenSearch Service domains are OpenSearch/Elasticsearch clusters
• Provides realtime analytics

Tagging and Resource Groups

Overview:

• Tagging and Resource Groups can be used for automations