Creating Alarm in AWS for EC2 Instances

Question

How to create alarm when 1) Alert when EC2 instance runs for too long (Say for 1 hour). 2)Alert when number of EC2 instances reaches a threshold (say 5 instances at a time)

One more assumption is, these EC2 instance are specific.Say these alerts applicable to EC2 instances where their instance name start with "test".

When i try to create the alarm , i haven't see this logic in Metrics. Standard Metrics include CPU Utilization, Network In, Network Out etc.

Is there a way to create this alarm either by defining our custom metrics or some other options?

Answer 1

I recently implemented a solution (see Github repo) to create alarms for EC2 instances based on runtime, but the approach can also be adapted for instance count. Here's how I approached it:

1. Create an AWS Lambda function that is triggered periodically by an Amazon EventBridge (CloudWatch Events) rule.
2. In the Lambda function, use the Boto3 library to describe all running EC2 instances and filter them based on specific tags (e.g., instances with names starting with "test").
3. For each relevant instance, calculate the runtime by comparing the current time with the instance's launch time. If the runtime exceeds a specified threshold (e.g., 1 hour), send an alert using Amazon SNS or another notification mechanism.
4. To alert when the number of EC2 instances reaches a threshold (e.g., 5 instances), keep a count of the relevant running instances and send an alert if the count exceeds the threshold.

Here's a simplified version of the Lambda function:

import boto3
from datetime import datetime, timezone

def lambda_handler(event, context):
    ec2 = boto3.client('ec2')
    
    # Specify the desired runtime threshold in hours
    runtime_threshold = 1
    
    # Specify the desired instance count threshold
    instance_count_threshold = 5
    
    # Get all running EC2 instances
    instances = ec2.describe_instances(Filters=[
        {'Name': 'instance-state-name', 'Values': ['running']},
        {'Name': 'tag:Name', 'Values': ['test*']}
    ])
    
    instance_count = 0
    for reservation in instances['Reservations']:
        for instance in reservation['Instances']:
            instance_count += 1
            
            # Calculate runtime
            launch_time = instance['LaunchTime']
            current_time = datetime.now(timezone.utc)
            runtime = current_time - launch_time
            runtime_hours = runtime.total_seconds() / 3600
            
            if runtime_hours > runtime_threshold:
                # Send runtime alert
                send_alert(f"Instance {instance['InstanceId']} has been running for {runtime_hours:.2f} hours.")
    
    if instance_count > instance_count_threshold:
        # Send instance count alert
        send_alert(f"There are currently {instance_count} running instances.")

def send_alert(message):
    # Implement your alert mechanism here (e.g., SNS, email)
    print(message)

This Lambda function retrieves all running EC2 instances with names starting with "test", calculates their runtime, and sends alerts if the runtime exceeds the specified threshold. It also sends an alert if the total count of relevant instances exceeds the specified threshold.

Note: Make sure to replace the send_alert function with your desired alert mechanism (e.g., SNS, email).

I hope this helps!