Amazon MQ Monitoring Integration
Amazon MQ is a messaging service that helps communicate messages between various applications and components. With Site24x7's integration, monitor your Amazon MQ service and get full visibility on all the broker and destination metrics.
To make your monitoring experience easier, the components monitored for MQ are classified as four monitors:
- Amazon MQ Broker
- Amazon MQ Topic
- Amazon MQ Queue
- Amazon MQ Network Connector
Setup and configuration
- If you haven't already, enable access to your AWS resources between your AWS account and Site24x7's AWS account by either:
- Creating Site24x7 as an IAM user.
- Creating a cross-account IAM role. Learn more.
- On the Integrate AWS Account page, check the box next to Amazon MQ. Learn more.
Policy and permissions
Site24x7 uses various Amazon MQ APIs to collect information on your messaging service. Assign the AWS Managed policy ReadOnlyAccess to the Site24x7 entity (IAM user or IAM role) to help Site24x7 collect metrics and metadata. If you want to assign a custom policy, please make sure the following read-level actions are present in the policy JSON. Learn more.
- "mq:DescribeBroker",
- "mq:DescribeConfiguration",
- "mq:DescribeConfigurationRevision",
- "mq:DescribeUser",
- "mq:ListTags",
- "mq:ListBrokers",
- "mq:DescribeBrokerEngineTypes",
- "cloudwatch:ListMetrics",
- "logs:DescribeLogStreams",
- "logs:GetLogEvents"
Polling Frequency
Site24x7 collects metric data on your clusters, namespace and nodes as per the poll frequency set, ranging from one minute up to one day. Learn more.
IT Automations
You can add automations for the AWS services supported by Site24x7. Log in to Site24x7 and go to Admin > IT Automation Templates (+) > Add Automation Templates. Once automations are added, you can schedule them to be executed one after the other.
You can now reboot an Amazon MQ broker automatically using Amazon MQ automations.
Licensing
Each of the customer-managed Amazon MQ will be considered a basic monitor, except the Amazon MQ Network Connector. For an Amazon MQ Network Connector, it consumes one basic monitor license for five monitors.
Performance Metrics
| CloudWatch Metric | Description | Statistics | Unit |
| Burst Balance | The remaining percentage of the underlying storage layer's Amazon EBS volume burst credits | Average | Percent |
| Cpu Credit Balance | The number of earned CPU credits that an instance has accrued since it was launched or started (including the number of launch credits). The credit balance is available for the broker instance to spend on bursts beyond the baseline CPU utilization | Minimum | Credits |
| Cpu Utilization | The percentage of allocated Amazon EC2 compute units that the broker currently uses | Maximum | Percent |
| Current Connections Count | The current number of active connections on the current broker. | Maximum | Count |
| Established Connections Count | The total number of connections, active and inactive, that have been established on the broker. | Maximum | Count |
| Heap Usage | The percentage of the ActiveMQ JVM memory limit that the broker currently uses. | Maximum | Percent |
| Network In | The volume of incoming traffic for the broker. | Sum | MB |
| Network Out | The volume of outgoing traffic for the broker. | Sum | MB |
| Open Transaction Count | The total number of transactions in progress. | Maximum | Count |
| Store Percent Usage | The percent used by the storage limit. If this reaches 100, the broker will refuse messages. | Average | Percent |
| Inactive Durable Topic Subscribers Count | The number of inactive durable topic subscribers, up to a maximum of 2000. | Sum | Count |
| Journal Files For Fast Recovery | The number of journal files that will be replayed after a clean shutdown. | Sum | Count |
| Journal Files For Full Recovery | The number of journal files that will be replayed after an unclean shutdown. | Sum | Count |
| Total Consumer Count | The number of message consumers subscribed to destinations on the current broker. | Maximum | Count |
| Total Message Count | The number of messages stored on the broker. | Maximum | Count |
| Total Producer Count | The number of message producers active on destinations on the current broker. | Maximum | Count |
| Volume Read Ops | The number of read operations performed on the Amazon EBS volume. | Sum | Count |
| Volume Write Ops | The number of write operations performed on the Amazon EBS volume. | Sum | Count |
| Total Enqueue Count | The total number of messages that have been sent to the broker. | Sum | Count |
| Total Dequeue Count | The total number of messages that have been consumed by clients. | Sum | Count |
Metrics for Queues and Topics
| CloudWatch Metric | Description | Statistics | Unit |
| Consumer Count | The number of consumers subscribed to the destination. | Maximum | Count |
| Enqueue Time | The end-to-end latency from when a message arrives at a broker until it is delivered to a consumer. | Maximum | Time(millisecond) |
| Expired Count | The number of messages that couldn't be delivered because they expired, per minute. | Sum | Count |
| Dispatch Count | The number of messages sent to consumers, per minute. | Sum | Count |
| Inflight Count | The number of messages sent to consumers that have not been acknowledged. | Sum | Count |
| Memory Usage | The percentage of the memory limit that the destination currently uses. | Average | Percent |
| Producer Count | The number of producers for the destination. | Maximum | Count |
| Queue Size | The number of messages in the queue. Note: This metric is applicable only for Queue. | Maximum | Count |
Metrics for Network Connector
| CloudWatch Metric | Description | Statistics | Unit |
| Enqueue Count | The number of messages sent to the destination, per minute. | Maximum | Count |
| Dequeue Count | The number of messages acknowledged by consumers, per minute. | Sum | Count |
| Receive Count | The number of messages that have been received from the remote broker for a duplex network connector. | Sum | Count |
Threshold Configuration
Go to Admin > Configuration Profiles > Threshold and Availability (+) > choose the monitor type as Amazon MQ Broker/Amazon MQ Topic/Amazon MQ Queue/Amazon MQ Network Connector. You can set threshold values for all the metrics mentioned above. Further, for Amazon MQ Queue and Amazon MQ Topic monitors, you can choose to mute inactive alerts in the threshold form.
Forecast
Estimate future values of the following performance metrics and make informed decisions about adding capacity or scaling your AWS infrastructure.
- CPU Utilization
- Heap Usage
- Store Percent Usage
- Total Enqueue Count
- Total Dequeue Count
- Volume Read Ops
- Volume Write Ops
Similarly, you can also view the forecast for the following metrics of Amazon MQ Queues and Topics:
- Inflight Count
- Memory Usage
Site24x7's Amazon MQ monitoring interface
Summary
Gain an overview of different events occurring within each resource with time series charts. These charts provide event timelines on CPU credit balance, CPU usage, the number of current connections, established connection count, heap usage and network throughput, and many more. All time series charts have the average, minimum, and maximum values listed.
Monitored Resources
On the Monitored Resources tab, you can view a list of Amazon MQ Topics, queues, and network connectors within your Amazon MQ environment. Click on an individual listing to see performance and resource usage stats associated with that resource. You can also set thresholds and be notified when any of these services fail by clicking the pencil icon under Action.
Logs
Collect Amazon MQ log entries for selected log types, with the logs being fetched from CloudWatch.The recent logs tab consists of both Audit log as well as General log.
Configuration
The configuration details of an Amazon MQ are provided under this tab. Details on the broker engine type, broker instance type, deployment type, endpoint URL, security group(s) and many more are listed in this section.
Outages
A list of down, trouble, critical, or maintenance history is displayed in the Outages tab. Details on start time to end time of an outage, duration, and comments (if any) are provided in this section.
Inventory
The configuration details of the threshold for each certificate are set here. The various threshold parameters that can be set include certificate age, and the number of hours, minutes, or days until certificate expiry. The polling frequency and the notification profile can be set according to the user and viewed here.