eG Monitoring

Measures reported by AWSMSKClusteTest AWS MSK Cluster uses Amazon EBS volume which is a durable, block-level storage device that you can attach to your instances. After you attach a volume to an instance, you can use it as you would use a physical hard drive. EBS volumes are flexible. Amazon EBS volume types that use burst performance, such as gp2, st1, and sc1, have a baseline performance depending on volume size. If your workload is driving I/O traffic to one of these volume types beyond its baseline performance, then burst credit gets spent. This test helps the administrators to monitor whether/not the input-output burst balance is running out of credits for EBS volumes in the cluster such that the volume stops and no further reads or writes will occur until more credits are earned. Outputs of the test: One set of results for each cluster executing in the target AWS Managed Service Kafka server. Descriptor: Cluster The measures made by this test are as follows:
Measurement | Description | Measurement Unit | Interpretation
--- | --- | --- | ---
burstBalance | Indicates the remaining balance of input-output burst credits for EBS volumes in the cluster. | Number | Burst Balance is not reported for EBS volumes when the baseline performance of a volume is higher than the maximum burst performance.
messagesInPerSec | Indicates the rate at which the messages are incoming to the broker. | Messages/Sec |
dataInPerSec | Indicates the average rate at which data sent from producers is consumed by the broker. | MB |
dataOutPerSec | Indicates the average rate at which data is fetched and read from the broker. | MB |
kafkaAppLogsDiskUsed | Indicates the percentage of disk space used for application logs. | Percent |
leaderCount | Indicates the number of replicas for which this broker is the leader. | Number |
partitionCount | Indicates the number of partitions in the broker. | Number |
requestBytesMean | Indicates the amount of data received during the last measurement period. | MB |
requestTime | Indicates the total amount of time taken for reading the request and sending the result. | Seconds |
rootDiskUsed | Indicates the percentage of the root disk used by the broker. | Percent |
swapFree | Indicates the size of swap memory that is available for the broker. | MB |
swapUsed | Indicates the size of swap memory that is in use for the broker. | MB |
underMinIsrPartitionCoun | Indicates the number of partitions under the minimum In-Sync Replica (ISR) count. | Number | The ISR count indicates the set of replicas that are up-to-date with the leader.
underReplicatedPartition | Indicates the number of partitions that have not been fully replicated in the follower replicas. | Number |
bwInAllowanceExceeded | Indicates the number of packets shaped because the inbound aggregate bandwidth exceeded the maximum for the broker. | Number |
bwOutAllowanceExceeded | Indicates the number of packets shaped because the outbound aggregate bandwidth exceeded the maximum for the broker. | Number |
ppsAllowanceExceeded | Indicates the number of packets shaped because the bidirectional PPS exceeded the maximum for the broker. | Number |
requestHandlerAvgIdlePer | Indicates the average percentage of the time the request handler threads are idle. | Percent |