大数据之rabbitmq 监控设计 指标采集 / 报警阈值 方案

大数据阿木 发布于 2025-07-12 14 次阅读

RabbitMQ 监控设计：指标采集与报警阈值方案

随着大数据时代的到来，消息队列系统在处理大规模数据传输和异步处理中扮演着越来越重要的角色。RabbitMQ 作为一款流行的消息队列中间件，其稳定性和可靠性对于保障大数据处理流程至关重要。本文将围绕 RabbitMQ 的监控设计，探讨指标采集和报警阈值方案，以确保系统的健康运行。

一、RabbitMQ 监控概述

RabbitMQ 监控主要包括以下几个方面：

1. 连接监控：监控连接数、连接类型、连接状态等。

2. 队列监控：监控队列的数量、大小、消息数量、消息速率等。

3. 交换机监控：监控交换机的类型、绑定关系、消息速率等。

4. 虚拟主机监控：监控虚拟主机的连接数、队列数、交换机数等。

5. 性能监控：监控内存使用、CPU 使用率、磁盘IO等。

二、指标采集方案

1. 使用 Prometheus 和 Grafana

Prometheus 是一款开源的监控和报警工具，Grafana 是一款开源的数据可视化工具。以下是使用 Prometheus 和 Grafana 采集 RabbitMQ 指标的步骤：

（1）安装 Prometheus 和 Grafana

bash
 安装 Prometheus

wget https://github.com/prometheus/prometheus/releases/download/v2.34.0/prometheus-2.34.0.linux-amd64.tar.gz

tar -xvf prometheus-2.34.0.linux-amd64.tar.gz

cd prometheus-2.34.0.linux-amd64



 安装 Grafana

wget https://dl.grafana.com/oss/release/grafana-7.4.3.linux-amd64.tar.gz

tar -xvf grafana-7.4.3.linux-amd64.tar.gz

cd grafana-7.4.3.linux-amd64

（2）配置 Prometheus

编辑 `prometheus.yml` 文件，添加 RabbitMQ 指标采集配置：

yaml
scrape_configs:

  - job_name: 'rabbitmq'

    static_configs:

      - targets: ['localhost:15672']

        labels:

          instance: 'localhost'

（3）配置 Grafana

编辑 `grafana.ini` 文件，配置 Prometheus 数据源：

ini
[datad Sources]

[datad Sources.prometheus]

type = prometheus

url = http://localhost:9090

orgId = 1

（4）创建 Grafana Dashboard

在 Grafana 中创建一个新的 Dashboard，添加 RabbitMQ 相关的指标图表。

2. 使用 RabbitMQ 自带指标

RabbitMQ 自带了一些指标，可以通过 HTTP API 获取。以下是一个简单的 Python 脚本，用于采集 RabbitMQ 指标：

python
import requests



def get_rabbitmq_metrics():

    url = 'http://localhost:15672/api/monitoring/metrics'

    response = requests.get(url)

    if response.status_code == 200:

        return response.json()

    else:

        return None



if __name__ == '__main__':

    metrics = get_rabbitmq_metrics()

    print(metrics)

三、报警阈值方案

1. 设置报警规则

在 Prometheus 中，可以设置报警规则来触发报警。以下是一个简单的报警规则示例：

yaml
alerting:

  alertmanagers:

    - static_configs:

        - targets:

            - 'localhost:9093'

rules:

  - alert: RabbitMQConnectionError

    expr: rabbitmq_connections{state="closed"} > 0

    for: 1m

    labels:

      severity: critical

    annotations:

      summary: "RabbitMQ connection error"

      description: "Number of closed connections is {{ $value }}"

2. 配置报警通知

在 Prometheus 中，可以配置报警通知方式，如邮件、短信、Slack 等。以下是一个配置邮件通知的示例：

```yaml

alerting:

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

- static_configs:

- targets:

- 'localhost:9093'

alertmanagers:

-