можно использовать стек rabbitmq -> telegraf+influxDB (на одном хосте, возможно добавить после influxdb добавить кеш trikster - не пробовал) -> Графана
1) Мониторим все золотые метрики (Disk,CPU, erlang procs, connections, consumers и т.д.) как светофор вверху, для привлечения внимания 1 линии/мониторинга.
queue_vhost:
from(bucket: "rabbitmq")
|> range(start: -7d)
|> filter(fn: (r) => r["_measurement"] == "rabbitmq_queue")
|> filter(fn: (r) => r["_field"] == "messages_publish")
|> group()
|> distinct(column: "vhost")
|> sort()
queue_name
from(bucket: "rabbitmq")
|> range(start: -1h)
|> filter(fn: (r) => r["_measurement"] == "rabbitmq_queue")
|> filter(fn: (r) => r["_field"] == "messages_publish")
|> filter(fn: (r) => r["vhost"] == "${queue_vhost}" )
|> group()
|> distinct(column: "queue")
должно получиться типа:
добавить опции мультивыбора и ALL для очередей. Также названия переменных в форме
(выбор vhost и т.д.)
3) В визуализациях контролировать кол-во публикаций и кол-во сообщений не вычитанных из топиков/очередей
- запрос на кол-во сообщений опубликованных (дельта между кол-вом published по очередям):
from(bucket: "rabbitmq")
|> range(start: v.timeRangeStart, stop: v.timeRangeStop)
|> filter(fn: (r) => r["_measurement"] == "rabbitmq_queue")
|> filter(fn: (r) => r["_field"] == "messages_publish")
// не используем "contains" - очень медленный. Используем выбор по regex
// |> filter(fn: (r) => contains(value: r["queue"], set: ${queue_name:json})) |> filter(fn: (r) => r["vhost"] =~ /^${queue_vhost:regex}$/)
|> filter(fn: (r) => r["vhost"] =~ /^${queue_vhost:regex}$/)
|> filter(fn: (r) => r["queue"] =~ /^${queue_name:regex}$/)
|> aggregateWindow(every: $__interval, fn: last, createEmpty: false) // Берем последнее значение в окне
|> derivative(unit: $__interval, nonNegative: true) // Считаем скорость в сообщ./сек, игнорируя сбросы
|> yield(name: "publish_rate_per_10minut")
выглядеть будет примерно так:
можно обрезать/трансформировать (rename by regex) в выводе лишнюю информацию
^message.+node\=(.+)url\=.+\:15672\"\,(.*)
$1 $2
- запрос на кол-во невычитанных сообщений (ready):
from(bucket: "rabbitmq")
|> range(start: v.timeRangeStart, stop: v.timeRangeStop)
|> filter(fn: (r) => r["_measurement"] == "rabbitmq_queue")
|> filter(fn: (r) => r["_field"] == "messages_ready")
// |> filter(fn: (r) => contains(value: r["queue"], set: ${queue_name:json}))
|> filter(fn: (r) => r["vhost"] =~ /^${queue_vhost:regex}$/)
|> filter(fn: (r) => r["queue"] =~ /^${queue_name:regex}$/)
|> aggregateWindow(every: $__interval, fn: last, createEmpty: false) // Берем последнее значение в окне
|> yield(name: "unread_per_10minut")
Выглядеть будет примерно так:
Общий json дашборда:
{
"annotations": {
"list": [
{
"builtIn": 1,
"datasource": {
"type": "grafana",
"uid": "-- Grafana --"
},
"enable": true,
"hide": true,
"iconColor": "rgba(0, 211, 255, 1)",
"name": "Annotations & Alerts",
"type": "dashboard"
}
]
},
"description": "",
"editable": true,
"fiscalYearStartMonth": 0,
"graphTooltip": 0,
"id": 603,
"links": [],
"liveNow": false,
"panels": [
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"fieldConfig": {
"defaults": {
"mappings": [],
"min": 2000,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "#EAB839",
"value": 4000
},
{
"color": "red",
"value": 6000
}
]
},
"unit": "none"
},
"overrides": []
},
"gridPos": {
"h": 5,
"w": 2,
"x": 0,
"y": 0
},
"id": 8,
"maxDataPoints": 2000,
"options": {
"colorMode": "background",
"graphMode": "area",
"justifyMode": "auto",
"orientation": "auto",
"reduceOptions": {
"calcs": [
"lastNotNull"
],
"fields": "",
"values": false
},
"textMode": "auto"
},
"pluginVersion": "9.5.21",
"targets": [
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": true,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"exchanges\") // Общее количество обменников\r\n// |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_exchanges_per_node\")\r\n",
"refId": "A"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": true,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"connections\") \r\n// |> last()\r\n// |> group(columns: [\"node\"]) // Группировка по узлу должна разделить данные\r\n |> yield(name: \"connections_per_node\")",
"refId": "B"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": false,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"queues\") // Общее количество обменников\r\n// |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_exchanges_per_node\")\r\n ",
"refId": "C"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": true,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"proc_used\") // Общее количество обменников\r\n |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_proc_used_per_node\")",
"refId": "D"
}
],
"title": "Число очередей",
"transformations": [
{
"id": "renameByRegex",
"options": {
"regex": "(^exchanges|connections|queues).*$",
"renamePattern": "$1"
}
}
],
"type": "stat"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"fieldConfig": {
"defaults": {
"mappings": [],
"min": 4000,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "#EAB839",
"value": 6000
},
{
"color": "red",
"value": 8000
}
]
},
"unit": "none"
},
"overrides": []
},
"gridPos": {
"h": 5,
"w": 2,
"x": 2,
"y": 0
},
"id": 9,
"maxDataPoints": 2000,
"options": {
"colorMode": "background",
"graphMode": "area",
"justifyMode": "auto",
"orientation": "auto",
"reduceOptions": {
"calcs": [
"lastNotNull"
],
"fields": "",
"values": false
},
"textMode": "auto"
},
"pluginVersion": "9.5.21",
"targets": [
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": false,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"exchanges\") // Общее количество обменников\r\n// |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_exchanges_per_node\")\r\n",
"refId": "A"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": true,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"connections\") \r\n// |> last()\r\n// |> group(columns: [\"node\"]) // Группировка по узлу должна разделить данные\r\n |> yield(name: \"connections_per_node\")",
"refId": "B"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": true,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"queues\") // Общее количество обменников\r\n// |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_exchanges_per_node\")\r\n ",
"refId": "C"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": true,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"proc_used\") // Общее количество обменников\r\n |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_proc_used_per_node\")",
"refId": "D"
}
],
"title": "Число обменников",
"transformations": [
{
"id": "renameByRegex",
"options": {
"regex": "(^exchanges|connections|queues).*$",
"renamePattern": "$1"
}
}
],
"type": "stat"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"fieldConfig": {
"defaults": {
"mappings": [],
"min": 8000,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "#EAB839",
"value": 15000
},
{
"color": "red",
"value": 20000
}
]
},
"unit": "none"
},
"overrides": []
},
"gridPos": {
"h": 5,
"w": 2,
"x": 4,
"y": 0
},
"id": 10,
"maxDataPoints": 2000,
"options": {
"colorMode": "background",
"graphMode": "area",
"justifyMode": "auto",
"orientation": "auto",
"reduceOptions": {
"calcs": [
"lastNotNull"
],
"fields": "",
"values": false
},
"textMode": "auto"
},
"pluginVersion": "9.5.21",
"targets": [
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": true,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"exchanges\") // Общее количество обменников\r\n// |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_exchanges_per_node\")\r\n",
"refId": "A"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": false,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"connections\") \r\n// |> last()\r\n// |> group(columns: [\"node\"]) // Группировка по узлу должна разделить данные\r\n |> yield(name: \"connections_per_node\")",
"refId": "B"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": true,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"queues\") // Общее количество обменников\r\n// |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_exchanges_per_node\")\r\n ",
"refId": "C"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": true,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"proc_used\") // Общее количество обменников\r\n |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_proc_used_per_node\")",
"refId": "D"
}
],
"title": "Число соединений",
"transformations": [
{
"id": "renameByRegex",
"options": {
"regex": "(^exchanges|connections|queues).*$",
"renamePattern": "$1"
}
}
],
"type": "stat"
},
{
"datasource": {
"type": "nin-zabbix-datasource",
"uid": "L2THLq0Sz"
},
"fieldConfig": {
"defaults": {
"mappings": [],
"thresholds": {
"mode": "percentage",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "#EAB839",
"value": 50
},
{
"color": "red",
"value": 70
}
]
},
"unit": "short"
},
"overrides": []
},
"gridPos": {
"h": 5,
"w": 9,
"x": 6,
"y": 0
},
"id": 11,
"options": {
"colorMode": "background",
"graphMode": "area",
"justifyMode": "auto",
"orientation": "auto",
"reduceOptions": {
"calcs": [
"lastNotNull"
],
"fields": "",
"values": false
},
"text": {
"titleSize": 16,
"valueSize": 24
},
"textMode": "value_and_name"
},
"pluginVersion": "9.5.21",
"targets": [
{
"application": {
"filter": ""
},
"countTriggersBy": "",
"datasource": {
"type": "nin-zabbix-datasource",
"uid": "L2THLq0Sz"
},
"evaltype": "0",
"functions": [],
"group": {
"filter": "Сервис/RabbitMQ Брокер сообщений [rabit]"
},
"host": {
"filter": "/^P-rabit-mq0.+win.kxx.gu$/"
},
"itServiceFilter": "",
"item": {
"filter": "/: Space utilization"
},
"itemTag": {
"filter": "Application: Filesystem /"
},
"macro": {
"filter": ""
},
"options": {
"count": false,
"disableDataAlignment": false,
"showDisabledItems": false,
"skipEmptyValues": false,
"useTrends": "default",
"useZabbixValueMapping": false
},
"proxy": {
"filter": ""
},
"queryType": "0",
"refId": "A",
"resultFormat": "time_series",
"schema": 12,
"slaFilter": "",
"slaInterval": "none",
"slaProperty": "sla",
"table": {
"skipEmptyValues": false
},
"tags": {
"filter": ""
},
"textFilter": "",
"trigger": {
"filter": ""
}
},
{
"application": {
"filter": ""
},
"countTriggersBy": "",
"datasource": {
"type": "bnin-zabbix-datasource",
"uid": "L2THLq0Sz"
},
"evaltype": "0",
"functions": [],
"group": {
"filter": "Сервис/RabbitMQ Брокер сообщений [rabit]"
},
"hide": true,
"host": {
"filter": "/^P-rabit-mq0.+win.kxx.gu$/"
},
"itServiceFilter": "",
"item": {
"filter": "Load average (1m avg)"
},
"itemTag": {
"filter": "Application: CPU"
},
"macro": {
"filter": ""
},
"options": {
"count": false,
"disableDataAlignment": false,
"showDisabledItems": false,
"skipEmptyValues": false,
"useTrends": "default",
"useZabbixValueMapping": false
},
"proxy": {
"filter": ""
},
"queryType": "0",
"refId": "B",
"resultFormat": "time_series",
"schema": 12,
"slaFilter": "",
"slaInterval": "none",
"slaProperty": "sla",
"table": {
"skipEmptyValues": false
},
"tags": {
"filter": ""
},
"textFilter": "",
"trigger": {
"filter": ""
}
}
],
"title": "DISK Usage",
"transformations": [
{
"id": "renameByRegex",
"options": {
"regex": "(^P\\-.+)/.*$",
"renamePattern": "$1 DISK usage"
}
}
],
"type": "stat"
},
{
"datasource": {
"type": "bnin-zabbix-datasource",
"uid": "L2THLq0Sz"
},
"fieldConfig": {
"defaults": {
"mappings": [],
"noValue": "0",
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "#EAB839",
"value": 50
},
{
"color": "dark-red",
"value": 70
}
]
},
"unit": "none"
},
"overrides": []
},
"gridPos": {
"h": 5,
"w": 9,
"x": 15,
"y": 0
},
"id": 12,
"options": {
"colorMode": "background",
"graphMode": "area",
"justifyMode": "auto",
"orientation": "vertical",
"reduceOptions": {
"calcs": [
"lastNotNull"
],
"fields": "",
"values": false
},
"text": {
"titleSize": 16,
"valueSize": 24
},
"textMode": "value_and_name"
},
"pluginVersion": "9.5.21",
"targets": [
{
"application": {
"filter": ""
},
"countTriggersBy": "",
"datasource": {
"type": "bnin-zabbix-datasource",
"uid": "L2THLq0Sz"
},
"evaltype": "0",
"functions": [],
"group": {
"filter": "Сервис/RabbitMQ Брокер сообщений [rabit]"
},
"hide": true,
"host": {
"filter": "/^P-rabit-mq0.+win.kxx.gu$/"
},
"itServiceFilter": "",
"item": {
"filter": "/: Space utilization"
},
"itemTag": {
"filter": "Application: Filesystem /"
},
"macro": {
"filter": ""
},
"options": {
"count": false,
"disableDataAlignment": false,
"showDisabledItems": false,
"skipEmptyValues": false,
"useTrends": "default",
"useZabbixValueMapping": false
},
"proxy": {
"filter": ""
},
"queryType": "0",
"refId": "A",
"resultFormat": "time_series",
"schema": 12,
"slaFilter": "",
"slaInterval": "none",
"slaProperty": "sla",
"table": {
"skipEmptyValues": false
},
"tags": {
"filter": ""
},
"textFilter": "",
"trigger": {
"filter": ""
}
},
{
"application": {
"filter": ""
},
"countTriggersBy": "",
"datasource": {
"type": "bnin-zabbix-datasource",
"uid": "L2THLq0Sz"
},
"evaltype": "0",
"functions": [],
"group": {
"filter": "Сервис/RabbitMQ Брокер сообщений [rabit]"
},
"hide": false,
"host": {
"filter": "/^P-rabit-mq0.+win.kxx.gu$/"
},
"itServiceFilter": "",
"item": {
"filter": "CPU utilization"
},
"itemTag": {
"filter": "Application: CPU"
},
"macro": {
"filter": ""
},
"options": {
"count": false,
"disableDataAlignment": false,
"showDisabledItems": false,
"skipEmptyValues": false,
"useTrends": "default",
"useZabbixValueMapping": false
},
"proxy": {
"filter": ""
},
"queryType": "0",
"refId": "B",
"resultFormat": "time_series",
"schema": 12,
"slaFilter": "",
"slaInterval": "none",
"slaProperty": "sla",
"table": {
"skipEmptyValues": false
},
"tags": {
"filter": ""
},
"textFilter": "",
"trigger": {
"filter": ""
}
}
],
"title": "Загрузка CPU",
"transformations": [
{
"disabled": true,
"id": "renameByRegex",
"options": {
"regex": "(^P\\-.+)Load.*$",
"renamePattern": "$1 CPU"
}
}
],
"type": "stat"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"fieldConfig": {
"defaults": {
"mappings": [],
"max": 7000,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "orange",
"value": 6000
},
{
"color": "red",
"value": 7000
}
]
}
},
"overrides": [
{
"matcher": {
"id": "byRegexp",
"options": "/_value$/"
},
"properties": [
{
"id": "displayName",
"value": "всего Consumers"
}
]
}
]
},
"gridPos": {
"h": 5,
"w": 8,
"x": 0,
"y": 5
},
"id": 3,
"maxDataPoints": 10,
"options": {
"orientation": "auto",
"reduceOptions": {
"calcs": [
"lastNotNull"
],
"fields": "",
"values": false
},
"showThresholdLabels": false,
"showThresholdMarkers": true
},
"pluginVersion": "9.5.21",
"targets": [
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_queue\" or r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"consumers\")\r\n |> last() // Получаем последнее значение для текущего момента времени\r\n |> group(columns: [\"node\"]) // Группируем по имени узла\r\n |> sum() // Суммируем потребителей, если они агрегированы по очередям\r\n |> yield(name: \"consumers_per_node\")",
"refId": "A"
}
],
"timeFrom": "1h",
"title": "кол-во Consumer по узлам",
"transformations": [
{
"id": "renameByRegex",
"options": {
"regex": "_value rabbit@(p-rabit.*)",
"renamePattern": "$1"
}
}
],
"type": "gauge"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
"axisPlacement": "auto",
"barAlignment": 0,
"drawStyle": "line",
"fillOpacity": 0,
"gradientMode": "none",
"hideFrom": {
"legend": false,
"tooltip": false,
"viz": false
},
"lineInterpolation": "linear",
"lineStyle": {
"fill": "solid"
},
"lineWidth": 2,
"pointSize": 4,
"scaleDistribution": {
"type": "linear"
},
"showPoints": "auto",
"spanNulls": true,
"stacking": {
"group": "A",
"mode": "none"
},
"thresholdsStyle": {
"mode": "off"
}
},
"mappings": [],
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "red",
"value": 80
}
]
}
},
"overrides": []
},
"gridPos": {
"h": 5,
"w": 7,
"x": 8,
"y": 5
},
"id": 7,
"interval": "1m",
"options": {
"legend": {
"calcs": [
"lastNotNull",
"max"
],
"displayMode": "table",
"placement": "right",
"showLegend": true
},
"tooltip": {
"mode": "multi",
"sort": "none"
}
},
"pluginVersion": "9.5.21",
"targets": [
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": false,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"exchanges\") // Общее количество обменников\r\n// |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_exchanges_per_node\")\r\n",
"refId": "A"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": false,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"connections\") \r\n// |> last()\r\n// |> group(columns: [\"node\"]) // Группировка по узлу должна разделить данные\r\n |> yield(name: \"connections_per_node\")",
"refId": "B"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": false,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"queues\") // Общее количество обменников\r\n// |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_exchanges_per_node\")\r\n ",
"refId": "C"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": true,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_overview\")\r\n |> filter(fn: (r) => r._field == \"proc_used\") // Общее количество обменников\r\n |> last()\r\n// |> group(columns: [\"node\"])\r\n |> yield(name: \"total_proc_used_per_node\")",
"refId": "D"
}
],
"title": "Метрики кластера",
"transformations": [
{
"id": "renameByRegex",
"options": {
"regex": "(^exchanges|connections|queues).*$",
"renamePattern": "$1"
}
}
],
"type": "timeseries"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"fieldConfig": {
"defaults": {
"mappings": [],
"max": 1048576,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "orange",
"value": 599999.9999
},
{
"color": "red",
"value": 1048576
}
]
}
},
"overrides": []
},
"gridPos": {
"h": 5,
"w": 9,
"x": 15,
"y": 5
},
"id": 4,
"maxDataPoints": 10,
"options": {
"orientation": "auto",
"reduceOptions": {
"calcs": [
"lastNotNull"
],
"fields": "",
"values": false
},
"showThresholdLabels": false,
"showThresholdMarkers": true
},
"pluginVersion": "9.5.21",
"targets": [
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_node\")\r\n |> filter(fn: (r) => r._field == \"proc_used\")\r\n |> last() // Последнее значение\r\n |> group(columns: [\"node\"]) // Группируем по узлу\r\n |> yield(name: \"connections_per_node\")",
"refId": "A"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"hide": true,
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r._measurement == \"rabbitmq_node\")\r\n |> filter(fn: (r) => r._field == \"proc_total\")\r\n |> last() // Получаем последнее значение, так как total обычно не меняется часто\r\n |> group(columns: [\"node\"]) // Группируем по имени узла\r\n |> yield(name: \"proc_total_per_node\")",
"refId": "B"
}
],
"timeFrom": "1h",
"title": "кол-во Процессов (erlang) по узлам",
"transformations": [
{
"id": "renameByRegex",
"options": {
"regex": "_value rabbit@(p-rabit.*)",
"renamePattern": "$1"
}
}
],
"type": "gauge"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"description": "",
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisCenteredZero": false,
"axisColorMode": "text",
"axisGridShow": true,
"axisLabel": "",
"axisPlacement": "left",
"fillOpacity": 80,
"gradientMode": "none",
"hideFrom": {
"legend": false,
"tooltip": false,
"viz": false
},
"lineWidth": 1,
"scaleDistribution": {
"type": "linear"
},
"thresholdsStyle": {
"mode": "off"
}
},
"mappings": [],
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "red",
"value": 80
}
]
}
},
"overrides": []
},
"gridPos": {
"h": 11,
"w": 24,
"x": 0,
"y": 10
},
"id": 1,
"interval": "2m",
"maxDataPoints": 150,
"options": {
"barRadius": 0,
"barWidth": 0.7,
"fullHighlight": false,
"groupWidth": 0.7,
"legend": {
"calcs": [
"lastNotNull",
"sum"
],
"displayMode": "table",
"placement": "bottom",
"showLegend": true,
"sortBy": "Total",
"sortDesc": true
},
"orientation": "vertical",
"showValue": "never",
"stacking": "normal",
"text": {},
"tooltip": {
"mode": "single",
"sort": "none"
},
"xField": "Time",
"xTickLabelRotation": -45,
"xTickLabelSpacing": 100
},
"pluginVersion": "9.5.21",
"targets": [
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"query": "//import \"experemental\"\r\n\r\n// myInterval = duration(v: unit(v: v.windowPeriod) * unit(v: 3))\r\n// myInterval = duration(v: $__interval_ms * 1000)\r\n\r\nfrom(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r[\"_measurement\"] == \"rabbitmq_queue\")\r\n |> filter(fn: (r) => r[\"_field\"] == \"messages_publish\")\r\n// |> filter(fn: (r) => contains(value: r[\"queue\"], set: ${queue_name:json}))\r\n// |> aggregateWindow(every: myInterval, fn: last, createEmpty: false) // Берем последнее значение в окне\r\n// |> derivative(unit: myInterval, nonNegative: true) // Считаем скорость в сообщ./сек, игнорируя сбросы\r\n// |> aggregateWindow(every: $__interval, fn: last, createEmpty: false) // Берем последнее значение в окне\r\n// |> derivative(unit: $__interval, nonNegative: true) // Считаем скорость в сообщ./сек, игнорируя сбросы\r\n |> filter(fn: (r) => r[\"vhost\"] =~ /^${queue_vhost:regex}$/)\r\n |> filter(fn: (r) => r[\"queue\"] =~ /^${queue_name:regex}$/)\r\n |> aggregateWindow(every: $__interval, fn: last, createEmpty: false) // Берем последнее значение в окне\r\n |> derivative(unit: $__interval, nonNegative: true) // Считаем скорость в сообщ./сек, игнорируя сбросы\r\n//|> aggregateWindow(every: 600s, fn: last, createEmpty: false) // Берем последнее значение в окне\r\n//|> derivative(unit: 600s, nonNegative: true) // Считаем скорость в сообщ./сек, игнорируя сброс//ы\r\n |> yield(name: \"publish_rate_per_10minut\")\r\n\r\n\r\n\r\n ",
"refId": "A"
}
],
"title": "Published messages RMQ per $__interval ",
"transformations": [
{
"id": "renameByRegex",
"options": {
"regex": "^message.+node\\=(.+)url\\=.+\\:15672\\\"\\,(.*)",
"renamePattern": "$1 $2"
}
}
],
"type": "barchart"
},
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisCenteredZero": false,
"axisColorMode": "text",
"axisGridShow": true,
"axisLabel": "",
"axisPlacement": "left",
"fillOpacity": 80,
"gradientMode": "none",
"hideFrom": {
"legend": false,
"tooltip": false,
"viz": false
},
"lineWidth": 1,
"scaleDistribution": {
"type": "linear"
},
"thresholdsStyle": {
"mode": "off"
}
},
"mappings": [],
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "red",
"value": 80
}
]
}
},
"overrides": []
},
"gridPos": {
"h": 11,
"w": 24,
"x": 0,
"y": 21
},
"id": 2,
"interval": "2m",
"maxDataPoints": 150,
"options": {
"barRadius": 0,
"barWidth": 0.79,
"fullHighlight": false,
"groupWidth": 0.7,
"legend": {
"calcs": [
"lastNotNull",
"distinctCount"
],
"displayMode": "table",
"placement": "bottom",
"showLegend": true,
"sortBy": "Last *",
"sortDesc": true
},
"orientation": "vertical",
"showValue": "never",
"stacking": "normal",
"text": {},
"tooltip": {
"mode": "single",
"sort": "desc"
},
"xField": "Time",
"xTickLabelRotation": -45,
"xTickLabelSpacing": 100
},
"pluginVersion": "9.5.21",
"targets": [
{
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: v.timeRangeStart, stop: v.timeRangeStop)\r\n |> filter(fn: (r) => r[\"_measurement\"] == \"rabbitmq_queue\")\r\n |> filter(fn: (r) => r[\"_field\"] == \"messages_ready\")\r\n// |> filter(fn: (r) => contains(value: r[\"queue\"], set: ${queue_name:json}))\r\n |> filter(fn: (r) => r[\"vhost\"] =~ /^${queue_vhost:regex}$/)\r\n |> filter(fn: (r) => r[\"queue\"] =~ /^${queue_name:regex}$/)\r\n// |> aggregateWindow(every: 600s, fn: last, createEmpty: false) // Берем последнее значение в окне\r\n |> aggregateWindow(every: $__interval, fn: last, createEmpty: false) // Берем последнее значение в окне\r\n// |> derivative(unit: 600s, nonNegative: true) // Считаем скорость в сообщ./сек, игнорируя сбросы\r\n// |> yield(name: \"unread_per_10minut\")\r\n// |> group(columns: [\"queue\", \"vhost\"])\r\n\r\n // 6. Получаем последнее значение в серии\r\n// |> last()\r\n |> yield(name: \"unread_per_10minut\") \r\n\r\n",
"refId": "A"
}
],
"title": "unread messages, interval = $__interval",
"transformations": [
{
"id": "renameByRegex",
"options": {
"regex": "^message.+node\\=(.+)url\\=.+\\:15672\\\"\\,(.*)",
"renamePattern": "$1 $2"
}
}
],
"type": "barchart"
}
],
"refresh": "",
"schemaVersion": 38,
"style": "dark",
"tags": [],
"templating": {
"list": [
{
"current": {
"selected": false,
"text": "/",
"value": "/"
},
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"definition": "from(bucket: \"rabbitmq\")\r\n |> range(start: -7d)\r\n |> filter(fn: (r) => r[\"_measurement\"] == \"rabbitmq_queue\")\r\n |> filter(fn: (r) => r[\"_field\"] == \"messages_publish\")\r\n |> group()\r\n |> distinct(column: \"vhost\")\r\n |> sort()",
"hide": 0,
"includeAll": false,
"label": "Выбор vhost",
"multi": false,
"name": "queue_vhost",
"options": [],
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: -7d)\r\n |> filter(fn: (r) => r[\"_measurement\"] == \"rabbitmq_queue\")\r\n |> filter(fn: (r) => r[\"_field\"] == \"messages_publish\")\r\n |> group()\r\n |> distinct(column: \"vhost\")\r\n |> sort()",
"refresh": 1,
"regex": "",
"skipUrlSync": false,
"sort": 0,
"type": "query"
},
{
"current": {
"selected": false,
"text": [
"All"
],
"value": [
"$__all"
]
},
"datasource": {
"type": "influxdb",
"uid": "f8d0181a-8287-4557-873b-f8770d8c5c1e"
},
"definition": "from(bucket: \"rabbitmq\")\r\n |> range(start: -1h)\r\n |> filter(fn: (r) => r[\"_measurement\"] == \"rabbitmq_queue\")\r\n |> filter(fn: (r) => r[\"_field\"] == \"messages_publish\")\r\n// |> filter(fn: (r) => r[\"vhost\"] == \"digitalprofile_prod\")\r\n |> filter(fn: (r) => r[\"vhost\"] == \"${queue_vhost}\" )\r\n// |> filter(fn: (r) => contains(value: r.vhost, set: ${queue_vhost}))\r\n |> group()\r\n |> distinct(column: \"queue\")",
"hide": 0,
"includeAll": true,
"label": "Выбор очереди",
"multi": true,
"name": "queue_name",
"options": [],
"query": "from(bucket: \"rabbitmq\")\r\n |> range(start: -1h)\r\n |> filter(fn: (r) => r[\"_measurement\"] == \"rabbitmq_queue\")\r\n |> filter(fn: (r) => r[\"_field\"] == \"messages_publish\")\r\n// |> filter(fn: (r) => r[\"vhost\"] == \"digitalprofile_prod\")\r\n |> filter(fn: (r) => r[\"vhost\"] == \"${queue_vhost}\" )\r\n// |> filter(fn: (r) => contains(value: r.vhost, set: ${queue_vhost}))\r\n |> group()\r\n |> distinct(column: \"queue\")",
"refresh": 1,
"regex": "",
"skipUrlSync": false,
"sort": 2,
"type": "query"
}
]
},
"time": {
"from": "now-2d",
"to": "now"
},
"timepicker": {},
"timezone": "",
"title": "Rabbitmq-influxdb by vhost and queue",
"uid": "fb797161-88e9-481d-983a-e379de935f58",
"version": 136,
"weekStart": ""
}
Комментариев нет:
Отправить комментарий