一氛驮，獲取存活節(jié)點(diǎn)
http://192.168.0.2:9090/api/v1/query?query=up
二咏删，內(nèi)存
包含 node-exporter? cadvisor 指標(biāo)
一天平均使用
sum(avg_over_time(container_memory_usage_bytes{container_label_name=~".+"}[1d])) by? (name,instance)
一天最大
sum(max_over_time(container_memory_usage_bytes{instance=~"172.20.70.100.+",container_label_name=~".+"}[1d])) by? (name,instance)
一天最小
sum(min_over_time(container_memory_usage_bytes{instance=~"172.20.70.100.+",container_label_name=~".+"}[1d])) by? (name,instance)
二畜隶，cpu
sum(rate(container_cpu_usage_seconds_total{instance=~"172.20.70.2:.+",name=~".+"}[1d])) by (name)?
注意:
在使用 http api 的時(shí)候较曼，要對參數(shù)進(jìn)行 urlencode ?編碼返奉；
def?prometheus_query_range(url,?sql):
? ? select_sql?=?urlencode({"query":?sql})
? ? req_url?=?"%s/api/v1/query_range?%s&start=%s&end=%s&step=240"?%?(url,?select_sql,?before_day,?now_time)
? ? result?=?request_url(req_url)
? ? return?result
各類指標(biāo):
所有磁盤空間
sum(container_fs_limit_bytes{instance=~"$server:.+",device=~".+sd[b-m]"}) by (instance)
已經(jīng)使用的磁盤空間
sum(container_fs_usage_bytes{instance=~"$server:.+",device=~".+sd[b-m]"}) by (instance)
根目錄大小
sum(container_fs_limit_bytes{instance=~"$server:.+",device=~"/dev/mapper/system-root",id="/"}) by (instance)
內(nèi)存可用大小 包含cache
node_memory_MemAvailable_bytes{instance=~"$server:.+"}
內(nèi)存總量
node_memory_MemTotal_bytes{instance=~"$server:.+"}
內(nèi)存空閑 not include cache
node_memory_MemFree_bytes{instance=~"$server:.+"}
cpu util
avg by (instance,mode) (rate(node_cpu_seconds_total{instance=~"$server:.+"}[5m])) * 100
磁盤讀速度
rate(node_disk_read_bytes_total{instance=~"$server:.+",device=~"sd[b-m]"}[$interval])
磁盤 read iops
rate(node_disk_read_time_seconds_total{instance=~"$server:.+",device=~"sd[b-m]"}[$interval])
磁盤每秒讀占用時(shí)間
rate(node_disk_read_time_seconds_total{instance=~"$server:.+",device=~"sd[b-m]"}[$interval])
磁盤 write iops
rate(node_disk_writes_completed_total{instance=~"$server:.+",device=~"sd[b-m]"}[$interval])
磁盤寫帶寬
rate(node_disk_written_bytes_total{instance=~"$server:.+",device=~"sd[b-m]"}[$interval])
磁盤讀每秒占用時(shí)間
rate(node_disk_write_time_seconds_total{instance=~"$server:.+",device=~"sd[b-m]"}[$interval])/60
網(wǎng)絡(luò)
query_result(sum(container_memory_usage_bytes{instance=~"$server:.+",name=~".+"})) by (name)))
sum by (device) (rate(node_network_transmit_bytes_total{instance=~"$server:.+" ,device=~"(bond0)"}[$interval]))
容器層面
容器啟動時(shí)間
container_start_time_seconds
容器內(nèi)存限制
sum(container_spec_memory_limit_bytes{instance=~"$server:.+",name=~"$container"}) by (name)
容器cpu限制
?sum(container_spec_cpu_quota{instance=~"$server:.+",name=~"$container"} / container_spec_cpu_period{instance=~"$server:.+",name=~"$container"})? by (name)
容器磁盤讀速度
sum(rate(container_fs_reads_bytes_total{instance=~"$server:.+",name="$container"}[$interval])) by (name)
容器寫帶寬
sum(rate(container_fs_writes_bytes_total{instance=~"$server:.+",name="$container"}[$interval])) by (name)
容器讀iops
sum(rate(container_fs_reads_total{instance=~"$server:.+",name=~"$container"}[$interval])) by (name)
容器寫iops
sum(rate(container_fs_writes_total{instance=~"$server:.+",name=~"$container"}[$interval])) by (name)
容器占用磁盤空間(不包括掛載)
sum(container_fs_usage_bytes{instance=~"$server:.+",name=~"$container"}) by (name)
容器所有內(nèi)存使用
sum(container_memory_usage_bytes{instance=~"$server:.+",name=~"$container"}) by (name)
容器內(nèi)存 rss
sum(container_memory_rss{instance=~"$server:.+",name=~"$container"}) by (name)
容器內(nèi)存
sum(container_memory_cache{instance=~"$server:.+",name=~"$container"}) by (name)
