Bucket Metering

[ligerard]

Hi,

I begin with most important : Happy new Year !

Since some weeks , I use your exporter. (Windows version ask by Franklin Piat who work with me ;-) )
I would like to know if you plan to include other metering in your exporter.
I look for informations about buckets to report after a migration from a Centera to ECS.

I found good examples in "https://github.com/bottkars/ECShell" but it's not possible "to batch" with it.

Thanks for your answer.

Lionel GERARD

[xphyr]

So we do export stats on a namespace level, however to this point I did not have plans to do bucket level exports because of the time it takes to gather that level of data. It may be possible to create a bucket level exporter, where you have to query with a namespace. Would that be what you are looking for?

P.S. I am curious what company you work for (if you can share that)

[ligerard]

Thanks for tour answer.
I'm working at AGIRC-ARRCO in France.
I have to collect meters about bucket on ECS. (Nbr of objects, size, read Write access, ...etc)

[xphyr]

Let me see what I can do. I have a few ideas on how to make this work. My concern is how long the ECS array takes to gather this data.

[ligerard]

Thanks for your answer. I think (in my case) that time will not be too long. We have only 4 productions buckets and 4 tests buckets. If we can put bucket as parameter, in case of lot of bucket, it will limit metrics. We can also imagine group of bucket and different frequency of collect. Le sam. 19 janv. 2019 à 19:26, Mark D <[email protected]> a écrit :

…

Let me see what I can do. I have a few ideas on how to make this work. My concern is how long the ECS array takes to gather this data. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#2 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AsDcGlu1pdpKeNP7FeNekRDxI_En9tw0ks5vE2NqgaJpZM4ZmeGm> .

[ligerard]

Hi,
Have you been able to start working on the subject? Do you think it's feasible?

[frollep]

We have code 3.8.x.x

This is s från the Dell ECS dok 3.5x

Secure ports 9101 and 10099 are reserved for internal communication between services and the ECS node

I get the following error when running prometheus-emcecs exports. We have opened port 9101, 4443 and 9021 between the server running the exporter and all ecs nodes. If I look at which ports the ECS listens to, it seems that it is the internal IP addresses that listen to exactly port 9101 compared to e.g. 4443

admin@xxxmgmtn01:~> netstat -nl | grep 9101
tcp 0 0 169.254.1.1:9101 :::* LISTEN

admin@ecs1mgmtn01:~> netstat -nl | grabbed 4443
tcp 0 0 127.0.0.1:4443 0.0.0.0:* THE LIST
tcp 0 0 172.XX.XXX.XX:4443 0.0.0.0:* THE LIST
tcp 0 0 ::1:4443 :::* THE LIST
tcp 0 0 127.0.0.1:64443 :::* THE LIST

Error connecting to ECS Cluster at: http://172.XX.XXX.XX:9101/stats/dt/DTInitStat cluster=xxx1mgmtn01.dc.xxx.se package=ecsclient
ERRO[2023-12-15 11:16:10] Error connecting to ECS Cluster at: http://172.XX.XXX.XX:9101/stats/dt/DTInitStat cluster=xxx1mgmtn01.dc.xxx.xx package=ecsclient
ERRO[2023-12-15 11:16:10] Error connecting to ECS Cluster at: http://172.XX.XXX.XX:9101/stats/dt/DTInitStat cluster=xxx1mgmtn01.dc.xxx.xx package=ecsclient
ERRO[2023-12-15 11:16:10] Error connecting to ECS Cluster at: http://172.XX.XXX.XX:9101/stats/dt/DTInitStat cluster=xxx1mgmtn01.dc.xxx.xx package=ecsclient
ERRO[2023-12-15 11:16:10] Error connecting to ECS Cluster at: http://172.XX.XXX.XX:9101/stats/dt/DTInitStat cluster=xxx1mgmtn01.dc.xxx.xx package=ecsclient
ERRO[2023-12-15 11:16:10] Error connecting to ECS Cluster at: http://172.XX.XXX.XX:9101/stats/dt/DTInitStat cluster=xxx1mgmtn01.dc.xxx.xx package=ecsclient
ERRO[2023-12-15 11:16:10] Error connecting to ECS Cluster at: http://172.XX.XXX.XX:9101/stats/dt/DTInitStat cluster=xxx1mgmtn01.dc.xxx.xx package=ecsclient
ERRO[2023-12-15 11:16:10] Error connecting to ECS Cluster at: http://172.XX.XXX.XX:9101/stats/dt/DTInitStat cluster=xxx1mgmtn01.dc.xxx.xx package=ecsclient
ERRO[2023-12-15 11:16:10] Error connecting to ECS Cluster at: http://172.XX.XXX.XX:9101/stats/dt/DTInitStat cluster=xxx1mgmtn01.dc.xxx.xx package=ecsclient
DEBU[2023-12-15 11:16:10] Nodestate exporter finished package=node-collector
DEBU[2023-12-15 11:16:10] [{0 0 0 172.XXX.XXX.XX 0} {0 0 0 172.XX.XXX.XX 0} {0 0 0 172.XX.XXX.XX 0} {0 0 0 172.XX.XXX.XX 0} {0 0 0 172.XX.XXX.XX 0} {0 0 0 172.XX.XXX.XX 0} {0 0 0 172.XX.XXX.XX 0} {0 0 0 172.XX.XXX.XX 0} {0 0 0 172.XX.XXX.XX 0} {0 0 0 172.XX.XXX.XX 0}] package=node-collector
DEBU[2023-12-15 11:16:10] Replication exporter finished package=repl-collector
DEBU[2023-12-15 11:16:10] { 0 0 0 0 0 0} package=repl-collector
DEBU[2023-12-15 11:16:11] Cluster exporter finished package=cluster-collector
DEBU[2023-12-15 11:16:11] {0 0 0 240 10 ecs2 0 0 3 1 2.14220688672736e+15 2.8784870817792e+15 7.3628019505184e+14 0 0 0 0 0 0 0 0 []} package=cluster-collector
DEBU[2023-12-15 11:16:11] Replication exporter finished package=repl-collector
DEBU[2023-12-15 11:16:11] { 0 0 0 0 0 0} package=repl-collector
DEBU[2023-12-15 11:16:13] Cluster exporter finished package=cluster-collector
DEBU[2023-12-15 11:16:13] {1 0 0 240 10 ecs1 0 0 1 2 2.45833392857616e+15 2.89048077795328e+15 4.2015315320304e+14 0 0 0 0 0 0 0 0 []} package=cluster-collector