Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

prometheus node exporter having trouble mounting root? #298

Open
Morisander opened this issue Aug 1, 2023 · 0 comments
Open

prometheus node exporter having trouble mounting root? #298

Morisander opened this issue Aug 1, 2023 · 0 comments

Comments

@Morisander
Copy link

good day!

i am currently trying to setup everything in my free trial to see if everything would be how i would need it, but i am getting a little trouble with the prometheus node exporter of the metrics exporter...

to make it short, here is what i get from describe pod and logs:
describe:
Name: logzio-k8s-telemetry-prometheus-node-exporter-7zzv8
Namespace: monitoring
Priority: 0
Service Account: logzio-k8s-telemetry-prometheus-node-exporter
Node: docker-desktop/192.168.65.4
Start Time: Tue, 01 Aug 2023 17:45:28 +0200
Labels: app=prometheus-node-exporter
chart=prometheus-node-exporter-3.3.0
controller-revision-hash=bf8fdc765
heritage=Helm
pod-template-generation=1
release=logzio-k8s-telemetry
Annotations: cluster-autoscaler.kubernetes.io/safe-to-evict: true
Status: Running
IP: 192.168.65.4
IPs:
IP: 192.168.65.4
Controlled By: DaemonSet/logzio-k8s-telemetry-prometheus-node-exporter
Containers:
node-exporter:
Container ID: docker://236b084a97754432048558be3197c388ec970c4b5ae2c734c54f01615ee5152a
Image: quay.io/prometheus/node-exporter:v1.3.1
Image ID: docker-pullable://quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd
Port: 9101/TCP
Host Port: 9101/TCP
Args:
--path.procfs=/host/proc
--path.sysfs=/host/sys
--path.rootfs=/host/root
--web.listen-address=[$(HOST_IP)]:9101
State: Waiting
Reason: CrashLoopBackOff
Last State: Terminated
Reason: ContainerCannotRun
Message: path / is mounted on / but it is not a shared or slave mount
Exit Code: 128
Started: Tue, 01 Aug 2023 17:45:59 +0200
Finished: Tue, 01 Aug 2023 17:45:59 +0200
Ready: False
Restart Count: 3
Liveness: http-get http://:9101/ delay=0s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:9101/ delay=0s timeout=1s period=10s #success=1 #failure=3
Environment:
HOST_IP: 0.0.0.0
Mounts:
/host/proc from proc (ro)
/host/root from root (ro)
/host/sys from sys (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
proc:
Type: HostPath (bare host directory volume)
Path: /proc
HostPathType:
sys:
Type: HostPath (bare host directory volume)
Path: /sys
HostPathType:
root:
Type: HostPath (bare host directory volume)
Path: /
HostPathType:
QoS Class: BestEffort
Node-Selectors: kubernetes.io/os=linux
Tolerations: :NoSchedule op=Exists
node.kubernetes.io/disk-pressure:NoSchedule op=Exists
node.kubernetes.io/memory-pressure:NoSchedule op=Exists
node.kubernetes.io/network-unavailable:NoSchedule op=Exists
node.kubernetes.io/not-ready:NoExecute op=Exists
node.kubernetes.io/pid-pressure:NoSchedule op=Exists
node.kubernetes.io/unreachable:NoExecute op=Exists
node.kubernetes.io/unschedulable:NoSchedule op=Exists
Events:
Type Reason Age From Message


Normal Scheduled 52s default-scheduler Successfully assigned monitoring/logzio-k8s-telemetry-prometheus-node-exporter-7zzv8 to docker-desktop
Normal Pulled 21s (x4 over 51s) kubelet Container image "quay.io/prometheus/node-exporter:v1.3.1" already present on machine
Normal Created 21s (x4 over 51s) kubelet Created container node-exporter
Warning Failed 21s (x4 over 51s) kubelet Error: failed to start container "node-exporter": Error response from daemon: path / is mounted on / but it is not a shared or slave mount
Warning BackOff 1s (x7 over 50s) kubelet Back-off restarting failed container node-exporter in pod logzio-k8s-telemetry-prometheus-node-exporter-7zzv8_monitoring(2f169e83-4057-4bcd-b3d6-7f620b251f0e)

logs:
failed to try resolving symlinks in path "/var/log/pods/monitoring_logzio-k8s-telemetry-prometheus-node-exporter-7zzv8_2f169e83-4057-4bcd-b3d6-7f620b251f0e/node-exporter/4.log": lstat /var/log/pods/monitoring_logzio-k8s-telemetry-prometheus-node-exporter-7zzv8_2f169e83-4057-4bcd-b3d6-7f620b251f0e/node-exporter/4.log: no such file or directory

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant