All virtual machine in Openshift container provider with Virtualization enabled shows 100% memory utilization permanently

[epicdigitalacademy]

manageiq version - radjabov-1
container provider - Openshift 4.14

We noticed that all virtual machines in the openshift container provider shows virtual machine mermory utilization 100%. all the time. Both max, high and average utiization shows 100%. Also noticed no storage data is reported. Please is the memory utilization a bug and the storage not reporting

[Fryguy]

@agrare Can you help here?

[epicdigitalacademy]

Can anyone help with this?

[agrare]

Hey @epicdigitalacademy yes this is on my list to do I'm still catching up with everything from before the holiday break

[epicdigitalacademy]

Thank you @agrare .I will wait for your feedback

[agrare]

@epicdigitalacademy it looks like the realtime metrics also show all 100% usage:

vmdb(dev)> vm.metrics.pluck(:mem_usage_absolute_average)
=> 
[100.0,
 100.0,
 100.0,
 100.0,
 100.0,
 100.0
]

My guess is a bug in the calculation of memory usage in the kubevirt metrics collector. Should have a fix shortly.

[agrare]

It looks like we are currently using: kubevirt_vmi_memory_domain_bytes
which is described by https://kubevirt.io/monitoring/metrics.html as:

The amount of memory in bytes allocated to the domain. The memory value in domain xml file

This is pretty clearly the statically allocated memory and not the "used" memory.

I think we should be using kubevirt_vmi_memory_used_bytes instead:

Amount of used memory as seen by the domain

It looks like there is also a base-10 vs base-2 conversion bug (vm_memory * 1000000.0 instead of vm_memory * 1048576.0)

[agrare]

Bug: ManageIQ/manageiq-providers-kubevirt#317
PR: ManageIQ/manageiq-providers-kubevirt#318

[Fryguy]

Merged, but this missed the spassky-1 release.

[agrare]

For the second question about disks, it looks like we never collected disks for kubevirt vms. I'll open an RFE issue on the kubevirt repo to track adding this.

[agrare]

ManageIQ/manageiq-providers-kubevirt#319

I believe that covers all of your issues so I'm going to close this discussion, if I missed anything please re-open