May 17 00:45:27.196 - 122s  E clusteroperator/control-plane-machine-set condition/Available status/False reason/Missing 1 available replica(s)
May 17 00:45:29.900 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-16-230112: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-22fff3dcd3cb3058a2998dde0dfbc93a expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-f35d32377b1ccc443099f68b2b9ccaa0, retrying]
May 17 00:45:29.900 - 576s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-16-230112: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-22fff3dcd3cb3058a2998dde0dfbc93a expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-f35d32377b1ccc443099f68b2b9ccaa0, retrying]

... 1 lines not shown

May 16 19:01:06.643 E ns/openshift-multus pod/multus-admission-controller-668c8b6f85-b8n7f node/ip-10-0-193-150.us-west-1.compute.internal uid/6308cce5-2848-455d-9b56-f5b31ae57b78 container/multus-admission-controller reason/ContainerExit code/137 cause/Error
May 16 19:04:12.414 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-16-170112: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-93ebcbf971204f270a265c554fcb5292 expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-4ee43e8028d0bd3684ec01bbb512bcfd, retrying]
May 16 19:04:12.414 - 159s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-16-170112: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-93ebcbf971204f270a265c554fcb5292 expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-4ee43e8028d0bd3684ec01bbb512bcfd, retrying]

... 1 lines not shown

May 15 15:13:40.156 E ns/e2e-k8s-sig-apps-job-upgrade-7398 pod/foo-4ljtz node/ip-10-0-187-51.us-west-2.compute.internal uid/86728a7c-b2d2-474a-b588-865b1809d204 container/c reason/ContainerExit code/137 cause/Error
May 15 15:14:31.566 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-15-132734: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-fccb17ddbd08043c9d5c6d7589e16566 expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-8de6f1bbcef511f70821125358d9b551, retrying]
May 15 15:14:31.566 - 590s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-15-132734: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-fccb17ddbd08043c9d5c6d7589e16566 expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-8de6f1bbcef511f70821125358d9b551, retrying]

... 1 lines not shown

May 16 11:32:01.834 E clusterversion/version changed Failing to True: ClusterOperatorNotAvailable: Cluster operator control-plane-machine-set is not available
May 16 11:33:08.146 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-16-093540: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-5fd08ce6873eb88f6b057d943ff695fb expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-24de20a03e409345af38798e8ba5bfca, retrying]
May 16 11:33:08.146 - 69s   E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-16-093540: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-5fd08ce6873eb88f6b057d943ff695fb expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-24de20a03e409345af38798e8ba5bfca, retrying]

... 1 lines not shown

May 14 17:15:11.726 E ns/openshift-ingress pod/router-default-575fb7fc7c-9jds5 node/ip-10-0-232-246.us-east-2.compute.internal uid/3907cc5d-ee61-49c8-8a62-9b3d31e2f089 container/router reason/ContainerExit code/137 cause/ContainerStatusUnknown The container could not be located when the pod was deleted.  The container used to be Running
May 14 17:15:54.589 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-14-154503: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-9adaaee7cddbbd3000a199326bb086ea expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-db4fd3db5e25842b6910ed856b3ad9ef, retrying]
May 14 17:15:54.589 - 555s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-14-154503: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-9adaaee7cddbbd3000a199326bb086ea expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-db4fd3db5e25842b6910ed856b3ad9ef, retrying]

... 1 lines not shown

May 15 05:41:29.750 E ns/openshift-multus pod/multus-admission-controller-d85c7cfd9-xnntm node/ip-10-0-174-240.us-west-2.compute.internal uid/98defd63-c470-4ca2-8150-e82070d4b453 container/multus-admission-controller reason/ContainerExit code/137 cause/ContainerStatusUnknown The container could not be located when the pod was deleted.  The container used to be Running
May 15 05:44:13.930 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-15-034503: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-84da51562889dfbc55b0263d81d6fd34 expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-f6a0f5b14cdd957ae4a73cd94f7828d4, retrying]
May 15 05:44:13.930 - 176s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-15-034503: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-84da51562889dfbc55b0263d81d6fd34 expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-f6a0f5b14cdd957ae4a73cd94f7828d4, retrying]

... 1 lines not shown

May 16 05:04:36.041 - 183s  E clusteroperator/control-plane-machine-set condition/Available status/False reason/Missing 1 available replica(s)
May 16 05:04:43.072 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-16-033540: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-35a02e21e4dfdd5c83cedbce9fed5c79 expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-8a04ab1602ef64330b6ae2cee20cf779, retrying]
May 16 05:04:43.072 - 587s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-16-033540: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-35a02e21e4dfdd5c83cedbce9fed5c79 expected 2d7a09cc9acd5ffd96ef777a1bd2c348cd49a0c9 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-8a04ab1602ef64330b6ae2cee20cf779, retrying]

... 1 lines not shown

May 14 11:28:17.138 E ns/openshift-multus pod/multus-admission-controller-59f67b8d97-fkkcj node/ip-10-0-182-146.us-west-2.compute.internal uid/b7f47bee-bdfd-4b88-ac9f-3c77f9e8d65b container/multus-admission-controller reason/ContainerExit code/137 cause/Error
May 14 11:31:17.922 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-14-094503: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-80598cc01bd87ddebc1ee31b7b2c9b3f expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-ec583cbfdf65d7ad1d74f852955628fd, retrying]
May 14 11:31:17.922 - 161s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-14-094503: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-80598cc01bd87ddebc1ee31b7b2c9b3f expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-ec583cbfdf65d7ad1d74f852955628fd, retrying]

... 1 lines not shown

May 13 11:04:29.716 E ns/openshift-multus pod/multus-admission-controller-6d977544df-sglcr node/ip-10-0-214-109.us-west-1.compute.internal uid/78c15ace-6239-442d-9d06-034aff9aab73 container/multus-admission-controller reason/ContainerExit code/137 cause/Error
May 13 11:07:39.178 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-13-091327: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-5cf68669d5e78dc04fdafaa2c4722b9d expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-d8537e27ea94746992689c4f98869340, retrying]
May 13 11:07:39.178 - 164s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-13-091327: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-5cf68669d5e78dc04fdafaa2c4722b9d expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-d8537e27ea94746992689c4f98869340, retrying]

... 1 lines not shown

May 10 16:31:22.030 - 96s   E clusteroperator/control-plane-machine-set condition/Available status/False reason/Missing 1 available replica(s)
May 10 16:31:24.617 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-10-145431: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-1cde6fb316d2c1e40544fbc49ee59e9f expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-589ccdb75c5459ba9bd06cd12090541a, retrying]
May 10 16:31:24.617 - 138s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-10-145431: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-1cde6fb316d2c1e40544fbc49ee59e9f expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-589ccdb75c5459ba9bd06cd12090541a, retrying]

... 1 lines not shown

May 13 16:57:48.871 E ns/e2e-k8s-sig-apps-job-upgrade-7070 pod/foo-qpw5f node/ip-10-0-228-52.us-west-2.compute.internal uid/d5d3ebb8-e13a-4577-bfba-8ceee389a52b container/c reason/ContainerExit code/137 cause/Error
May 13 16:59:34.906 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-13-151327: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-c9355dc290f6fabaab2d7daa2a7c1614 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-1022436c0df21009fb87bc694becb1ee, retrying]
May 13 16:59:34.906 - 541s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-13-151327: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-c9355dc290f6fabaab2d7daa2a7c1614 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-1022436c0df21009fb87bc694becb1ee, retrying]

... 1 lines not shown

May 10 10:25:11.552 - 120s  E clusteroperator/control-plane-machine-set condition/Available status/False reason/Missing 1 available replica(s)
May 10 10:25:18.356 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-10-082301: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-7d30c46e55c9c8baeecdbe0254e95491 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-f5cd6bb1cee181485870a6a178ec8a06, retrying]
May 10 10:25:18.356 - 521s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-10-082301: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-7d30c46e55c9c8baeecdbe0254e95491 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-f5cd6bb1cee181485870a6a178ec8a06, retrying]

... 1 lines not shown

May 09 23:50:54.905 E ns/e2e-k8s-sig-apps-job-upgrade-3208 pod/foo-dckbq node/ip-10-0-216-4.us-west-2.compute.internal uid/67f5cf26-80e0-4fd4-b478-531bd1ac6987 container/c reason/ContainerExit code/137 cause/Error
May 09 23:52:29.319 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-09-221809: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-aff8746f40ad7e27fd2c78094a5dcac6 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-1880a2fbd77988d33a15fc98b9ebcf07, retrying]
May 09 23:52:29.319 - 587s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-09-221809: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-aff8746f40ad7e27fd2c78094a5dcac6 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-1880a2fbd77988d33a15fc98b9ebcf07, retrying]

... 1 lines not shown

May 09 02:29:45.656 - 117s  E clusteroperator/control-plane-machine-set condition/Available status/False reason/Missing 1 available replica(s)
May 09 02:30:06.282 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-09-004250: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-3ddd3f394569cbedc26d9a143f1c84c3 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-4e36f4075dd8a52bce2b048f5dd946c8, retrying]
May 09 02:30:06.282 - 546s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-09-004250: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-3ddd3f394569cbedc26d9a143f1c84c3 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-4e36f4075dd8a52bce2b048f5dd946c8, retrying]

... 1 lines not shown

May 09 14:51:39.871 E ns/openshift-multus pod/multus-admission-controller-6664f8f797-659k9 node/ip-10-0-138-20.us-west-2.compute.internal uid/54914ff5-0e30-46aa-b7a0-f83ff7a8bc28 container/multus-admission-controller reason/ContainerExit code/137 cause/Error
May 09 14:54:48.150 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-09-130510: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-2eff585abd0cbc172de15c731caac291 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-2641585b8461c8f86eded57ac2443bfe, retrying]
May 09 14:54:48.150 - 140s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-09-130510: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-2eff585abd0cbc172de15c731caac291 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-2641585b8461c8f86eded57ac2443bfe, retrying]

... 1 lines not shown

May 08 14:05:43.854 E ns/openshift-monitoring pod/alertmanager-main-1 node/ip-10-0-147-151.us-west-2.compute.internal uid/98fdc72a-dc00-456a-8ebd-2e4bef8eda2d container/alertmanager reason/ContainerExit code/1 cause/Error ts=2024-05-08T14:05:37.130Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=release-4.13, revision=df2f11e2ddc206ad1924ed766b4a394d84c9236f)"\nts=2024-05-08T14:05:37.130Z caller=main.go:241 level=info build_context="(go=go1.19.13 X:strictfipsruntime, user=root@50ec6f22b504, date=20231031-09:45:13)"\nts=2024-05-08T14:05:37.155Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s\nts=2024-05-08T14:05:37.193Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/config_out/alertmanager.env.yaml\nts=2024-05-08T14:05:37.193Z caller=coordinator.go:118 level=error component=configuration msg="Loading configuration file failed" file=/etc/alertmanager/config_out/alertmanager.env.yaml err="open /etc/alertmanager/config_out/alertmanager.env.yaml: no such file or directory"\nts=2024-05-08T14:05:37.193Z caller=cluster.go:690 level=info component=cluster msg="gossip not settled but continuing anyway" polls=0 elapsed=37.823315ms\n
May 08 14:07:15.676 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-08-123136: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-f266924e5a60bd16e97016d0852ccd49 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-b4819729400de948f3e37f17c2f53437, retrying]
May 08 14:07:15.676 - 566s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-08-123136: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-f266924e5a60bd16e97016d0852ccd49 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-b4819729400de948f3e37f17c2f53437, retrying]

... 1 lines not shown

May 08 08:14:21.157 - 99s   E clusteroperator/control-plane-machine-set condition/Available status/False reason/Missing 1 available replica(s)
May 08 08:14:28.350 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-08-063136: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-ec10c50a48fbf79ac085b544a13cf690 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-62fc14de6cdb61bb943baad6832dc1cb, retrying]
May 08 08:14:28.350 - 131s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-08-063136: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-ec10c50a48fbf79ac085b544a13cf690 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-62fc14de6cdb61bb943baad6832dc1cb, retrying]

... 1 lines not shown

May 08 01:40:03.675 E ns/e2e-k8s-sig-apps-job-upgrade-4496 pod/foo-nvvpg node/ip-10-0-253-50.us-west-2.compute.internal uid/aa111aae-ecfb-4f73-9bcb-afb4ea82f2b2 container/c reason/ContainerExit code/137 cause/Error
May 08 01:41:06.111 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-07-235844: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-5523d3573abcc667654a5b3b0f62c368 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-c91174fa6c26c73c3e691221a4db7cf0, retrying]
May 08 01:41:06.111 - 586s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-07-235844: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-5523d3573abcc667654a5b3b0f62c368 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-c91174fa6c26c73c3e691221a4db7cf0, retrying]

... 1 lines not shown

May 07 17:13:34.114 E clusterversion/version changed Failing to True: ClusterOperatorNotAvailable: Cluster operator control-plane-machine-set is not available
May 07 17:13:36.059 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-07-154117: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-529b18e0990021d0853049bfd6c6bc25 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-b924a90ee2d9f88a8655d0f8932556c9, retrying]
May 07 17:13:36.059 - 508s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-07-154117: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-529b18e0990021d0853049bfd6c6bc25 expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-b924a90ee2d9f88a8655d0f8932556c9, retrying]

... 1 lines not shown

May 03 18:20:26.821 - 119s  E clusteroperator/control-plane-machine-set condition/Available status/False reason/Missing 1 available replica(s)
May 03 18:20:55.918 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-03-162932: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-03f12e742764ecf9e72ff16e459d155d expected 88140227ee7d79c77092efd92b5a4363971333e2 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-558f9be6a2f713e84e5c25f2397b4f0a, retrying]
May 03 18:20:55.918 - 129s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-03-162932: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-03f12e742764ecf9e72ff16e459d155d expected 88140227ee7d79c77092efd92b5a4363971333e2 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-558f9be6a2f713e84e5c25f2397b4f0a, retrying]

... 1 lines not shown

May 03 12:12:29.374 E clusterversion/version changed Failing to True: ClusterOperatorNotAvailable: Cluster operator control-plane-machine-set is not available
May 03 12:12:37.394 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-03-102932: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-07dc2c52508ee63ff6b7a526a20541ea expected 88140227ee7d79c77092efd92b5a4363971333e2 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-a220b9a88232bc09f8d8e89c14c12439, retrying]
May 03 12:12:37.394 - 500s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-03-102932: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-07dc2c52508ee63ff6b7a526a20541ea expected 88140227ee7d79c77092efd92b5a4363971333e2 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-a220b9a88232bc09f8d8e89c14c12439, retrying]

... 1 lines not shown

May 06 21:07:32.835 E ns/openshift-multus pod/multus-admission-controller-5447c656b9-9qr9x node/ip-10-0-174-110.us-west-1.compute.internal uid/d386d49e-27e0-44ea-a1fd-4eaf3b8e036c container/multus-admission-controller reason/ContainerExit code/137 cause/Error
May 06 21:10:28.946 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-06-192520: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-48acd9d3b050c4c850de421ed594933d expected 88140227ee7d79c77092efd92b5a4363971333e2 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-47b8825bb5c7802589deaa597d76c4d9, retrying]
May 06 21:10:28.946 - 157s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-06-192520: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-48acd9d3b050c4c850de421ed594933d expected 88140227ee7d79c77092efd92b5a4363971333e2 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-47b8825bb5c7802589deaa597d76c4d9, retrying]

... 1 lines not shown

May 07 10:35:43.929 E clusterversion/version changed Failing to True: ClusterOperatorNotAvailable: Cluster operator control-plane-machine-set is not available
May 07 10:35:58.561 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-07-085425: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-016a6651c77952b2c257eb04665d194f expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-f838e93fd54e152bdb3f6dbbffc64941, retrying]
May 07 10:35:58.561 - 127s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-07-085425: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-016a6651c77952b2c257eb04665d194f expected bb00d4f6f57ab3a3fc11644a958a6e1781389a23 has 33a010772d604aff2cb625d04a9469a47f53c96e: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-f838e93fd54e152bdb3f6dbbffc64941, retrying]

... 1 lines not shown

May 06 14:29:37.418 E ns/e2e-k8s-sig-apps-job-upgrade-6163 pod/foo-fxvdg node/ip-10-0-217-158.us-west-2.compute.internal uid/fa323f69-10ff-4cd9-8c42-771ab7942ba0 container/c reason/ContainerExit code/137 cause/Error
May 06 14:30:41.393 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.13.0-0.ci-2024-05-06-124130: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-5a9c33a0a1518b3fd9b49ed20fe5db63 expected 88140227ee7d79c77092efd92b5a4363971333e2 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-72c10f5393ca6bd9873de3ebc3c4dd9a, retrying]
May 06 14:30:41.393 - 561s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.13.0-0.ci-2024-05-06-124130: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-5a9c33a0a1518b3fd9b49ed20fe5db63 expected 88140227ee7d79c77092efd92b5a4363971333e2 has 33a010772d604aff2cb625d04a9469a47f53c96e: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-72c10f5393ca6bd9873de3ebc3c4dd9a, retrying]

... 1 lines not shown