May 15 17:44:47.428 E ns/openshift-multus pod/cni-sysctl-allowlist-ds-2f9dn node/ip-10-0-181-78.us-east-2.compute.internal uid/32985fa7-0667-4e64-a047-3d60ae68b071 container/kube-multus-additional-cni-plugins reason/ContainerExit code/137 cause/Error
May 15 17:46:51.070 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-15-154441: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-e98a838ce0a69fe277a11cbfdb830c88 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-6d0d053e569c471944337c87bd6d10a7, retrying]
May 15 17:46:51.070 - 99s   E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-15-154441: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-e98a838ce0a69fe277a11cbfdb830c88 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-6d0d053e569c471944337c87bd6d10a7, retrying]

... 1 lines not shown

May 15 11:16:46.460 E ns/openshift-multus pod/multus-admission-controller-564c88d697-26fbx node/ip-10-0-197-54.ec2.internal uid/b9ac0460-1901-4148-b22d-916d4d4ab6c7 container/multus-admission-controller reason/ContainerExit code/137 cause/Error
May 15 11:20:07.568 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-15-094441: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-9d89ba7b378f74d9617346d64c96d1a7 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-6993e89416a2be0596fd7a9b52f9cdcd, retrying]
May 15 11:20:07.568 - 117s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-15-094441: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-9d89ba7b378f74d9617346d64c96d1a7 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-6993e89416a2be0596fd7a9b52f9cdcd, retrying]

... 1 lines not shown

May 14 14:06:47.364 E ns/openshift-oauth-apiserver pod/apiserver-6df4489d6-w6xsc node/ip-10-0-238-213.ec2.internal uid/c335b46d-d4fc-4889-b1bb-ee0f64f43f65 container/oauth-apiserver reason/ContainerExit code/137 cause/ContainerStatusUnknown The container could not be located when the pod was deleted.  The container used to be Running
May 14 14:09:24.654 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-14-122945: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-47255d9112642713697f987cd1cb7e95 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-c20737772629cc4a521bbdb251a7e21a, retrying]
May 14 14:09:24.654 - 134s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-14-122945: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-47255d9112642713697f987cd1cb7e95 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-c20737772629cc4a521bbdb251a7e21a, retrying]

... 1 lines not shown

May 13 23:26:03.584 - 95ms  E clusteroperator/storage condition/Degraded status/True reason/AWSEBSCSIDriverOperatorDeploymentDegraded: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/aws-ebs-csi-driver-operator": context canceled
May 13 23:26:58.756 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-13-215426: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-284d497f8f3021de76b4019fedb8405f expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-07b54dc774323d0e4727c0c9ac769ad0, retrying]
May 13 23:26:58.756 - 523s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-13-215426: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-284d497f8f3021de76b4019fedb8405f expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-07b54dc774323d0e4727c0c9ac769ad0, retrying]

... 1 lines not shown

May 13 10:53:08.097 E ns/openshift-multus pod/multus-admission-controller-57b46f6d85-f549r node/ip-10-0-201-15.us-west-2.compute.internal uid/9d8121f7-8e80-45a2-89a7-2b010d0bad71 container/multus-admission-controller reason/ContainerExit code/137 cause/Error
May 13 10:56:43.837 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-13-090953: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-b823706ac08e3ad0ef6cc2d7393bd018 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-2460456885869a5c37e32198095649fc, retrying]
May 13 10:56:43.837 - 115s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-13-090953: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-b823706ac08e3ad0ef6cc2d7393bd018 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-2460456885869a5c37e32198095649fc, retrying]

... 1 lines not shown

May 11 07:48:09.700 - 70ms  E clusteroperator/storage condition/Degraded status/True reason/AWSEBSCSIDriverOperatorDeploymentDegraded: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/aws-ebs-csi-driver-operator": context canceled
May 11 07:48:53.321 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-11-061012: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-5f64ae260bd09b3b58d857927e50db0f expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-c1c6904684121ea3b011f91d3123a954, retrying]
May 11 07:48:53.321 - 521s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-11-061012: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-5f64ae260bd09b3b58d857927e50db0f expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-c1c6904684121ea3b011f91d3123a954, retrying]

... 1 lines not shown

May 11 01:43:00.000 - 1s    E disruption/service-load-balancer-with-pdb connection/new reason/DisruptionBegan disruption/service-load-balancer-with-pdb connection/new stopped responding to GET requests over new connections: Get "http://aaa0bcabb217e4a6fabca670ce656c84-1552995451.us-east-2.elb.amazonaws.com:80/echo?msg=Hello": read tcp 10.131.111.252:45370->3.133.62.172:80: read: connection reset by peer
May 11 01:43:44.912 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-11-001012: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-cc10f38709f6007d09a76d21bc2c0c3d expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-608202b46d973f72b94eef4a0e43b879, retrying]
May 11 01:43:44.912 - 98s   E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-11-001012: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-cc10f38709f6007d09a76d21bc2c0c3d expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-608202b46d973f72b94eef4a0e43b879, retrying]

... 1 lines not shown

May 10 15:07:31.401 E ns/openshift-multus pod/cni-sysctl-allowlist-ds-xjbwm node/ip-10-0-169-123.us-west-2.compute.internal uid/8f4b8671-f125-44fc-abcb-631d05c87fb5 container/kube-multus-additional-cni-plugins reason/ContainerExit code/137 cause/Error
May 10 15:08:35.141 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-10-132619: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-ce4b450da78682ef27bb4d826fe4d76b expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-23b668237a950f8adc55fc94f3cf428b, retrying]
May 10 15:08:35.141 - 535s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-10-132619: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-ce4b450da78682ef27bb4d826fe4d76b expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-23b668237a950f8adc55fc94f3cf428b, retrying]

... 1 lines not shown

May 14 23:19:58.218 E ns/openshift-multus pod/cni-sysctl-allowlist-ds-mxtqc node/ip-10-0-192-251.ec2.internal uid/d51c7a25-508d-4e80-8f28-7216147177c2 container/kube-multus-additional-cni-plugins reason/ContainerExit code/137 cause/Error
May 14 23:21:21.393 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-14-214846: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-efdf0d87f39f7cc370a9cd4e983bf02b expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-bd4bcbefc119aa48eb57ecfb0170dd11, retrying]
May 14 23:21:21.393 - 125s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-14-214846: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-efdf0d87f39f7cc370a9cd4e983bf02b expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-bd4bcbefc119aa48eb57ecfb0170dd11, retrying]

... 1 lines not shown

May 09 16:47:25.569 E ns/openshift-multus pod/cni-sysctl-allowlist-ds-64ln6 node/ip-10-0-230-47.ec2.internal uid/917692c4-0040-4a5e-bf6f-a4765c7c55d8 container/kube-multus-additional-cni-plugins reason/ContainerExit code/137 cause/Error
May 09 16:48:31.475 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-09-151252: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-829cd39b80c2da9396b3110e0d80cc21 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-2ddcb9cedb0ab356c4ed7c742085ccc8, retrying]
May 09 16:48:31.475 - 119s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-09-151252: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-829cd39b80c2da9396b3110e0d80cc21 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-2ddcb9cedb0ab356c4ed7c742085ccc8, retrying]

... 1 lines not shown

May 09 13:58:11.861 - 77ms  E clusteroperator/storage condition/Degraded status/True reason/AWSEBSCSIDriverOperatorDeploymentDegraded: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/aws-ebs-csi-driver-operator": context canceled
May 09 13:59:05.383 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-08-124617: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-e5b713e0b5246366854c8027e23b144e expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-b7a7e03e98462e449392be778e421863, retrying]
May 09 13:59:05.383 - 133s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-08-124617: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-e5b713e0b5246366854c8027e23b144e expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-b7a7e03e98462e449392be778e421863, retrying]

... 1 lines not shown

May 09 08:08:54.388 E ns/openshift-multus pod/cni-sysctl-allowlist-ds-vvcjm node/ip-10-0-148-168.us-east-2.compute.internal uid/783aeb16-294f-4442-bca7-b79b54cabf76 container/kube-multus-additional-cni-plugins reason/ContainerExit code/137 cause/Error
May 09 08:11:40.367 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-09-061655: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-d8ea1b4cc5f7494f88bae115f0369fdd expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-b0f2dfbf851dfeba035953197a391a80, retrying]
May 09 08:11:40.367 - 112s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-09-061655: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-d8ea1b4cc5f7494f88bae115f0369fdd expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-b0f2dfbf851dfeba035953197a391a80, retrying]

... 1 lines not shown

May 08 21:36:47.066 E ns/openshift-multus pod/cni-sysctl-allowlist-ds-8km4h node/ip-10-0-231-217.us-west-2.compute.internal uid/b93c590e-66f7-4601-a0aa-6a9d986c73e8 container/kube-multus-additional-cni-plugins reason/ContainerExit code/137 cause/Error
May 08 21:38:25.649 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-08-194829: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-ee6fbe122c538af804e265e94301d016 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-37ba234bb98091a2084eae1f4c3e6c9e, retrying]
May 08 21:38:25.649 - 133s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-08-194829: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-ee6fbe122c538af804e265e94301d016 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-37ba234bb98091a2084eae1f4c3e6c9e, retrying]

... 1 lines not shown

May 08 14:35:39.095 E ns/openshift-multus pod/multus-admission-controller-8478d457d7-2czn7 node/ip-10-0-134-53.us-east-2.compute.internal uid/006d7320-992d-4497-b863-1f608082660d container/multus-admission-controller reason/ContainerExit code/137 cause/Error
May 08 14:39:06.020 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-08-124617: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-46e55453c666b2bdbcf78a7812c9fda1 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-9e1b148c71f66ed4f015de10560f9df6, retrying]
May 08 14:39:06.020 - 119s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-08-124617: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-46e55453c666b2bdbcf78a7812c9fda1 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-9e1b148c71f66ed4f015de10560f9df6, retrying]

... 1 lines not shown

May 08 04:19:49.649 E ns/openshift-multus pod/cni-sysctl-allowlist-ds-fhn2n node/ip-10-0-176-188.us-west-2.compute.internal uid/cf3a7e36-1df6-418f-ad7a-3ddb6e8fdd6e container/kube-multus-additional-cni-plugins reason/ContainerExit code/137 cause/Error
May 08 04:22:15.635 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-08-023912: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-2ada19a7e050df6f5d9661cadf58c3ef expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-be6ef08f1ec423a2fc6e62d03381919f, retrying]
May 08 04:22:15.635 - 101s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-08-023912: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-2ada19a7e050df6f5d9661cadf58c3ef expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-be6ef08f1ec423a2fc6e62d03381919f, retrying]

... 1 lines not shown

May 07 22:18:32.422 E ns/e2e-k8s-sig-apps-job-upgrade-2577 pod/foo-nxw7r node/ip-10-0-181-50.us-west-1.compute.internal uid/540a0a41-5833-4ead-87ae-7d83ae12eea5 container/c reason/ContainerExit code/137 cause/Error
May 07 22:20:05.855 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-07-203912: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-fccd3c76a79a74848421bbb468f817cd expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-a589f94baee2791af28fce6655fadf96, retrying]
May 07 22:20:05.855 - 534s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-07-203912: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-fccd3c76a79a74848421bbb468f817cd expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-a589f94baee2791af28fce6655fadf96, retrying]

... 1 lines not shown

May 07 16:13:01.118 - 35s   E clusteroperator/network condition/Degraded status/True reason/Error while updating operator configuration: could not apply (/v1, Kind=Namespace) /openshift-sdn: failed to apply / update (/v1, Kind=Namespace) /openshift-sdn: Patch "https://api-int.ci-op-kzv25dir-a3bb2.aws-2.ci.openshift.org:6443/api/v1/namespaces/openshift-sdn?fieldManager=cluster-network-operator%2Foperconfig&force=true": read tcp 10.0.136.168:54210->10.0.143.3:6443: read: connection reset by peer
May 07 16:13:07.878 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-07-143912: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-197d212fcb73c746844d944a11e73138 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-97a3093c08d0bde10f7f47bba5de1d62, retrying]
May 07 16:13:07.878 - 523s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-07-143912: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-197d212fcb73c746844d944a11e73138 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-97a3093c08d0bde10f7f47bba5de1d62, retrying]

... 1 lines not shown

May 06 20:13:47.119 E ns/e2e-k8s-sig-apps-job-upgrade-6844 pod/foo-lpqrs node/ip-10-0-161-176.us-west-1.compute.internal uid/b740b9fb-1ec8-4904-8540-97bb89d04c44 container/c reason/ContainerExit code/137 cause/Error
May 06 20:15:08.497 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-06-183542: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-eb0dd4ab9eab24e006c0f2d3e5b4419f expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-387eac27f9640a9880706fe2537ac7dc, retrying]
May 06 20:15:08.497 - 506s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-06-183542: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-eb0dd4ab9eab24e006c0f2d3e5b4419f expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-387eac27f9640a9880706fe2537ac7dc, retrying]

... 1 lines not shown

May 06 14:17:33.324 E ns/openshift-multus pod/cni-sysctl-allowlist-ds-888nh node/ip-10-0-192-222.us-east-2.compute.internal uid/9026c234-8aef-48d0-8ce6-e1e77f42cdf1 container/kube-multus-additional-cni-plugins reason/ContainerExit code/137 cause/Error
May 06 14:19:23.246 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-06-123542: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-1e57d9e03459a84840aed1dc653b4302 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-91ea455a2860927fdf97889bb9e7caad, retrying]
May 06 14:19:23.246 - 120s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-06-123542: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-1e57d9e03459a84840aed1dc653b4302 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-91ea455a2860927fdf97889bb9e7caad, retrying]

... 1 lines not shown

May 03 21:14:24.314 - 1s    E ns/openshift-authentication route/oauth-openshift disruption/ingress-to-oauth-server connection/new reason/DisruptionBegan ns/openshift-authentication route/oauth-openshift disruption/ingress-to-oauth-server connection/new stopped responding to GET requests over new connections: Get "https://oauth-openshift.apps.ci-op-ldy2hsrs-a3bb2.aws-2.ci.openshift.org/healthz": read tcp 10.131.93.140:49336->52.52.134.181:443: read: connection reset by peer
May 03 21:14:31.283 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-03-193550: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-28ae4afff885cf66892709d620b78ff7 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-9f6f74e60d387f96ebac78bfcf20b57d, retrying]
May 03 21:14:31.283 - 114s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-03-193550: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-28ae4afff885cf66892709d620b78ff7 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-9f6f74e60d387f96ebac78bfcf20b57d, retrying]

... 1 lines not shown

May 03 11:55:33.486 E ns/openshift-multus pod/cni-sysctl-allowlist-ds-zrvmf node/ip-10-0-231-197.ec2.internal uid/48cb6192-9161-45e5-8bb5-1628e4bb94df container/kube-multus-additional-cni-plugins reason/ContainerExit code/137 cause/Error
May 03 11:57:12.255 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-03-102448: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-76f48353eedb57dcb6e6dfdb6976dbae expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-601c31bb9299a54b3b7c2451b1cb1cc8, retrying]
May 03 11:57:12.255 - 114s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-03-102448: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-76f48353eedb57dcb6e6dfdb6976dbae expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-601c31bb9299a54b3b7c2451b1cb1cc8, retrying]

... 1 lines not shown

May 11 19:44:44.033 - 1s    E ns/openshift-authentication route/oauth-openshift disruption/ingress-to-oauth-server connection/new reason/DisruptionBegan ns/openshift-authentication route/oauth-openshift disruption/ingress-to-oauth-server connection/new stopped responding to GET requests over new connections: Get "https://oauth-openshift.apps.ci-op-pn4t57zr-a3bb2.aws-2.ci.openshift.org/healthz": read tcp 10.128.244.2:46496->52.53.45.44:443: read: connection reset by peer
May 11 19:45:24.178 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-11-181333: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-a00951719728290b62705fd374092c87 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-18f99c29f0191c2dd6f984139fb1fc97, retrying]
May 11 19:45:24.178 - 492s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-11-181333: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-a00951719728290b62705fd374092c87 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-18f99c29f0191c2dd6f984139fb1fc97, retrying]

... 1 lines not shown

May 16 02:42:20.959 E ns/openshift-multus pod/cni-sysctl-allowlist-ds-zfmpw node/ip-10-0-135-190.us-west-2.compute.internal uid/c94b431d-474b-487b-ba0b-fc5f11dd6394 container/kube-multus-additional-cni-plugins reason/ContainerExit code/137 cause/Error
May 16 02:45:08.931 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.12.0-0.ci-2024-05-16-010831: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-fe2c967a86488a9b984d0436a0a594b5 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-b619bd0c707f2403477f89aff24125d0, retrying]
May 16 02:45:08.931 - 100s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.12.0-0.ci-2024-05-16-010831: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-fe2c967a86488a9b984d0436a0a594b5 expected 33a010772d604aff2cb625d04a9469a47f53c96e has 15d0b0288a4330b90ac89f14c781dfa7349af52c: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-b619bd0c707f2403477f89aff24125d0, retrying]

... 1 lines not shown