Job:
periodic-ci-openshift-release-master-ci-4.11-upgrade-from-stable-4.10-e2e-azure-upgrade (all) - 7 runs, 86% failed, 50% of failures match = 43% impact
#1789414609858334720junit5 days ago
May 11 23:44:49.355 E ns/openshift-dns pod/node-resolver-wg7db node/ci-op-c0f7pidi-fde6e-8p9cb-master-1 uid/cac1c7a8-ec96-4716-8d91-036b0391660b container/dns-node-resolver reason/TerminationStateCleared lastState.terminated was cleared on a pod (bug https://bugzilla.redhat.com/show_bug.cgi?id=1933760 or similar)
May 11 23:45:21.646 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.11.0-0.ci-2024-05-11-200626: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-e620ce0e635adca616118cddcc679a20 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-04838c670a12bc4546d240f152b54f63, retrying]
May 11 23:45:21.646 - 407s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.11.0-0.ci-2024-05-11-200626: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-e620ce0e635adca616118cddcc679a20 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-04838c670a12bc4546d240f152b54f63, retrying]

... 1 lines not shown

#1789495080394952704junit5 days ago
May 12 04:52:20.207 E ns/openshift-dns pod/node-resolver-f9r7b node/ci-op-xxsf58bb-fde6e-nnc2j-master-0 uid/c4b1586a-1e14-4ce1-b4cc-990e65424def container/dns-node-resolver reason/TerminationStateCleared lastState.terminated was cleared on a pod (bug https://bugzilla.redhat.com/show_bug.cgi?id=1933760 or similar)
May 12 04:52:25.149 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.11.0-0.ci-2024-05-11-200626: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-4b42aa2e5c835f528f9a226785ed6f08 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-7f034915a0395e203f183ff95b0b9665, retrying]
May 12 04:52:25.149 - 414s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.11.0-0.ci-2024-05-11-200626: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-4b42aa2e5c835f528f9a226785ed6f08 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-7f034915a0395e203f183ff95b0b9665, retrying]

... 1 lines not shown

#1786690022217355264junit12 days ago
May 04 11:24:58.666 E ns/e2e-check-for-dns-availability-3305 pod/dns-test-d09ce63e-58ae-48fa-a3a8-915257acffcb-2hjls node/ci-op-42hixqrv-fde6e-cjndz-worker-westus-qrgpm uid/b14b403f-f586-4032-8173-e59d6f0c0e25 container/querier reason/TerminationStateCleared lastState.terminated was cleared on a pod (bug https://bugzilla.redhat.com/show_bug.cgi?id=1933760 or similar)
May 04 11:25:11.336 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.11.0-0.ci-2024-05-04-061844: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-7c78a324ae6311521f9cb3f6d4471fd1 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-190c40894c25f388679d97229f6fbe31, retrying]
May 04 11:25:11.336 - 121s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.11.0-0.ci-2024-05-04-061844: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-7c78a324ae6311521f9cb3f6d4471fd1 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-190c40894c25f388679d97229f6fbe31, retrying]

... 1 lines not shown

Found in 42.86% of runs (50.00% of failures) across 7 total runs and 1 jobs (85.71% failed) in 151ms - clear search | chart view - source code located on github