Job:
periodic-ci-openshift-release-master-ci-4.11-upgrade-from-stable-4.10-e2e-aws-ovn-upgrade (all) - 3 runs, 33% failed, 300% of failures match = 100% impact
#1789387624381681664junit5 days ago
May 11 21:53:29.000 - 1s    E disruption/service-load-balancer-with-pdb connection/new reason/DisruptionBegan disruption/service-load-balancer-with-pdb connection/new stopped responding to GET requests over new connections: Get "http://ac284a2e33ff84c809790795469a5f8d-792550360.us-west-2.elb.amazonaws.com:80/echo?msg=Hello": read tcp 10.128.204.52:59642->54.202.59.80:80: read: connection reset by peer
May 11 21:53:42.653 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.11.0-0.ci-2024-05-11-200626: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-25aa4c2e5266b44f444cc9a417c04346 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-c787accfa7d14b2fe1c9701f82679a6a, retrying]
May 11 21:53:42.653 - 177s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.11.0-0.ci-2024-05-11-200626: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-25aa4c2e5266b44f444cc9a417c04346 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-c787accfa7d14b2fe1c9701f82679a6a, retrying]

... 1 lines not shown

#1786642086859116544junit12 days ago
May 04 07:58:14.000 - 1s    E disruption/openshift-api connection/new reason/DisruptionBegan disruption/openshift-api connection/new stopped responding to GET requests over new connections: error running request: 500 Internal Server Error: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"rpc error: code = Unknown desc = malformed header: missing HTTP content-type","code":500}\n
May 04 07:59:38.589 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.11.0-0.ci-2024-05-04-061844: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-1fa60017f8a32fdddf96b2bd37d04521 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-a71cb4425c68202a9e7bc7b14cddbb15, retrying]
May 04 07:59:38.589 - 191s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.11.0-0.ci-2024-05-04-061844: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-1fa60017f8a32fdddf96b2bd37d04521 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-a71cb4425c68202a9e7bc7b14cddbb15, retrying]

... 1 lines not shown

#1787660396283301888junit9 days ago
May 07 03:33:05.463 E ns/openshift-e2e-loki pod/loki-promtail-sq7vp node/ip-10-0-180-251.us-west-2.compute.internal uid/4f22d23d-0e05-404a-ad40-e6457378fae0 container/prod-bearer-token reason/TerminationStateCleared lastState.terminated was cleared on a pod (bug https://bugzilla.redhat.com/show_bug.cgi?id=1933760 or similar)
May 07 03:34:35.103 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.11.0-0.ci-2024-05-04-061844: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-54382d186713cf8e3c9d537d0d909b40 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-8466babb5a5d0dcff69599451e8e9370, retrying]
May 07 03:34:35.103 - 226s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.11.0-0.ci-2024-05-04-061844: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-54382d186713cf8e3c9d537d0d909b40 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-8466babb5a5d0dcff69599451e8e9370, retrying]

... 1 lines not shown

Found in 100.00% of runs (300.00% of failures) across 3 total runs and 1 jobs (33.33% failed) in 197ms - clear search | chart view - source code located on github