Job:
periodic-ci-openshift-release-master-ci-4.12-upgrade-from-stable-4.11-from-stable-4.10-e2e-aws-sdn-upgrade (all) - 4 runs, 75% failed, 133% of failures match = 100% impact
#1790866720299159552junit28 hours ago
May 15 23:39:04.544 E ns/openshift-console pod/console-5d64f8dd4c-ztp8w node/ip-10-0-213-116.us-west-1.compute.internal uid/7b08fe3d-7a43-4db9-8103-fc73e762a641 container/console reason/ContainerExit code/2 cause/Error W0515 23:15:34.626652       1 main.go:220] Flag inactivity-timeout is set to less then 300 seconds and will be ignored!\nI0515 23:15:34.626673       1 main.go:364] cookies are secure!\nI0515 23:15:34.692870       1 main.go:798] Binding to [::]:8443...\nI0515 23:15:34.692909       1 main.go:800] using TLS\n
May 15 23:42:53.967 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.11.59: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-7c7bc664bca2a9f8b4b1374965d137a3 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-e83e8ea8a0317286f3d527541f24244d, retrying]
May 15 23:42:53.967 - 103s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.11.59: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-7c7bc664bca2a9f8b4b1374965d137a3 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-e83e8ea8a0317286f3d527541f24244d, retrying]

... 1 lines not shown

#1787242705265364992junit11 days ago
May 05 23:34:52.524 E ns/openshift-console pod/console-798b7c6d69-th8xv node/ip-10-0-165-182.ec2.internal uid/db556a3a-d312-4b39-9efb-3d4cc6652b6e container/console reason/ContainerExit code/2 cause/Error W0505 23:12:50.645660       1 main.go:220] Flag inactivity-timeout is set to less then 300 seconds and will be ignored!\nI0505 23:12:50.645688       1 main.go:364] cookies are secure!\nI0505 23:12:50.708301       1 main.go:798] Binding to [::]:8443...\nI0505 23:12:50.708356       1 main.go:800] using TLS\n
May 05 23:38:41.681 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.11.59: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-c51ab8e1510f7a805ba5f9a955180ef7 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-bf0448f37ecfee10d519eeac23229a83, retrying]
May 05 23:38:41.681 - 112s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.11.59: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-c51ab8e1510f7a805ba5f9a955180ef7 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 2 (ready 2) out of 3 nodes are updating to latest configuration rendered-master-bf0448f37ecfee10d519eeac23229a83, retrying]

... 1 lines not shown

#1790141919725096960junit3 days ago
May 13 23:30:50.612 E ns/openshift-cluster-csi-drivers pod/aws-ebs-csi-driver-node-zrts6 node/ip-10-0-217-159.us-east-2.compute.internal uid/140b6ef4-2027-4da9-81c5-90d37bc6edda container/csi-liveness-probe reason/ContainerExit code/137 cause/ContainerStatusUnknown The container could not be located when the pod was deleted.  The container used to be Running
May 13 23:30:50.804 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.11.59: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-99bbe0e4e1d49d506f484a8fe114c6f3 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-d7d25ad8ddaf399f9d741c2874dd0e9f, retrying]
May 13 23:30:50.804 - 440s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.11.59: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-99bbe0e4e1d49d506f484a8fe114c6f3 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-d7d25ad8ddaf399f9d741c2874dd0e9f, retrying]

... 1 lines not shown

#1788692355470069760junit7 days ago
May 09 23:34:10.074 E ns/e2e-k8s-sig-apps-job-upgrade-2395 pod/foo-h9fjv node/ip-10-0-254-220.ec2.internal uid/ccb35971-1a85-4da6-ba8f-304144a06a98 container/c reason/ContainerExit code/137 cause/Error
May 09 23:35:47.665 E clusteroperator/machine-config condition/Degraded status/True reason/RequiredPoolsFailed changed: Unable to apply 4.11.59: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-d1f73750d03df0eacb953843c853dc89 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-98fd8e6b4cc7c1717e8e778d071ec48e, retrying]
May 09 23:35:47.665 - 472s  E clusteroperator/machine-config condition/Degraded status/True reason/Unable to apply 4.11.59: error during syncRequiredMachineConfigPools: [timed out waiting for the condition, pool master has not progressed to latest configuration: controller version mismatch for rendered-master-d1f73750d03df0eacb953843c853dc89 expected 15d0b0288a4330b90ac89f14c781dfa7349af52c has 59a8d308bfa4cd89abdec9d345e396fe9dafd7b0: 1 (ready 1) out of 3 nodes are updating to latest configuration rendered-master-98fd8e6b4cc7c1717e8e778d071ec48e, retrying]

... 1 lines not shown

Found in 100.00% of runs (133.33% of failures) across 4 total runs and 1 jobs (75.00% failed) in 84ms - clear search | chart view - source code located on github