Job:
periodic-ci-openshift-release-master-ci-4.8-e2e-azure-upgrade (all) - 1 runs, 100% failed, 100% of failures match = 100% impact
#1783353790968107008junit5 hours ago
Apr 25 06:19:39.418 E ns/openshift-insights pod/insights-operator-7979b9f879-695s8 node/ci-op-w65hfwzc-25656-7xsch-master-0 container/insights-operator reason/ContainerExit code/2 cause/Error  06:17:00.135755       1 configobserver.go:77] Refreshing configuration from cluster pull secret\nI0425 06:17:00.141541       1 configobserver.go:102] Found cloud.openshift.com token\nI0425 06:17:00.141575       1 configobserver.go:120] Refreshing configuration from cluster secret\nI0425 06:17:00.144755       1 configobserver.go:124] Support secret does not exist\nI0425 06:17:00.196732       1 httplog.go:89] "HTTP" verb="GET" URI="/metrics" latency="9.666206ms" userAgent="Prometheus/2.26.1" srcIP="10.128.2.20:49628" resp=200\nI0425 06:17:00.266647       1 status.go:340] The operator is healthy\nI0425 06:17:00.266727       1 status.go:427] No status update necessary, objects are identical\nI0425 06:17:30.194504       1 httplog.go:89] "HTTP" verb="GET" URI="/metrics" latency="9.118025ms" userAgent="Prometheus/2.26.1" srcIP="10.128.2.20:49628" resp=200\nI0425 06:17:40.079765       1 reflector.go:530] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Watch close - *v1.ConfigMap total 5 items received\nI0425 06:18:00.214536       1 httplog.go:89] "HTTP" verb="GET" URI="/metrics" latency="14.612828ms" userAgent="Prometheus/2.26.1" srcIP="10.128.2.20:49628" resp=200\nI0425 06:18:12.083526       1 reflector.go:530] k8s.io/apiserver/pkg/authentication/request/headerrequest/requestheader_controller.go:172: Watch close - *v1.ConfigMap total 8 items received\nI0425 06:18:30.194220       1 httplog.go:89] "HTTP" verb="GET" URI="/metrics" latency="8.440168ms" userAgent="Prometheus/2.26.1" srcIP="10.128.2.20:49628" resp=200\nI0425 06:19:00.206577       1 httplog.go:89] "HTTP" verb="GET" URI="/metrics" latency="20.306844ms" userAgent="Prometheus/2.26.1" srcIP="10.128.2.20:49628" resp=200\nI0425 06:19:00.263793       1 status.go:340] The operator is healthy\nI0425 06:19:00.263876       1 status.go:427] No status update necessary, objects are identical\nI0425 06:19:30.199528       1 httplog.go:89] "HTTP" verb="GET" URI="/metrics" latency="12.181635ms" userAgent="Prometheus/2.26.1" srcIP="10.128.2.20:49628" resp=200\n
Apr 25 06:19:40.421 E ns/openshift-operator-lifecycle-manager pod/packageserver-795bc7d454-ssgvr node/ci-op-w65hfwzc-25656-7xsch-master-0 container/packageserver reason/ContainerExit code/2 cause/Error 3] Shutting down client-ca::kube-system::extension-apiserver-authentication::client-ca-file\nI0425 06:19:38.612537       1 requestheader_controller.go:183] Shutting down RequestHeaderAuthRequestController\nI0425 06:19:38.612550       1 configmap_cafile_content.go:223] Shutting down client-ca::kube-system::extension-apiserver-authentication::client-ca-file\nI0425 06:19:38.612574       1 requestheader_controller.go:183] Shutting down RequestHeaderAuthRequestController\nI0425 06:19:38.612591       1 configmap_cafile_content.go:223] Shutting down client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file\nI0425 06:19:38.612602       1 configmap_cafile_content.go:223] Shutting down client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file\nI0425 06:19:38.612679       1 secure_serving.go:241] Stopped listening on [::]:5443\nI0425 06:19:38.612707       1 tlsconfig.go:255] Shutting down DynamicServingCertificateController\nI0425 06:19:38.612746       1 dynamic_serving_content.go:145] Shutting down serving-cert::apiserver.local.config/certificates/apiserver.crt::apiserver.local.config/certificates/apiserver.key\npanic: send on closed channel\n\ngoroutine 44 [running]:\ngithub.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).processNextWorkItem(0xc0000ea8f0, 0x21371f0, 0xc000420000, 0xc00058ede0, 0x0)\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:297 +0x6fb\ngithub.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).worker(0xc0000ea8f0, 0x21371f0, 0xc000420000, 0xc00058ede0)\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:231 +0x49\ncreated by github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).start\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:221 +0x446\n
Apr 25 06:19:41.463 E ns/openshift-cluster-storage-operator pod/cluster-storage-operator-58b4cf58d6-7kqbk node/ci-op-w65hfwzc-25656-7xsch-master-0 container/cluster-storage-operator reason/ContainerExit code/1 cause/Error 5:56:47.400444       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-storage-operator", Name:"cluster-storage-operator", UID:"17af2172-b155-4842-9253-79cd513b9d1c", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/storage changed: status.versions changed from [{"operator" "4.8.0-0.ci-2023-07-15-003738"}] to [{"operator" "4.8.0-0.ci-2023-07-28-002940"}]\nI0425 05:56:47.476456       1 base_controller.go:72] Caches are synced for SnapshotCRDController \nI0425 05:56:47.476501       1 base_controller.go:109] Starting #1 worker of SnapshotCRDController controller ...\nI0425 06:06:47.285287       1 controller.go:174] Existing StorageClass managed-premium found, reconciling\nI0425 06:16:47.285833       1 controller.go:174] Existing StorageClass managed-premium found, reconciling\nI0425 06:16:47.295403       1 controller.go:174] Existing StorageClass managed-premium found, reconciling\nI0425 06:16:47.298896       1 controller.go:174] Existing StorageClass managed-premium found, reconciling\nI0425 06:19:40.605510       1 cmd.go:88] Received SIGTERM or SIGINT signal, shutting down controller.\nI0425 06:19:40.605636       1 base_controller.go:166] Shutting down SnapshotCRDController ...\nI0425 06:19:40.605661       1 base_controller.go:166] Shutting down CSIDriverStarter ...\nI0425 06:19:40.605674       1 base_controller.go:166] Shutting down ConfigObserver ...\nI0425 06:19:40.605743       1 base_controller.go:166] Shutting down ManagementStateController ...\nI0425 06:19:40.605745       1 reflector.go:225] Stopping reflector *v1.Role (10m0s) from k8s.io/client-go@v12.0.0+incompatible/tools/cache/reflector.go:167\nW0425 06:19:40.605771       1 builder.go:99] graceful termination failed, controllers failed with error: stopped\nI0425 06:19:40.605773       1 base_controller.go:166] Shutting down DefaultStorageClassController ...\nI0425 06:19:40.605799       1 base_controller.go:166] Shutting down StatusSyncer_storage ...\n
periodic-ci-openshift-release-master-ci-4.8-upgrade-from-stable-4.7-e2e-aws-upgrade (all) - 1 runs, 100% failed, 100% of failures match = 100% impact
#1783178879289004032junit17 hours ago
Apr 24 18:22:05.965 E ns/openshift-service-ca-operator pod/service-ca-operator-6ffd6f7cd8-6f5h8 node/ip-10-0-189-196.us-west-1.compute.internal container/service-ca-operator reason/ContainerExit code/1 cause/Error
Apr 24 18:22:06.001 E ns/openshift-operator-lifecycle-manager pod/packageserver-8b877dfd7-jb8d8 node/ip-10-0-189-196.us-west-1.compute.internal container/packageserver reason/ContainerExit code/2 cause/Error nfigmap_cafile_content.go:206\nI0424 18:22:05.025114       1 reflector.go:225] Stopping reflector *v1.ConfigMap (12h0m0s) from k8s.io/apiserver/pkg/authentication/request/headerrequest/requestheader_controller.go:172\nI0424 18:22:05.025151       1 secure_serving.go:241] Stopped listening on [::]:5443\nI0424 18:22:05.025173       1 reflector.go:225] Stopping reflector *v1.ConfigMap (12h0m0s) from k8s.io/apiserver/pkg/authentication/request/headerrequest/requestheader_controller.go:172\nI0424 18:22:05.025200       1 dynamic_serving_content.go:145] Shutting down serving-cert::apiserver.local.config/certificates/apiserver.crt::apiserver.local.config/certificates/apiserver.key\nI0424 18:22:05.024781       1 reflector.go:225] Stopping reflector *v1alpha1.CatalogSource (5m0s) from github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:153\nI0424 18:22:05.024847       1 reflector.go:225] Stopping reflector *v1.ConfigMap (12h0m0s) from k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206\nI0424 18:22:05.025177       1 tlsconfig.go:255] Shutting down DynamicServingCertificateController\npanic: send on closed channel\n\ngoroutine 163 [running]:\ngithub.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).processNextWorkItem(0xc000137810, 0x21371f0, 0xc000542dc0, 0xc0003c1f80, 0xc000234600)\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:297 +0x6fb\ngithub.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).worker(0xc000137810, 0x21371f0, 0xc000542dc0, 0xc0003c1f80)\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:231 +0x49\ncreated by github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).start\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:221 +0x446\n
Apr 24 18:22:06.976 E ns/openshift-service-ca pod/service-ca-5978cb6948-9vcds node/ip-10-0-189-196.us-west-1.compute.internal container/service-ca-controller reason/ContainerExit code/1 cause/Error

Found in 8.00% of runs (10.00% of failures) across 25 total runs and 25 jobs (80.00% failed) in 127ms - clear search | chart view - source code located on github