Result | SUCCESS |
Tests | 1 failed / 57 succeeded |
Started | |
Elapsed | 1h35m |
Work namespace | ci-op-5hjivt3i |
pod | 4.3.0-0.ci-2019-11-08-025819-gcp-serial |
go run hack/e2e.go -v -test --test_args='--ginkgo.focus=openshift\-tests\sMonitor\scluster\swhile\stests\sexecute$'
15 error level events were detected during this test run: Nov 08 03:31:51.562 E ns/openshift-machine-config-operator pod/machine-config-daemon-bn5ss node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 143 (Error): Nov 08 03:31:52.803 E ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-tt6gk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=prometheus-adapter container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:36:09.523 E ns/openshift-machine-config-operator pod/machine-config-daemon-q592c node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:36:09.523 E ns/openshift-machine-config-operator pod/machine-config-daemon-q592c node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=machine-config-daemon container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:36:09.542 E ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=config-reloader container exited with code 2 (Error): 2019/11/08 03:32:13 Watching directory: "/etc/alertmanager/config"\n Nov 08 03:36:09.542 E ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=alertmanager-proxy container exited with code 2 (Error): 2019/11/08 03:32:13 provider.go:117: Defaulting client-id to system:serviceaccount:openshift-monitoring:alertmanager-main\n2019/11/08 03:32:13 provider.go:122: Defaulting client-secret to service account token /var/run/secrets/kubernetes.io/serviceaccount/token\n2019/11/08 03:32:13 provider.go:310: Delegation of authentication and authorization to OpenShift is enabled for bearer tokens and client certificates.\n2019/11/08 03:32:13 oauthproxy.go:200: mapping path "/" => upstream "http://localhost:9093/"\n2019/11/08 03:32:13 oauthproxy.go:221: compiled skip-auth-regex => "^/metrics"\n2019/11/08 03:32:13 oauthproxy.go:227: OAuthProxy configured for Client ID: system:serviceaccount:openshift-monitoring:alertmanager-main\n2019/11/08 03:32:13 oauthproxy.go:237: Cookie settings: name:_oauth_proxy secure(https):true httponly:true expiry:168h0m0s domain:<default> refresh:disabled\n2019/11/08 03:32:13 http.go:96: HTTPS: listening on [::]:9095\n Nov 08 03:43:03.495 E ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:43:03.495 E ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=machine-config-daemon container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:47:32.008 E ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 143 (Error): Nov 08 03:49:46.287 E ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 143 (Error): Nov 08 03:49:47.314 E ns/openshift-dns pod/dns-default-5jbdk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns-node-resolver container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:49:47.314 E ns/openshift-dns pod/dns-default-5jbdk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 04:05:43.042 E clusteroperator/dns changed Degraded to True: NotAllDNSesAvailable: Not all desired DNS DaemonSets available Nov 08 04:12:24.546 E ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 143 (Error): Nov 08 04:24:10.983 E ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 143 (Error):from junit_e2e_20191108-042420.xml
Timeline: Nov 08 03:31:50.688 W ns/openshift-dns pod/dns-default-7nw49 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:31:50.691 W ns/openshift-image-registry pod/node-ca-5pmhx node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:31:50.694 I ns/openshift-ingress pod/router-default-86745b9ddc-j95nc Marking for deletion Pod openshift-ingress/router-default-86745b9ddc-j95nc Nov 08 03:31:50.695 I ns/openshift-dns daemonset/dns-default Deleted pod: dns-default-7nw49 Nov 08 03:31:50.696 W ns/openshift-ingress pod/router-default-86745b9ddc-j95nc node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:31:50.699 W ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-tt6gk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:31:50.702 W ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 120s Nov 08 03:31:50.702 W ns/openshift-machine-config-operator pod/machine-config-daemon-bn5ss node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 600s Nov 08 03:31:50.706 I ns/openshift-dns pod/dns-default-7nw49 Stopping container dns-node-resolver Nov 08 03:31:50.706 I ns/openshift-dns pod/dns-default-7nw49 Marking for deletion Pod openshift-dns/dns-default-7nw49 Nov 08 03:31:50.712 W ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-pnd2d node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:31:50.713 W ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:31:50.714 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-bn5ss Nov 08 03:31:50.716 I ns/openshift-dns pod/dns-default-7nw49 Stopping container dns Nov 08 03:31:50.728 I ns/openshift-image-registry daemonset/node-ca Deleted pod: node-ca-5pmhx Nov 08 03:31:50.728 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-pnd2d Marking for deletion Pod openshift-monitoring/openshift-state-metrics-55648f75b5-pnd2d Nov 08 03:31:50.754 I ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-tt6gk Marking for deletion Pod openshift-monitoring/prometheus-adapter-5cf9bfb96-tt6gk Nov 08 03:31:50.754 I ns/openshift-image-registry pod/node-ca-5pmhx Stopping container node-ca Nov 08 03:31:50.762 I ns/openshift-image-registry pod/node-ca-5pmhx Marking for deletion Pod openshift-image-registry/node-ca-5pmhx Nov 08 03:31:50.764 I ns/openshift-ingress pod/router-default-86745b9ddc-j95nc Stopping container router Nov 08 03:31:50.768 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l Marking for deletion Pod openshift-monitoring/thanos-querier-cd9bc9df9-sxd8l Nov 08 03:31:50.771 I ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-tt6gk Stopping container prometheus-adapter Nov 08 03:31:50.773 I ns/openshift-monitoring pod/alertmanager-main-1 Marking for deletion Pod openshift-monitoring/alertmanager-main-1 Nov 08 03:31:50.779 I ns/openshift-machine-config-operator pod/machine-config-daemon-bn5ss Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-bn5ss Nov 08 03:31:50.780 I ns/openshift-monitoring pod/alertmanager-main-1 Stopping container alertmanager-proxy Nov 08 03:31:50.789 I ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-ndjqw node/ created Nov 08 03:31:50.794 I ns/openshift-ingress pod/router-default-86745b9ddc-mqxsr node/ created Nov 08 03:31:50.795 I ns/openshift-monitoring pod/alertmanager-main-1 Stopping container config-reloader Nov 08 03:31:50.800 I ns/openshift-monitoring replicaset/prometheus-adapter-5cf9bfb96 Created pod: prometheus-adapter-5cf9bfb96-ndjqw Nov 08 03:31:50.808 I ns/openshift-monitoring pod/alertmanager-main-1 Stopping container alertmanager Nov 08 03:31:50.814 I ns/openshift-ingress replicaset/router-default-86745b9ddc Created pod: router-default-86745b9ddc-mqxsr Nov 08 03:31:50.820 I ns/openshift-machine-config-operator pod/machine-config-daemon-bn5ss Stopping container machine-config-daemon Nov 08 03:31:50.836 I ns/openshift-machine-config-operator pod/machine-config-daemon-bn5ss Stopping container oauth-proxy Nov 08 03:31:50.839 I ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-ndjqw Successfully assigned openshift-monitoring/prometheus-adapter-5cf9bfb96-ndjqw to ci-op--b6wsl-w-b-cpl45.c.openshift-gce-devel-ci.internal Nov 08 03:31:50.856 I ns/openshift-ingress pod/router-default-86745b9ddc-mqxsr Successfully assigned openshift-ingress/router-default-86745b9ddc-mqxsr to ci-op--b6wsl-w-b-cpl45.c.openshift-gce-devel-ci.internal Nov 08 03:31:50.856 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 node/ created Nov 08 03:31:50.876 I ns/openshift-monitoring replicaset/openshift-state-metrics-55648f75b5 Created pod: openshift-state-metrics-55648f75b5-86cf7 Nov 08 03:31:50.892 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 Successfully assigned openshift-monitoring/openshift-state-metrics-55648f75b5-86cf7 to ci-op--b6wsl-w-b-cpl45.c.openshift-gce-devel-ci.internal Nov 08 03:31:50.903 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz node/ created Nov 08 03:31:50.914 I ns/openshift-monitoring replicaset/thanos-querier-cd9bc9df9 Created pod: thanos-querier-cd9bc9df9-lxkkz Nov 08 03:31:50.941 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Successfully assigned openshift-monitoring/thanos-querier-cd9bc9df9-lxkkz to ci-op--b6wsl-w-b-cpl45.c.openshift-gce-devel-ci.internal Nov 08 03:31:50.956 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-pnd2d Stopping container openshift-state-metrics Nov 08 03:31:51.107 W clusteroperator/ingress changed Available to False: IngressUnavailable: Not all ingress controllers are available. Nov 08 03:31:51.107 W clusteroperator/ingress changed Progressing to True: Reconciling: Not all ingress controllers are available. Nov 08 03:31:51.148 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-pnd2d Stopping container kube-rbac-proxy-self Nov 08 03:31:51.348 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-pnd2d Stopping container kube-rbac-proxy-main Nov 08 03:31:51.544 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l Stopping container prom-label-proxy Nov 08 03:31:51.562 E ns/openshift-machine-config-operator pod/machine-config-daemon-bn5ss node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 143 (Error): Nov 08 03:31:51.745 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l Stopping container kube-rbac-proxy Nov 08 03:31:51.948 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l Stopping container oauth-proxy Nov 08 03:31:52.145 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l Stopping container thanos-querier Nov 08 03:31:52.704 W ns/openshift-machine-config-operator pod/machine-config-daemon-bn5ss node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:31:52.720 I ns/openshift-machine-config-operator pod/machine-config-daemon-q592c node/ created Nov 08 03:31:52.729 W ns/openshift-ingress pod/router-default-86745b9ddc-j95nc node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:31:52.729 W ns/openshift-ingress pod/router-default-86745b9ddc-j95nc node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=router container stopped being ready Nov 08 03:31:52.731 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-q592c Nov 08 03:31:52.743 I ns/openshift-machine-config-operator pod/machine-config-daemon-q592c Successfully assigned openshift-machine-config-operator/machine-config-daemon-q592c to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:31:52.756 W ns/openshift-dns pod/dns-default-7nw49 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:31:52.756 W ns/openshift-dns pod/dns-default-7nw49 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns container stopped being ready Nov 08 03:31:52.756 W ns/openshift-dns pod/dns-default-7nw49 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns-node-resolver container stopped being ready Nov 08 03:31:52.777 W ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-pnd2d node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:31:52.777 W ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-pnd2d node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=openshift-state-metrics container stopped being ready Nov 08 03:31:52.777 W ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-pnd2d node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=kube-rbac-proxy-main container stopped being ready Nov 08 03:31:52.777 W ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-pnd2d node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=kube-rbac-proxy-self container stopped being ready Nov 08 03:31:52.790 W ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-tt6gk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:31:52.790 W ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-tt6gk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=prometheus-adapter container stopped being ready Nov 08 03:31:52.803 E ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-tt6gk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=prometheus-adapter container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:31:52.816 W ns/openshift-image-registry pod/node-ca-5pmhx node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:31:52.816 W ns/openshift-image-registry pod/node-ca-5pmhx node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=node-ca container stopped being ready Nov 08 03:31:52.831 W ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:31:52.831 W ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=kube-rbac-proxy container stopped being ready Nov 08 03:31:52.831 W ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container stopped being ready Nov 08 03:31:52.831 W ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=thanos-querier container stopped being ready Nov 08 03:31:52.831 W ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=prom-label-proxy container stopped being ready Nov 08 03:31:52.852 W ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:31:52.852 W ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=alertmanager container stopped being ready Nov 08 03:31:52.852 W ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=alertmanager-proxy container stopped being ready Nov 08 03:31:52.852 W ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=config-reloader container stopped being ready Nov 08 03:31:52.882 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available. Nov 08 03:31:53.394 I ns/openshift-machine-config-operator pod/machine-config-daemon-q592c Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:cdabca18ca3136518c5c0f66c0ed643bd45e356fe10af7555e58a5697b942953" already present on machine Nov 08 03:31:53.549 I ns/openshift-machine-config-operator pod/machine-config-daemon-q592c Created container machine-config-daemon Nov 08 03:31:53.582 I ns/openshift-machine-config-operator pod/machine-config-daemon-q592c Started container machine-config-daemon Nov 08 03:31:53.588 I ns/openshift-machine-config-operator pod/machine-config-daemon-q592c Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" already present on machine Nov 08 03:31:53.765 I ns/openshift-machine-config-operator pod/machine-config-daemon-q592c Created container oauth-proxy Nov 08 03:31:53.795 I ns/openshift-machine-config-operator pod/machine-config-daemon-q592c Started container oauth-proxy Nov 08 03:31:54.018 W ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-tt6gk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 03:31:54.018 W ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 03:31:54.018 W ns/openshift-ingress pod/router-default-86745b9ddc-j95nc node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 03:31:54.018 W ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-pnd2d node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 03:31:54.018 W ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 03:31:54.018 W ns/openshift-image-registry pod/node-ca-5pmhx node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 03:31:54.018 W ns/openshift-dns pod/dns-default-7nw49 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 03:31:58.353 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:93a0c6d5321fe0afcc6d59b04b7110f17418390e71d2ba2320b3b2a71b632b56" already present on machine Nov 08 03:31:58.520 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 Created container kube-rbac-proxy-main Nov 08 03:31:58.548 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 Started container kube-rbac-proxy-main Nov 08 03:31:58.553 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:93a0c6d5321fe0afcc6d59b04b7110f17418390e71d2ba2320b3b2a71b632b56" already present on machine Nov 08 03:31:58.773 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 Created container kube-rbac-proxy-self Nov 08 03:31:58.797 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 Started container kube-rbac-proxy-self Nov 08 03:31:58.802 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:2ff626cae8e48e7075928c30aaf339add647c8b3a7c9cbb62581ef0e91a2a9f9" Nov 08 03:31:59.283 I ns/openshift-ingress pod/router-default-86745b9ddc-mqxsr Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:bd70de74d6dc01dedf586047151a4e6f4116a04f853d3fce65f353726a0c64e3" Nov 08 03:31:59.647 I ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-ndjqw Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:832221e63bc0b28b204f04a861c773b7f808afd7b18922a6983e5f95fbeb7ae3" Nov 08 03:31:59.682 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:2b9dabef8ad692d143307c77162da685f6bdfe94be7f09010a64b73400c96258" already present on machine Nov 08 03:31:59.863 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Created container thanos-querier Nov 08 03:31:59.901 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Started container thanos-querier Nov 08 03:31:59.908 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" already present on machine Nov 08 03:32:00.096 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Created container oauth-proxy Nov 08 03:32:00.132 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Started container oauth-proxy Nov 08 03:32:00.139 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:93a0c6d5321fe0afcc6d59b04b7110f17418390e71d2ba2320b3b2a71b632b56" already present on machine Nov 08 03:32:00.426 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Created container kube-rbac-proxy Nov 08 03:32:00.530 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Started container kube-rbac-proxy Nov 08 03:32:00.540 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:27f4cef3c20b57e894d34b297136eed9b2864efbbd96f57d2bed7c8441947b3d" already present on machine Nov 08 03:32:00.917 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Created container prom-label-proxy Nov 08 03:32:00.994 I ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-lxkkz Started container prom-label-proxy Nov 08 03:32:03.935 I ns/openshift-ingress pod/router-default-86745b9ddc-mqxsr Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:bd70de74d6dc01dedf586047151a4e6f4116a04f853d3fce65f353726a0c64e3" Nov 08 03:32:03.940 I ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-ndjqw Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:832221e63bc0b28b204f04a861c773b7f808afd7b18922a6983e5f95fbeb7ae3" Nov 08 03:32:04.134 I ns/openshift-ingress pod/router-default-86745b9ddc-mqxsr Created container router Nov 08 03:32:04.154 I ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-ndjqw Created container prometheus-adapter Nov 08 03:32:04.166 I ns/openshift-ingress pod/router-default-86745b9ddc-mqxsr Started container router Nov 08 03:32:04.200 I ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-ndjqw Started container prometheus-adapter Nov 08 03:32:04.352 W ns/openshift-image-registry pod/node-ca-5pmhx node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:32:04.389 I ns/openshift-image-registry pod/node-ca-kvvdr node/ created Nov 08 03:32:04.395 W ns/openshift-monitoring pod/thanos-querier-cd9bc9df9-sxd8l node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:32:04.397 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-kvvdr Nov 08 03:32:04.419 I ns/openshift-image-registry pod/node-ca-kvvdr Successfully assigned openshift-image-registry/node-ca-kvvdr to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:32:04.445 W ns/openshift-monitoring pod/prometheus-adapter-5cf9bfb96-tt6gk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:32:04.495 W ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-pnd2d node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:32:04.532 W ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:32:04.564 W ns/openshift-ingress pod/router-default-86745b9ddc-j95nc node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:32:04.597 I ns/openshift-monitoring pod/alertmanager-main-1 node/ created Nov 08 03:32:04.603 W ns/openshift-dns pod/dns-default-7nw49 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:32:04.607 I ns/openshift-monitoring statefulset/alertmanager-main create Pod alertmanager-main-1 in StatefulSet alertmanager-main successful Nov 08 03:32:04.628 I ns/openshift-dns pod/dns-default-4txld node/ created Nov 08 03:32:04.628 I ns/openshift-monitoring pod/alertmanager-main-1 Successfully assigned openshift-monitoring/alertmanager-main-1 to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:32:04.638 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-4txld Nov 08 03:32:04.647 I ns/openshift-dns pod/dns-default-4txld Successfully assigned openshift-dns/dns-default-4txld to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:32:09.053 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:2ff626cae8e48e7075928c30aaf339add647c8b3a7c9cbb62581ef0e91a2a9f9" Nov 08 03:32:09.257 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 Created container openshift-state-metrics Nov 08 03:32:09.404 I ns/openshift-monitoring pod/openshift-state-metrics-55648f75b5-86cf7 Started container openshift-state-metrics Nov 08 03:32:12.419 I ns/openshift-image-registry pod/node-ca-kvvdr Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:f6eb3311f979eda2afbf98b9b8240237215076246bf2ea5d4a35f62aa09ff192" already present on machine Nov 08 03:32:12.567 I ns/openshift-image-registry pod/node-ca-kvvdr Created container node-ca Nov 08 03:32:12.596 I ns/openshift-image-registry pod/node-ca-kvvdr Started container node-ca Nov 08 03:32:12.773 I ns/openshift-dns pod/dns-default-4txld Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:9a7e8297f7b70ee3a11fcbe4a78c59a5861e1afda5657a7437de6934bdc2458e" already present on machine Nov 08 03:32:12.884 I ns/openshift-monitoring pod/alertmanager-main-1 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:4a4d954ea2a2f7eff16f8c11d2b808286ff722c878d4d05dccf4d545580f1d3a" already present on machine Nov 08 03:32:12.943 I ns/openshift-dns pod/dns-default-4txld Created container dns Nov 08 03:32:12.985 I ns/openshift-dns pod/dns-default-4txld Started container dns Nov 08 03:32:12.993 I ns/openshift-dns pod/dns-default-4txld Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:37811ccc702371cbc91e86935f03b5d55040835fb8d653d211410587385034f8" already present on machine Nov 08 03:32:13.088 I ns/openshift-monitoring pod/alertmanager-main-1 Created container alertmanager Nov 08 03:32:13.124 I ns/openshift-monitoring pod/alertmanager-main-1 Started container alertmanager Nov 08 03:32:13.129 I ns/openshift-monitoring pod/alertmanager-main-1 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:63ff8d9f806970af770724d4ba8bc521885de81e3e22212042a8b770a83f1b94" already present on machine Nov 08 03:32:13.172 I ns/openshift-dns pod/dns-default-4txld Created container dns-node-resolver Nov 08 03:32:13.233 I ns/openshift-dns pod/dns-default-4txld Started container dns-node-resolver Nov 08 03:32:13.592 I ns/openshift-monitoring pod/alertmanager-main-1 Created container config-reloader Nov 08 03:32:13.625 I ns/openshift-monitoring pod/alertmanager-main-1 Started container config-reloader Nov 08 03:32:13.630 I ns/openshift-monitoring pod/alertmanager-main-1 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" already present on machine Nov 08 03:32:13.820 I ns/openshift-monitoring pod/alertmanager-main-1 Created container alertmanager-proxy Nov 08 03:32:14.019 I ns/openshift-monitoring pod/alertmanager-main-1 Started container alertmanager-proxy Nov 08 03:32:14.179 W clusteroperator/ingress changed Available to True: desired and current number of IngressControllers are equal Nov 08 03:32:14.179 W clusteroperator/ingress changed Progressing to False: desired and current number of IngressControllers are equal Nov 08 03:32:28.365 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal Nov 08 03:36:07.794 W ns/openshift-dns pod/dns-default-4txld node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:36:07.802 W ns/openshift-machine-config-operator pod/machine-config-daemon-q592c node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 600s Nov 08 03:36:07.803 I ns/openshift-image-registry pod/node-ca-kvvdr Marking for deletion Pod openshift-image-registry/node-ca-kvvdr Nov 08 03:36:07.806 I ns/openshift-dns pod/dns-default-4txld Stopping container dns Nov 08 03:36:07.817 W ns/openshift-image-registry pod/node-ca-kvvdr node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:36:07.818 W ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 120s Nov 08 03:36:07.828 I ns/openshift-image-registry daemonset/node-ca Deleted pod: node-ca-kvvdr Nov 08 03:36:07.828 I ns/openshift-machine-config-operator pod/machine-config-daemon-q592c Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-q592c Nov 08 03:36:07.828 I ns/openshift-dns pod/dns-default-4txld Stopping container dns-node-resolver Nov 08 03:36:07.835 I ns/openshift-machine-config-operator pod/machine-config-daemon-q592c Stopping container oauth-proxy Nov 08 03:36:07.839 I ns/openshift-dns daemonset/dns-default Deleted pod: dns-default-4txld Nov 08 03:36:07.842 I ns/openshift-machine-config-operator pod/machine-config-daemon-q592c Stopping container machine-config-daemon Nov 08 03:36:07.843 I ns/openshift-monitoring pod/alertmanager-main-1 Marking for deletion Pod openshift-monitoring/alertmanager-main-1 (2 times) Nov 08 03:36:07.850 I ns/openshift-dns pod/dns-default-4txld Marking for deletion Pod openshift-dns/dns-default-4txld Nov 08 03:36:07.850 I ns/openshift-image-registry pod/node-ca-kvvdr Stopping container node-ca Nov 08 03:36:07.860 I ns/openshift-monitoring pod/alertmanager-main-1 Stopping container alertmanager-proxy Nov 08 03:36:07.873 I ns/openshift-monitoring pod/alertmanager-main-1 Stopping container config-reloader Nov 08 03:36:07.881 I ns/openshift-monitoring pod/alertmanager-main-1 Stopping container alertmanager Nov 08 03:36:09.459 W ns/openshift-dns pod/dns-default-4txld node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:36:09.459 W ns/openshift-dns pod/dns-default-4txld node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns-node-resolver container stopped being ready Nov 08 03:36:09.459 W ns/openshift-dns pod/dns-default-4txld node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns container stopped being ready Nov 08 03:36:09.489 W ns/openshift-image-registry pod/node-ca-kvvdr node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:36:09.489 W ns/openshift-image-registry pod/node-ca-kvvdr node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=node-ca container stopped being ready Nov 08 03:36:09.505 W ns/openshift-machine-config-operator pod/machine-config-daemon-q592c node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:36:09.505 W ns/openshift-machine-config-operator pod/machine-config-daemon-q592c node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container stopped being ready Nov 08 03:36:09.505 W ns/openshift-machine-config-operator pod/machine-config-daemon-q592c node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=machine-config-daemon container stopped being ready Nov 08 03:36:09.523 E ns/openshift-machine-config-operator pod/machine-config-daemon-q592c node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:36:09.523 E ns/openshift-machine-config-operator pod/machine-config-daemon-q592c node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=machine-config-daemon container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:36:09.542 E ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=config-reloader container exited with code 2 (Error): 2019/11/08 03:32:13 Watching directory: "/etc/alertmanager/config"\n Nov 08 03:36:09.542 E ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=alertmanager-proxy container exited with code 2 (Error): 2019/11/08 03:32:13 provider.go:117: Defaulting client-id to system:serviceaccount:openshift-monitoring:alertmanager-main\n2019/11/08 03:32:13 provider.go:122: Defaulting client-secret to service account token /var/run/secrets/kubernetes.io/serviceaccount/token\n2019/11/08 03:32:13 provider.go:310: Delegation of authentication and authorization to OpenShift is enabled for bearer tokens and client certificates.\n2019/11/08 03:32:13 oauthproxy.go:200: mapping path "/" => upstream "http://localhost:9093/"\n2019/11/08 03:32:13 oauthproxy.go:221: compiled skip-auth-regex => "^/metrics"\n2019/11/08 03:32:13 oauthproxy.go:227: OAuthProxy configured for Client ID: system:serviceaccount:openshift-monitoring:alertmanager-main\n2019/11/08 03:32:13 oauthproxy.go:237: Cookie settings: name:_oauth_proxy secure(https):true httponly:true expiry:168h0m0s domain:<default> refresh:disabled\n2019/11/08 03:32:13 http.go:96: HTTPS: listening on [::]:9095\n Nov 08 03:36:10.493 W ns/openshift-dns pod/dns-default-4txld node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:36:10.531 W ns/openshift-machine-config-operator pod/machine-config-daemon-q592c node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:36:10.561 W ns/openshift-monitoring pod/alertmanager-main-1 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:36:10.603 W ns/openshift-image-registry pod/node-ca-kvvdr node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:36:10.611 I ns/openshift-monitoring pod/alertmanager-main-1 node/ created Nov 08 03:36:10.621 I ns/openshift-monitoring statefulset/alertmanager-main create Pod alertmanager-main-1 in StatefulSet alertmanager-main successful (2 times) Nov 08 03:36:10.631 I ns/openshift-monitoring pod/alertmanager-main-1 Successfully assigned openshift-monitoring/alertmanager-main-1 to ci-op--b6wsl-w-c-sd8wn.c.openshift-gce-devel-ci.internal Nov 08 03:36:18.371 I ns/openshift-monitoring pod/alertmanager-main-1 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:4a4d954ea2a2f7eff16f8c11d2b808286ff722c878d4d05dccf4d545580f1d3a" already present on machine Nov 08 03:36:18.569 I ns/openshift-monitoring pod/alertmanager-main-1 Created container alertmanager Nov 08 03:36:18.600 I ns/openshift-monitoring pod/alertmanager-main-1 Started container alertmanager Nov 08 03:36:18.606 I ns/openshift-monitoring pod/alertmanager-main-1 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:63ff8d9f806970af770724d4ba8bc521885de81e3e22212042a8b770a83f1b94" already present on machine Nov 08 03:36:19.065 I ns/openshift-monitoring pod/alertmanager-main-1 Created container config-reloader Nov 08 03:36:19.099 I ns/openshift-monitoring pod/alertmanager-main-1 Started container config-reloader Nov 08 03:36:19.108 I ns/openshift-monitoring pod/alertmanager-main-1 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" already present on machine Nov 08 03:36:19.332 I ns/openshift-monitoring pod/alertmanager-main-1 Created container alertmanager-proxy Nov 08 03:36:19.367 I ns/openshift-monitoring pod/alertmanager-main-1 Started container alertmanager-proxy Nov 08 03:36:20.190 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (2 times) Nov 08 03:36:20.201 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-000" not found) (3 times) Nov 08 03:36:20.385 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-001" not found) (7 times) Nov 08 03:36:20.785 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-002" not found) (2 times) Nov 08 03:36:21.187 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-003" not found) (3 times) Nov 08 03:36:34.834 I ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls node/ created Nov 08 03:36:34.840 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-s4tls Nov 08 03:36:34.855 I ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls Successfully assigned openshift-machine-config-operator/machine-config-daemon-s4tls to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:36:34.860 I ns/openshift-image-registry pod/node-ca-djc46 node/ created Nov 08 03:36:34.864 I ns/openshift-dns pod/dns-default-7h8w6 node/ created Nov 08 03:36:34.868 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-djc46 Nov 08 03:36:34.884 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-7h8w6 Nov 08 03:36:34.884 I ns/openshift-image-registry pod/node-ca-djc46 Successfully assigned openshift-image-registry/node-ca-djc46 to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:36:34.894 I ns/openshift-dns pod/dns-default-7h8w6 Successfully assigned openshift-dns/dns-default-7h8w6 to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:36:34.997 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available. Nov 08 03:36:35.692 I ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:cdabca18ca3136518c5c0f66c0ed643bd45e356fe10af7555e58a5697b942953" already present on machine Nov 08 03:36:35.845 I ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls Created container machine-config-daemon Nov 08 03:36:35.880 I ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls Started container machine-config-daemon Nov 08 03:36:35.891 I ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" already present on machine Nov 08 03:36:36.061 I ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls Created container oauth-proxy Nov 08 03:36:36.098 I ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls Started container oauth-proxy Nov 08 03:36:42.873 I ns/openshift-dns pod/dns-default-7h8w6 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:9a7e8297f7b70ee3a11fcbe4a78c59a5861e1afda5657a7437de6934bdc2458e" already present on machine Nov 08 03:36:43.037 I ns/openshift-dns pod/dns-default-7h8w6 Created container dns Nov 08 03:36:43.068 I ns/openshift-dns pod/dns-default-7h8w6 Started container dns Nov 08 03:36:43.077 I ns/openshift-dns pod/dns-default-7h8w6 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:37811ccc702371cbc91e86935f03b5d55040835fb8d653d211410587385034f8" already present on machine Nov 08 03:36:43.100 I ns/openshift-image-registry pod/node-ca-djc46 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:f6eb3311f979eda2afbf98b9b8240237215076246bf2ea5d4a35f62aa09ff192" already present on machine Nov 08 03:36:43.283 I ns/openshift-dns pod/dns-default-7h8w6 Created container dns-node-resolver Nov 08 03:36:43.307 I ns/openshift-image-registry pod/node-ca-djc46 Created container node-ca Nov 08 03:36:43.321 I ns/openshift-dns pod/dns-default-7h8w6 Started container dns-node-resolver Nov 08 03:36:43.340 I ns/openshift-image-registry pod/node-ca-djc46 Started container node-ca Nov 08 03:36:55.163 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal Nov 08 03:38:04.919 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (3 times) Nov 08 03:38:04.925 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-000" not found) (3 times) Nov 08 03:38:04.931 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-001" not found) (6 times) Nov 08 03:38:05.315 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-002" not found) (7 times) Nov 08 03:38:05.713 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-003" not found) (3 times) Nov 08 03:39:54.819 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (3 times) Nov 08 03:39:54.826 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-000" not found) (3 times) Nov 08 03:39:54.835 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-001" not found) (5 times) Nov 08 03:39:55.213 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-002" not found) (3 times) Nov 08 03:39:55.813 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-007" not found) (2 times) Nov 08 03:43:02.138 I ns/openshift-dns pod/dns-default-7h8w6 Marking for deletion Pod openshift-dns/dns-default-7h8w6 Nov 08 03:43:02.148 W ns/openshift-dns pod/dns-default-7h8w6 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:43:02.149 W ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 600s Nov 08 03:43:02.149 W ns/openshift-image-registry pod/node-ca-djc46 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:43:02.153 I ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-s4tls Nov 08 03:43:02.164 I ns/openshift-dns daemonset/dns-default Deleted pod: dns-default-7h8w6 Nov 08 03:43:02.164 I ns/openshift-dns pod/dns-default-7h8w6 Stopping container dns Nov 08 03:43:02.166 I ns/openshift-image-registry pod/node-ca-djc46 Marking for deletion Pod openshift-image-registry/node-ca-djc46 Nov 08 03:43:02.184 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-s4tls Nov 08 03:43:02.184 I ns/openshift-dns pod/dns-default-7h8w6 Stopping container dns-node-resolver Nov 08 03:43:02.189 I ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls Stopping container oauth-proxy Nov 08 03:43:02.203 I ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls Stopping container machine-config-daemon Nov 08 03:43:02.215 I ns/openshift-image-registry pod/node-ca-djc46 Stopping container node-ca Nov 08 03:43:03.466 W ns/openshift-image-registry pod/node-ca-djc46 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:43:03.466 W ns/openshift-image-registry pod/node-ca-djc46 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=node-ca container stopped being ready Nov 08 03:43:03.482 W ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:43:03.482 W ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container stopped being ready Nov 08 03:43:03.482 W ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=machine-config-daemon container stopped being ready Nov 08 03:43:03.495 E ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:43:03.495 E ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=machine-config-daemon container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:43:03.508 W ns/openshift-dns pod/dns-default-7h8w6 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:43:03.508 W ns/openshift-dns pod/dns-default-7h8w6 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns container stopped being ready Nov 08 03:43:03.508 W ns/openshift-dns pod/dns-default-7h8w6 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns-node-resolver container stopped being ready Nov 08 03:43:04.498 W ns/openshift-dns pod/dns-default-7h8w6 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:43:04.536 W ns/openshift-image-registry pod/node-ca-djc46 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:43:09.018 W ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 03:43:14.325 W ns/openshift-machine-config-operator pod/machine-config-daemon-s4tls node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:44:24.355 I ns/openshift-dns pod/dns-default-zb2xn node/ created Nov 08 03:44:24.363 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-zb2xn Nov 08 03:44:24.365 I ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 node/ created Nov 08 03:44:24.379 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-fvgh7 Nov 08 03:44:24.395 I ns/openshift-dns pod/dns-default-zb2xn Successfully assigned openshift-dns/dns-default-zb2xn to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:44:24.395 I ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 Successfully assigned openshift-machine-config-operator/machine-config-daemon-fvgh7 to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:44:24.419 I ns/openshift-image-registry pod/node-ca-rblsj node/ created Nov 08 03:44:24.428 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-rblsj Nov 08 03:44:24.438 I ns/openshift-image-registry pod/node-ca-rblsj Successfully assigned openshift-image-registry/node-ca-rblsj to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:44:24.518 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available. Nov 08 03:44:25.215 I ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:cdabca18ca3136518c5c0f66c0ed643bd45e356fe10af7555e58a5697b942953" already present on machine Nov 08 03:44:25.356 I ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 Created container machine-config-daemon Nov 08 03:44:25.388 I ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 Started container machine-config-daemon Nov 08 03:44:25.397 I ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" already present on machine Nov 08 03:44:25.570 I ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 Created container oauth-proxy Nov 08 03:44:25.602 I ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 Started container oauth-proxy Nov 08 03:44:32.845 I ns/openshift-image-registry pod/node-ca-rblsj Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:f6eb3311f979eda2afbf98b9b8240237215076246bf2ea5d4a35f62aa09ff192" already present on machine Nov 08 03:44:32.964 I ns/openshift-dns pod/dns-default-zb2xn Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:9a7e8297f7b70ee3a11fcbe4a78c59a5861e1afda5657a7437de6934bdc2458e" already present on machine Nov 08 03:44:33.007 I ns/openshift-image-registry pod/node-ca-rblsj Created container node-ca Nov 08 03:44:33.059 I ns/openshift-image-registry pod/node-ca-rblsj Started container node-ca Nov 08 03:44:33.166 I ns/openshift-dns pod/dns-default-zb2xn Created container dns Nov 08 03:44:33.196 I ns/openshift-dns pod/dns-default-zb2xn Started container dns Nov 08 03:44:33.202 I ns/openshift-dns pod/dns-default-zb2xn Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:37811ccc702371cbc91e86935f03b5d55040835fb8d653d211410587385034f8" already present on machine Nov 08 03:44:33.348 I ns/openshift-dns pod/dns-default-zb2xn Created container dns-node-resolver Nov 08 03:44:33.379 I ns/openshift-dns pod/dns-default-zb2xn Started container dns-node-resolver Nov 08 03:44:43.583 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal Nov 08 03:46:20.190 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (12 times) Nov 08 03:46:20.788 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (14 times) Nov 08 03:47:31.158 I ns/openshift-dns pod/dns-default-zb2xn Marking for deletion Pod openshift-dns/dns-default-zb2xn Nov 08 03:47:31.158 W ns/openshift-dns pod/dns-default-zb2xn node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:47:31.162 W ns/openshift-image-registry pod/node-ca-rblsj node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:47:31.163 W ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 600s Nov 08 03:47:31.187 I ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-fvgh7 Nov 08 03:47:31.187 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-fvgh7 Nov 08 03:47:31.187 I ns/openshift-dns pod/dns-default-zb2xn Stopping container dns-node-resolver Nov 08 03:47:31.202 I ns/openshift-image-registry daemonset/node-ca Deleted pod: node-ca-rblsj Nov 08 03:47:31.202 I ns/openshift-dns pod/dns-default-zb2xn Stopping container dns Nov 08 03:47:31.216 I ns/openshift-image-registry pod/node-ca-rblsj Marking for deletion Pod openshift-image-registry/node-ca-rblsj Nov 08 03:47:31.218 I ns/openshift-image-registry pod/node-ca-rblsj Stopping container node-ca Nov 08 03:47:31.230 I ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 Stopping container oauth-proxy Nov 08 03:47:31.238 I ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 Stopping container machine-config-daemon Nov 08 03:47:32.008 E ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 143 (Error): Nov 08 03:47:44.327 W ns/openshift-dns pod/dns-default-zb2xn node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:47:44.357 W ns/openshift-machine-config-operator pod/machine-config-daemon-fvgh7 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:47:44.384 W ns/openshift-image-registry pod/node-ca-rblsj node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:48:04.918 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (5 times) Nov 08 03:48:05.517 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (4 times) Nov 08 03:48:36.187 I ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p node/ created Nov 08 03:48:36.195 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-bbl6p Nov 08 03:48:36.213 I ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p Successfully assigned openshift-machine-config-operator/machine-config-daemon-bbl6p to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:48:36.225 I ns/openshift-dns pod/dns-default-5jbdk node/ created Nov 08 03:48:36.226 I ns/openshift-image-registry pod/node-ca-plt5l node/ created Nov 08 03:48:36.236 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-plt5l Nov 08 03:48:36.255 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-5jbdk Nov 08 03:48:36.265 I ns/openshift-dns pod/dns-default-5jbdk Successfully assigned openshift-dns/dns-default-5jbdk to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:48:36.270 I ns/openshift-image-registry pod/node-ca-plt5l Successfully assigned openshift-image-registry/node-ca-plt5l to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:48:36.389 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available. Nov 08 03:48:36.955 I ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:cdabca18ca3136518c5c0f66c0ed643bd45e356fe10af7555e58a5697b942953" already present on machine Nov 08 03:48:37.139 I ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p Created container machine-config-daemon Nov 08 03:48:37.179 I ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p Started container machine-config-daemon Nov 08 03:48:37.197 I ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" already present on machine Nov 08 03:48:37.336 I ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p Created container oauth-proxy Nov 08 03:48:37.369 I ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p Started container oauth-proxy Nov 08 03:48:40.628 I ns/kube-system pod/pod0-system-node-critical node/ created Nov 08 03:48:40.636 I ns/kube-system pod/pod1-system-cluster-critical node/ created Nov 08 03:48:40.646 I ns/kube-system pod/pod0-system-node-critical Successfully assigned kube-system/pod0-system-node-critical to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:48:40.649 W ns/kube-system pod/pod1-system-cluster-critical node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 03:48:40.650 I ns/kube-system pod/pod1-system-cluster-critical Successfully assigned kube-system/pod1-system-cluster-critical to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:48:40.655 W ns/kube-system pod/pod1-system-cluster-critical node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:48:40.663 W ns/kube-system pod/pod0-system-node-critical node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 03:48:40.670 W ns/kube-system pod/pod0-system-node-critical node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:48:44.349 I ns/openshift-image-registry pod/node-ca-plt5l Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:f6eb3311f979eda2afbf98b9b8240237215076246bf2ea5d4a35f62aa09ff192" already present on machine Nov 08 03:48:44.500 I ns/openshift-image-registry pod/node-ca-plt5l Created container node-ca Nov 08 03:48:44.532 I ns/openshift-image-registry pod/node-ca-plt5l Started container node-ca Nov 08 03:48:44.722 I ns/openshift-dns pod/dns-default-5jbdk Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:9a7e8297f7b70ee3a11fcbe4a78c59a5861e1afda5657a7437de6934bdc2458e" already present on machine Nov 08 03:48:44.892 I ns/openshift-dns pod/dns-default-5jbdk Created container dns Nov 08 03:48:44.921 I ns/openshift-dns pod/dns-default-5jbdk Started container dns Nov 08 03:48:44.928 I ns/openshift-dns pod/dns-default-5jbdk Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:37811ccc702371cbc91e86935f03b5d55040835fb8d653d211410587385034f8" already present on machine Nov 08 03:48:45.064 I ns/openshift-dns pod/dns-default-5jbdk Created container dns-node-resolver Nov 08 03:48:45.095 I ns/openshift-dns pod/dns-default-5jbdk Started container dns-node-resolver Nov 08 03:48:56.637 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal Nov 08 03:49:45.511 I ns/openshift-dns pod/dns-default-5jbdk Marking for deletion Pod openshift-dns/dns-default-5jbdk Nov 08 03:49:45.521 W ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 600s Nov 08 03:49:45.521 I ns/openshift-image-registry pod/node-ca-plt5l Marking for deletion Pod openshift-image-registry/node-ca-plt5l Nov 08 03:49:45.521 W ns/openshift-image-registry pod/node-ca-plt5l node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:49:45.525 W ns/openshift-dns pod/dns-default-5jbdk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 03:49:45.530 I ns/openshift-dns daemonset/dns-default Deleted pod: dns-default-5jbdk Nov 08 03:49:45.534 I ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p Stopping container oauth-proxy Nov 08 03:49:45.535 I ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-bbl6p Nov 08 03:49:45.539 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-bbl6p Nov 08 03:49:45.557 I ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p Stopping container machine-config-daemon Nov 08 03:49:45.573 I ns/openshift-image-registry pod/node-ca-plt5l Stopping container node-ca Nov 08 03:49:45.584 I ns/openshift-dns pod/dns-default-5jbdk Stopping container dns Nov 08 03:49:45.591 I ns/openshift-dns pod/dns-default-5jbdk Stopping container dns-node-resolver Nov 08 03:49:46.287 E ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 143 (Error): Nov 08 03:49:47.300 W ns/openshift-dns pod/dns-default-5jbdk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 03:49:47.300 W ns/openshift-dns pod/dns-default-5jbdk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns container stopped being ready Nov 08 03:49:47.300 W ns/openshift-dns pod/dns-default-5jbdk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns-node-resolver container stopped being ready Nov 08 03:49:47.314 E ns/openshift-dns pod/dns-default-5jbdk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns-node-resolver container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:49:47.314 E ns/openshift-dns pod/dns-default-5jbdk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal container=dns container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated Nov 08 03:49:54.018 W ns/openshift-dns pod/dns-default-5jbdk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 03:49:54.331 W ns/openshift-machine-config-operator pod/machine-config-daemon-bbl6p node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:49:54.363 W ns/openshift-dns pod/dns-default-5jbdk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:49:54.390 W ns/openshift-image-registry pod/node-ca-plt5l node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 03:49:54.821 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (4 times) Nov 08 03:49:55.816 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (16 times) Nov 08 03:50:43.681 W ns/kube-system pod/pod0-system-node-critical Unable to attach or mount volumes: unmounted volumes=[default-token-xxx76], unattached volumes=[default-token-xxx76]: timed out waiting for the condition Nov 08 03:50:43.687 W ns/kube-system pod/pod1-system-cluster-critical Unable to attach or mount volumes: unmounted volumes=[default-token-xxx76], unattached volumes=[default-token-xxx76]: timed out waiting for the condition Nov 08 03:50:50.534 I ns/openshift-dns pod/dns-default-9df75 node/ created Nov 08 03:50:50.546 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-9df75 Nov 08 03:50:50.560 I ns/openshift-dns pod/dns-default-9df75 Successfully assigned openshift-dns/dns-default-9df75 to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:50:50.564 I ns/openshift-image-registry pod/node-ca-nzk6g node/ created Nov 08 03:50:50.569 I ns/openshift-machine-config-operator pod/machine-config-daemon-rn2lz node/ created Nov 08 03:50:50.574 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-nzk6g Nov 08 03:50:50.588 I ns/openshift-image-registry pod/node-ca-nzk6g Successfully assigned openshift-image-registry/node-ca-nzk6g to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:50:50.588 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-rn2lz Nov 08 03:50:50.588 I ns/openshift-machine-config-operator pod/machine-config-daemon-rn2lz Successfully assigned openshift-machine-config-operator/machine-config-daemon-rn2lz to ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Nov 08 03:50:50.681 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available. Nov 08 03:50:51.397 I ns/openshift-machine-config-operator pod/machine-config-daemon-rn2lz Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:cdabca18ca3136518c5c0f66c0ed643bd45e356fe10af7555e58a5697b942953" already present on machine Nov 08 03:50:51.540 I ns/openshift-machine-config-operator pod/machine-config-daemon-rn2lz Created container machine-config-daemon Nov 08 03:50:51.578 I ns/openshift-machine-config-operator pod/machine-config-daemon-rn2lz Started container machine-config-daemon Nov 08 03:50:51.584 I ns/openshift-machine-config-operator pod/machine-config-daemon-rn2lz Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" already present on machine Nov 08 03:50:51.771 I ns/openshift-machine-config-operator pod/machine-config-daemon-rn2lz Created container oauth-proxy Nov 08 03:50:51.804 I ns/openshift-machine-config-operator pod/machine-config-daemon-rn2lz Started container oauth-proxy Nov 08 03:50:58.097 I ns/openshift-dns pod/dns-default-9df75 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:9a7e8297f7b70ee3a11fcbe4a78c59a5861e1afda5657a7437de6934bdc2458e" already present on machine Nov 08 03:50:58.273 I ns/openshift-dns pod/dns-default-9df75 Created container dns Nov 08 03:50:58.307 I ns/openshift-dns pod/dns-default-9df75 Started container dns Nov 08 03:50:58.312 I ns/openshift-dns pod/dns-default-9df75 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:37811ccc702371cbc91e86935f03b5d55040835fb8d653d211410587385034f8" already present on machine Nov 08 03:50:58.481 I ns/openshift-dns pod/dns-default-9df75 Created container dns-node-resolver Nov 08 03:50:58.513 I ns/openshift-dns pod/dns-default-9df75 Started container dns-node-resolver Nov 08 03:50:59.106 I ns/openshift-image-registry pod/node-ca-nzk6g Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:f6eb3311f979eda2afbf98b9b8240237215076246bf2ea5d4a35f62aa09ff192" already present on machine Nov 08 03:50:59.262 I ns/openshift-image-registry pod/node-ca-nzk6g Created container node-ca Nov 08 03:50:59.296 I ns/openshift-image-registry pod/node-ca-nzk6g Started container node-ca Nov 08 03:51:08.187 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal Nov 08 03:56:20.193 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (4 times) Nov 08 03:56:21.186 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (3 times) Nov 08 03:58:04.921 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (7 times) Nov 08 03:58:05.515 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (20 times) Nov 08 03:58:27.971 W ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m requeue in: 20s Nov 08 03:58:28.623 W ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m requeue in: 20s Nov 08 03:58:30.857 W ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 requeue in: 20s Nov 08 03:58:33.369 W ns/openshift-machine-api machine/ci-op--b6wsl-w-d-wmh8t requeue in: 20s Nov 08 03:58:34.023 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Updated Machine ci-op--b6wsl-w-b-2545m Nov 08 03:58:34.566 W ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 requeue in: 20s Nov 08 03:58:35.165 W ns/openshift-machine-api machine/ci-op--b6wsl-w-d-wmh8t requeue in: 20s Nov 08 03:58:35.877 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Updated Machine ci-op--b6wsl-w-b-2545m (2 times) Nov 08 03:58:36.419 W ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 requeue in: 20s (2 times) Nov 08 03:58:37.080 W ns/openshift-machine-api machine/ci-op--b6wsl-w-d-wmh8t requeue in: 20s (2 times) Nov 08 03:58:37.736 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Updated Machine ci-op--b6wsl-w-b-2545m (3 times) Nov 08 03:58:38.317 W ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 requeue in: 20s (3 times) Nov 08 03:58:38.950 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-wmh8t Updated Machine ci-op--b6wsl-w-d-wmh8t Nov 08 03:58:39.557 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-wmh8t Updated Machine ci-op--b6wsl-w-d-wmh8t (2 times) Nov 08 03:58:40.218 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-wmh8t Updated Machine ci-op--b6wsl-w-d-wmh8t (3 times) Nov 08 03:58:48.589 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Updated Machine ci-op--b6wsl-w-b-2545m (4 times) Nov 08 03:58:51.404 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Updated Machine ci-op--b6wsl-w-c-fqxt4 Nov 08 03:58:51.999 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Updated Machine ci-op--b6wsl-w-c-fqxt4 (2 times) Nov 08 03:58:52.545 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Updated Machine ci-op--b6wsl-w-c-fqxt4 (3 times) Nov 08 03:58:53.961 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-wmh8t Updated Machine ci-op--b6wsl-w-d-wmh8t (4 times) Nov 08 03:59:54.824 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (5 times) Nov 08 03:59:55.815 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (6 times) Nov 08 04:04:52.159 I node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal status is now: NodeHasSufficientMemory (8 times) Nov 08 04:04:52.166 W node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal condition NetworkUnavailable changed Nov 08 04:04:52.180 I node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal status is now: NodeHasNoDiskPressure (8 times) Nov 08 04:04:52.199 I ns/openshift-sdn pod/sdn-b692c node/ created Nov 08 04:04:52.199 I ns/openshift-multus pod/multus-d2p7l node/ created Nov 08 04:04:52.236 I ns/openshift-sdn daemonset/sdn Created pod: sdn-b692c Nov 08 04:04:52.244 W clusteroperator/network changed Progressing to True: Deploying: DaemonSet "openshift-sdn/sdn" update is rolling out (6 out of 7 updated) Nov 08 04:04:52.247 I ns/openshift-multus daemonset/multus Created pod: multus-d2p7l Nov 08 04:04:52.260 I ns/openshift-multus pod/multus-d2p7l Successfully assigned openshift-multus/multus-d2p7l to ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Nov 08 04:04:52.266 I ns/openshift-sdn pod/sdn-b692c Successfully assigned openshift-sdn/sdn-b692c to ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Nov 08 04:04:52.320 I ns/openshift-cluster-node-tuning-operator pod/tuned-6w9pb node/ created Nov 08 04:04:52.331 I ns/openshift-cluster-node-tuning-operator daemonset/tuned Created pod: tuned-6w9pb Nov 08 04:04:52.345 I ns/openshift-cluster-node-tuning-operator pod/tuned-6w9pb Successfully assigned openshift-cluster-node-tuning-operator/tuned-6w9pb to ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Nov 08 04:04:52.350 I ns/openshift-sdn pod/ovs-tk9s2 node/ created Nov 08 04:04:52.351 I ns/openshift-monitoring pod/node-exporter-dgbkw node/ created Nov 08 04:04:52.363 I ns/openshift-sdn daemonset/ovs Created pod: ovs-tk9s2 Nov 08 04:04:52.378 I ns/openshift-sdn pod/ovs-tk9s2 Successfully assigned openshift-sdn/ovs-tk9s2 to ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Nov 08 04:04:52.378 I ns/openshift-monitoring daemonset/node-exporter Created pod: node-exporter-dgbkw Nov 08 04:04:52.381 I ns/openshift-monitoring pod/node-exporter-dgbkw Successfully assigned openshift-monitoring/node-exporter-dgbkw to ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Nov 08 04:04:52.963 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Updated Machine ci-op--b6wsl-w-b-2545m (5 times) Nov 08 04:04:53.925 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Updated Machine ci-op--b6wsl-w-b-2545m (6 times) Nov 08 04:04:54.018 - 119s W node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal node is not ready Nov 08 04:04:54.120 I node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal event: Registered Node ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal in Controller Nov 08 04:05:02.763 I node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal status is now: NodeHasSufficientMemory (8 times) Nov 08 04:05:02.774 I node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal status is now: NodeHasNoDiskPressure (8 times) Nov 08 04:05:02.802 W node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal condition NetworkUnavailable changed Nov 08 04:05:02.809 I ns/openshift-cluster-node-tuning-operator pod/tuned-tc25s node/ created Nov 08 04:05:02.824 I ns/openshift-cluster-node-tuning-operator daemonset/tuned Created pod: tuned-tc25s Nov 08 04:05:02.832 I ns/openshift-cluster-node-tuning-operator pod/tuned-tc25s Successfully assigned openshift-cluster-node-tuning-operator/tuned-tc25s to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:05:02.835 I ns/openshift-sdn pod/ovs-n87kk node/ created Nov 08 04:05:02.836 I ns/openshift-monitoring pod/node-exporter-95ht6 node/ created Nov 08 04:05:02.851 I ns/openshift-sdn daemonset/ovs Created pod: ovs-n87kk Nov 08 04:05:02.864 I ns/openshift-sdn pod/sdn-59s2r node/ created Nov 08 04:05:02.865 I ns/openshift-monitoring daemonset/node-exporter Created pod: node-exporter-95ht6 Nov 08 04:05:02.874 I ns/openshift-sdn pod/ovs-n87kk Successfully assigned openshift-sdn/ovs-n87kk to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:05:02.877 I ns/openshift-monitoring pod/node-exporter-95ht6 Successfully assigned openshift-monitoring/node-exporter-95ht6 to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:05:02.878 I ns/openshift-multus pod/multus-5tpc7 node/ created Nov 08 04:05:02.880 I ns/openshift-sdn daemonset/sdn Created pod: sdn-59s2r Nov 08 04:05:02.893 I ns/openshift-multus daemonset/multus Created pod: multus-5tpc7 Nov 08 04:05:02.897 I ns/openshift-sdn pod/sdn-59s2r Successfully assigned openshift-sdn/sdn-59s2r to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:05:02.923 I ns/openshift-multus pod/multus-5tpc7 Successfully assigned openshift-multus/multus-5tpc7 to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:05:03.486 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-wmh8t Updated Machine ci-op--b6wsl-w-d-wmh8t (5 times) Nov 08 04:05:04.119 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-wmh8t Updated Machine ci-op--b6wsl-w-d-wmh8t (6 times) Nov 08 04:05:04.122 I node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal event: Registered Node ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal in Controller Nov 08 04:05:04.153 I ns/openshift-sdn pod/ovs-tk9s2 Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a60705c375cf1796e81cc7a5d459e5faa1de63b24e624ab87aa3fea6feb3348" Nov 08 04:05:04.177 I ns/openshift-cluster-node-tuning-operator pod/tuned-6w9pb Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a09dc9c52c07e6cee4eb210a0b468d413497f3e16fbeb8d4146e5b84ffef2dc" Nov 08 04:05:04.213 I ns/openshift-multus pod/multus-d2p7l Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:04.284 I ns/openshift-sdn pod/sdn-b692c Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:04.347 I ns/openshift-monitoring pod/node-exporter-dgbkw Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:195b73ffa38c24c558372c7be3e5fc4633a51b229d901dd0c060045143e80a8d" Nov 08 04:05:09.018 - 30s W node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal node is not ready Nov 08 04:05:09.064 I node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal status is now: NodeHasSufficientMemory (8 times) Nov 08 04:05:09.077 I ns/openshift-sdn pod/sdn-hsd5p node/ created Nov 08 04:05:09.083 I ns/openshift-sdn daemonset/sdn Created pod: sdn-hsd5p Nov 08 04:05:09.088 I ns/openshift-multus pod/multus-sk2hm node/ created Nov 08 04:05:09.093 I node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal status is now: NodeHasNoDiskPressure (8 times) Nov 08 04:05:09.099 I ns/openshift-multus daemonset/multus Created pod: multus-sk2hm Nov 08 04:05:09.106 I ns/openshift-multus pod/multus-sk2hm Successfully assigned openshift-multus/multus-sk2hm to ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Nov 08 04:05:09.108 W node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal condition NetworkUnavailable changed Nov 08 04:05:09.117 I ns/openshift-sdn pod/sdn-hsd5p Successfully assigned openshift-sdn/sdn-hsd5p to ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Nov 08 04:05:09.125 I node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal event: Registered Node ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal in Controller Nov 08 04:05:09.154 I ns/openshift-cluster-node-tuning-operator pod/tuned-22cpw node/ created Nov 08 04:05:09.166 I ns/openshift-cluster-node-tuning-operator daemonset/tuned Created pod: tuned-22cpw Nov 08 04:05:09.181 I ns/openshift-sdn pod/ovs-8475f node/ created Nov 08 04:05:09.189 I ns/openshift-cluster-node-tuning-operator pod/tuned-22cpw Successfully assigned openshift-cluster-node-tuning-operator/tuned-22cpw to ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Nov 08 04:05:09.197 I ns/openshift-sdn daemonset/ovs Created pod: ovs-8475f Nov 08 04:05:09.213 I ns/openshift-sdn pod/ovs-8475f Successfully assigned openshift-sdn/ovs-8475f to ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Nov 08 04:05:09.219 I ns/openshift-monitoring pod/node-exporter-8t6jz node/ created Nov 08 04:05:09.230 I ns/openshift-monitoring daemonset/node-exporter Created pod: node-exporter-8t6jz Nov 08 04:05:09.239 I ns/openshift-monitoring pod/node-exporter-8t6jz Successfully assigned openshift-monitoring/node-exporter-8t6jz to ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Nov 08 04:05:09.689 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Updated Machine ci-op--b6wsl-w-c-fqxt4 (4 times) Nov 08 04:05:10.240 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Updated Machine ci-op--b6wsl-w-c-fqxt4 (5 times) Nov 08 04:05:14.694 I ns/openshift-sdn pod/sdn-59s2r Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:14.732 I ns/openshift-monitoring pod/node-exporter-95ht6 Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:195b73ffa38c24c558372c7be3e5fc4633a51b229d901dd0c060045143e80a8d" Nov 08 04:05:14.755 I ns/openshift-cluster-node-tuning-operator pod/tuned-tc25s Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a09dc9c52c07e6cee4eb210a0b468d413497f3e16fbeb8d4146e5b84ffef2dc" Nov 08 04:05:14.773 I ns/openshift-sdn pod/ovs-n87kk Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a60705c375cf1796e81cc7a5d459e5faa1de63b24e624ab87aa3fea6feb3348" Nov 08 04:05:14.894 I ns/openshift-multus pod/multus-5tpc7 Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:19.245 I ns/openshift-sdn pod/ovs-tk9s2 Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a60705c375cf1796e81cc7a5d459e5faa1de63b24e624ab87aa3fea6feb3348" Nov 08 04:05:20.972 I ns/openshift-sdn pod/ovs-8475f Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a60705c375cf1796e81cc7a5d459e5faa1de63b24e624ab87aa3fea6feb3348" Nov 08 04:05:20.977 I ns/openshift-sdn pod/sdn-hsd5p Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:20.981 I ns/openshift-monitoring pod/node-exporter-8t6jz Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:195b73ffa38c24c558372c7be3e5fc4633a51b229d901dd0c060045143e80a8d" Nov 08 04:05:21.096 I ns/openshift-multus pod/multus-sk2hm Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:21.133 I ns/openshift-cluster-node-tuning-operator pod/tuned-22cpw Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a09dc9c52c07e6cee4eb210a0b468d413497f3e16fbeb8d4146e5b84ffef2dc" Nov 08 04:05:21.377 I ns/openshift-cluster-node-tuning-operator pod/tuned-6w9pb Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a09dc9c52c07e6cee4eb210a0b468d413497f3e16fbeb8d4146e5b84ffef2dc" Nov 08 04:05:21.398 I ns/openshift-sdn pod/sdn-b692c Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:21.407 I ns/openshift-monitoring pod/node-exporter-dgbkw Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:195b73ffa38c24c558372c7be3e5fc4633a51b229d901dd0c060045143e80a8d" Nov 08 04:05:21.428 I ns/openshift-multus pod/multus-d2p7l Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:21.550 I ns/openshift-sdn pod/ovs-tk9s2 Created container openvswitch Nov 08 04:05:21.598 I ns/openshift-sdn pod/ovs-tk9s2 Started container openvswitch Nov 08 04:05:21.645 I ns/openshift-cluster-node-tuning-operator pod/tuned-6w9pb Created container tuned Nov 08 04:05:21.707 I ns/openshift-cluster-node-tuning-operator pod/tuned-6w9pb Started container tuned Nov 08 04:05:21.715 I ns/openshift-sdn pod/sdn-b692c Created container install-cni-plugins Nov 08 04:05:21.735 I ns/openshift-monitoring pod/node-exporter-dgbkw Created container node-exporter Nov 08 04:05:21.754 I ns/openshift-sdn pod/sdn-b692c Started container install-cni-plugins Nov 08 04:05:21.776 I ns/openshift-multus pod/multus-d2p7l Created container cni-plugins Nov 08 04:05:21.977 I ns/openshift-monitoring pod/node-exporter-dgbkw Started container node-exporter Nov 08 04:05:22.178 I ns/openshift-monitoring pod/node-exporter-dgbkw Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:93a0c6d5321fe0afcc6d59b04b7110f17418390e71d2ba2320b3b2a71b632b56" Nov 08 04:05:22.378 I ns/openshift-multus pod/multus-d2p7l Started container cni-plugins Nov 08 04:05:22.578 I ns/openshift-multus pod/multus-d2p7l Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:a776ee5f7e0df7d6864ec9f6fb2c12475c61cc329ae595377eeda78be0b39160" Nov 08 04:05:22.780 I ns/openshift-sdn pod/sdn-b692c Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a60705c375cf1796e81cc7a5d459e5faa1de63b24e624ab87aa3fea6feb3348" already present on machine Nov 08 04:05:22.977 I ns/openshift-sdn pod/sdn-b692c Created container sdn Nov 08 04:05:23.178 I ns/openshift-sdn pod/sdn-b692c Started container sdn Nov 08 04:05:23.856 I node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal openshift-sdn done initializing node networking. Nov 08 04:05:24.018 - 14s W node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal node is not ready Nov 08 04:05:24.024 I ns/openshift-monitoring pod/node-exporter-dgbkw Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:93a0c6d5321fe0afcc6d59b04b7110f17418390e71d2ba2320b3b2a71b632b56" Nov 08 04:05:24.162 I ns/openshift-monitoring pod/node-exporter-dgbkw Created container kube-rbac-proxy Nov 08 04:05:24.187 I ns/openshift-monitoring pod/node-exporter-dgbkw Started container kube-rbac-proxy Nov 08 04:05:31.850 I ns/openshift-sdn pod/ovs-n87kk Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a60705c375cf1796e81cc7a5d459e5faa1de63b24e624ab87aa3fea6feb3348" Nov 08 04:05:31.992 I ns/openshift-sdn pod/sdn-59s2r Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:31.999 I ns/openshift-monitoring pod/node-exporter-95ht6 Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:195b73ffa38c24c558372c7be3e5fc4633a51b229d901dd0c060045143e80a8d" Nov 08 04:05:32.003 I ns/openshift-multus pod/multus-5tpc7 Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:32.009 I ns/openshift-cluster-node-tuning-operator pod/tuned-tc25s Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a09dc9c52c07e6cee4eb210a0b468d413497f3e16fbeb8d4146e5b84ffef2dc" Nov 08 04:05:32.215 I ns/openshift-sdn pod/ovs-n87kk Created container openvswitch Nov 08 04:05:32.288 I ns/openshift-monitoring pod/node-exporter-95ht6 Created container node-exporter Nov 08 04:05:32.301 I ns/openshift-sdn pod/ovs-n87kk Started container openvswitch Nov 08 04:05:32.328 I ns/openshift-sdn pod/sdn-59s2r Created container install-cni-plugins Nov 08 04:05:32.333 I ns/openshift-monitoring pod/node-exporter-95ht6 Started container node-exporter Nov 08 04:05:32.338 I ns/openshift-monitoring pod/node-exporter-95ht6 Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:93a0c6d5321fe0afcc6d59b04b7110f17418390e71d2ba2320b3b2a71b632b56" Nov 08 04:05:32.343 I ns/openshift-cluster-node-tuning-operator pod/tuned-tc25s Created container tuned Nov 08 04:05:32.449 I ns/openshift-multus pod/multus-5tpc7 Created container cni-plugins Nov 08 04:05:32.649 I ns/openshift-cluster-node-tuning-operator pod/tuned-tc25s Started container tuned Nov 08 04:05:32.849 I ns/openshift-sdn pod/sdn-59s2r Started container install-cni-plugins Nov 08 04:05:33.020 I ns/openshift-multus pod/multus-d2p7l Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:a776ee5f7e0df7d6864ec9f6fb2c12475c61cc329ae595377eeda78be0b39160" Nov 08 04:05:33.049 I ns/openshift-multus pod/multus-5tpc7 Started container cni-plugins Nov 08 04:05:33.148 I ns/openshift-multus pod/multus-d2p7l Created container kube-multus Nov 08 04:05:33.177 I ns/openshift-multus pod/multus-d2p7l Started container kube-multus Nov 08 04:05:33.248 I ns/openshift-sdn pod/sdn-59s2r Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a60705c375cf1796e81cc7a5d459e5faa1de63b24e624ab87aa3fea6feb3348" already present on machine Nov 08 04:05:33.449 I ns/openshift-multus pod/multus-5tpc7 Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:a776ee5f7e0df7d6864ec9f6fb2c12475c61cc329ae595377eeda78be0b39160" Nov 08 04:05:33.649 I ns/openshift-sdn pod/sdn-59s2r Created container sdn Nov 08 04:05:33.850 I ns/openshift-sdn pod/sdn-59s2r Started container sdn Nov 08 04:05:34.584 I node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal openshift-sdn done initializing node networking. Nov 08 04:05:34.971 I ns/openshift-monitoring pod/node-exporter-95ht6 Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:93a0c6d5321fe0afcc6d59b04b7110f17418390e71d2ba2320b3b2a71b632b56" Nov 08 04:05:35.143 I ns/openshift-monitoring pod/node-exporter-95ht6 Created container kube-rbac-proxy Nov 08 04:05:35.188 I ns/openshift-monitoring pod/node-exporter-95ht6 Started container kube-rbac-proxy Nov 08 04:05:37.411 I ns/openshift-sdn pod/ovs-8475f Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a60705c375cf1796e81cc7a5d459e5faa1de63b24e624ab87aa3fea6feb3348" Nov 08 04:05:37.869 I ns/openshift-multus pod/multus-5tpc7 Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:a776ee5f7e0df7d6864ec9f6fb2c12475c61cc329ae595377eeda78be0b39160" Nov 08 04:05:38.018 I ns/openshift-multus pod/multus-5tpc7 Created container kube-multus Nov 08 04:05:38.049 I ns/openshift-multus pod/multus-5tpc7 Started container kube-multus Nov 08 04:05:38.575 I ns/openshift-monitoring pod/node-exporter-8t6jz Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:195b73ffa38c24c558372c7be3e5fc4633a51b229d901dd0c060045143e80a8d" Nov 08 04:05:38.595 I ns/openshift-multus pod/multus-sk2hm Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:38.602 I ns/openshift-sdn pod/sdn-hsd5p Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:222704af43f638d68cf1c99fb3281bcca7ea299c95a4202ad1980c0326b35a90" Nov 08 04:05:38.606 I ns/openshift-cluster-node-tuning-operator pod/tuned-22cpw Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a09dc9c52c07e6cee4eb210a0b468d413497f3e16fbeb8d4146e5b84ffef2dc" Nov 08 04:05:38.783 I ns/openshift-sdn pod/ovs-8475f Created container openvswitch Nov 08 04:05:38.869 I ns/openshift-sdn pod/ovs-8475f Started container openvswitch Nov 08 04:05:38.881 I ns/openshift-cluster-node-tuning-operator pod/tuned-22cpw Created container tuned Nov 08 04:05:38.911 I ns/openshift-monitoring pod/node-exporter-8t6jz Created container node-exporter Nov 08 04:05:38.916 I ns/openshift-sdn pod/sdn-hsd5p Created container install-cni-plugins Nov 08 04:05:38.950 I ns/openshift-cluster-node-tuning-operator pod/tuned-22cpw Started container tuned Nov 08 04:05:38.977 I ns/openshift-multus pod/multus-sk2hm Created container cni-plugins Nov 08 04:05:38.983 I ns/openshift-monitoring pod/node-exporter-8t6jz Started container node-exporter Nov 08 04:05:39.176 I ns/openshift-monitoring pod/node-exporter-8t6jz Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:93a0c6d5321fe0afcc6d59b04b7110f17418390e71d2ba2320b3b2a71b632b56" Nov 08 04:05:39.375 I ns/openshift-sdn pod/sdn-hsd5p Started container install-cni-plugins Nov 08 04:05:39.575 I ns/openshift-multus pod/multus-sk2hm Started container cni-plugins Nov 08 04:05:40.004 I ns/openshift-multus pod/multus-sk2hm Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:a776ee5f7e0df7d6864ec9f6fb2c12475c61cc329ae595377eeda78be0b39160" Nov 08 04:05:40.012 I ns/openshift-sdn pod/sdn-hsd5p Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:0a60705c375cf1796e81cc7a5d459e5faa1de63b24e624ab87aa3fea6feb3348" already present on machine Nov 08 04:05:40.175 I ns/openshift-sdn pod/sdn-hsd5p Created container sdn Nov 08 04:05:40.376 I ns/openshift-sdn pod/sdn-hsd5p Started container sdn Nov 08 04:05:41.250 I ns/openshift-monitoring pod/node-exporter-8t6jz Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:93a0c6d5321fe0afcc6d59b04b7110f17418390e71d2ba2320b3b2a71b632b56" Nov 08 04:05:41.425 I node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal openshift-sdn done initializing node networking. Nov 08 04:05:41.486 I ns/openshift-monitoring pod/node-exporter-8t6jz Created container kube-rbac-proxy Nov 08 04:05:41.528 I ns/openshift-monitoring pod/node-exporter-8t6jz Started container kube-rbac-proxy Nov 08 04:05:42.221 W node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal condition Ready changed Nov 08 04:05:42.254 I ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk node/ created Nov 08 04:05:42.260 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-jxvsk Nov 08 04:05:42.276 I ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk Successfully assigned openshift-machine-config-operator/machine-config-daemon-jxvsk to ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Nov 08 04:05:42.280 I ns/openshift-image-registry pod/node-ca-cbzg8 node/ created Nov 08 04:05:42.281 I ns/openshift-dns pod/dns-default-k2nm7 node/ created Nov 08 04:05:42.295 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-cbzg8 Nov 08 04:05:42.312 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-k2nm7 Nov 08 04:05:42.315 I ns/openshift-image-registry pod/node-ca-cbzg8 Successfully assigned openshift-image-registry/node-ca-cbzg8 to ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Nov 08 04:05:42.326 I ns/openshift-dns pod/dns-default-k2nm7 Successfully assigned openshift-dns/dns-default-k2nm7 to ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Nov 08 04:05:42.425 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available. Nov 08 04:05:42.848 W node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal condition Ready changed Nov 08 04:05:42.871 I ns/openshift-dns pod/dns-default-qcntr node/ created Nov 08 04:05:42.890 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-qcntr Nov 08 04:05:42.907 I ns/openshift-dns pod/dns-default-qcntr Successfully assigned openshift-dns/dns-default-qcntr to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:05:42.912 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr node/ created Nov 08 04:05:42.914 W ns/openshift-dns endpoints/dns-default Failed to update endpoint openshift-dns/dns-default: Operation cannot be fulfilled on endpoints "dns-default": the object has been modified; please apply your changes to the latest version and try again Nov 08 04:05:42.930 I ns/openshift-image-registry pod/node-ca-txp8c node/ created Nov 08 04:05:42.930 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-dktfr Nov 08 04:05:42.941 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-txp8c Nov 08 04:05:42.946 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Successfully assigned openshift-machine-config-operator/machine-config-daemon-dktfr to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:05:42.982 I ns/openshift-image-registry pod/node-ca-txp8c Successfully assigned openshift-image-registry/node-ca-txp8c to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:05:43.001 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Updated Machine ci-op--b6wsl-w-b-2545m (7 times) Nov 08 04:05:43.042 E clusteroperator/dns changed Degraded to True: NotAllDNSesAvailable: Not all desired DNS DaemonSets available Nov 08 04:05:43.076 I ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:cdabca18ca3136518c5c0f66c0ed643bd45e356fe10af7555e58a5697b942953" Nov 08 04:05:43.616 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:cdabca18ca3136518c5c0f66c0ed643bd45e356fe10af7555e58a5697b942953" Nov 08 04:05:43.653 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-wmh8t Updated Machine ci-op--b6wsl-w-d-wmh8t (7 times) Nov 08 04:05:44.683 I ns/openshift-multus pod/multus-sk2hm Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:a776ee5f7e0df7d6864ec9f6fb2c12475c61cc329ae595377eeda78be0b39160" Nov 08 04:05:44.835 I ns/openshift-multus pod/multus-sk2hm Created container kube-multus Nov 08 04:05:44.870 I ns/openshift-multus pod/multus-sk2hm Started container kube-multus Nov 08 04:05:49.059 I ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:cdabca18ca3136518c5c0f66c0ed643bd45e356fe10af7555e58a5697b942953" Nov 08 04:05:49.196 I ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk Created container machine-config-daemon Nov 08 04:05:49.224 I ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk Started container machine-config-daemon Nov 08 04:05:49.229 I ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" Nov 08 04:05:49.344 W node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal condition Ready changed Nov 08 04:05:49.373 I ns/openshift-machine-config-operator pod/machine-config-daemon-25t7n node/ created Nov 08 04:05:49.383 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-25t7n Nov 08 04:05:49.388 I ns/openshift-machine-config-operator pod/machine-config-daemon-25t7n Successfully assigned openshift-machine-config-operator/machine-config-daemon-25t7n to ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Nov 08 04:05:49.394 I ns/openshift-dns pod/dns-default-rw249 node/ created Nov 08 04:05:49.404 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-rw249 Nov 08 04:05:49.420 I ns/openshift-image-registry pod/node-ca-l67zs node/ created Nov 08 04:05:49.426 I ns/openshift-dns pod/dns-default-rw249 Successfully assigned openshift-dns/dns-default-rw249 to ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Nov 08 04:05:49.435 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-l67zs Nov 08 04:05:49.444 I ns/openshift-image-registry pod/node-ca-l67zs Successfully assigned openshift-image-registry/node-ca-l67zs to ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Nov 08 04:05:49.618 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:cdabca18ca3136518c5c0f66c0ed643bd45e356fe10af7555e58a5697b942953" Nov 08 04:05:49.752 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Created container machine-config-daemon Nov 08 04:05:49.777 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Started container machine-config-daemon Nov 08 04:05:49.781 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" Nov 08 04:05:49.933 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Updated Machine ci-op--b6wsl-w-c-fqxt4 (6 times) Nov 08 04:05:50.099 I ns/openshift-dns pod/dns-default-k2nm7 Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:9a7e8297f7b70ee3a11fcbe4a78c59a5861e1afda5657a7437de6934bdc2458e" Nov 08 04:05:50.442 I ns/openshift-machine-config-operator pod/machine-config-daemon-25t7n Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:cdabca18ca3136518c5c0f66c0ed643bd45e356fe10af7555e58a5697b942953" Nov 08 04:05:50.566 I ns/openshift-image-registry pod/node-ca-cbzg8 Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:f6eb3311f979eda2afbf98b9b8240237215076246bf2ea5d4a35f62aa09ff192" Nov 08 04:05:50.995 I ns/openshift-dns pod/dns-default-qcntr Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:9a7e8297f7b70ee3a11fcbe4a78c59a5861e1afda5657a7437de6934bdc2458e" Nov 08 04:05:51.508 I ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" Nov 08 04:05:51.663 I ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk Created container oauth-proxy Nov 08 04:05:51.702 I ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk Started container oauth-proxy Nov 08 04:05:52.042 I ns/openshift-image-registry pod/node-ca-txp8c Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:f6eb3311f979eda2afbf98b9b8240237215076246bf2ea5d4a35f62aa09ff192" Nov 08 04:05:52.312 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" Nov 08 04:05:52.475 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Created container oauth-proxy Nov 08 04:05:52.512 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Node "ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal" drained Nov 08 04:05:52.549 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Started container oauth-proxy Nov 08 04:05:53.452 I node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Setting node ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal, currentConfig rendered-worker-f79fb2a0e1d276013c37a254e770d7ff to Done Nov 08 04:05:53.548 W ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m requeue in: 20s Nov 08 04:05:53.630 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Node "ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal" drained Nov 08 04:05:53.912 I node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Setting node ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal, currentConfig rendered-worker-f79fb2a0e1d276013c37a254e770d7ff to Done Nov 08 04:05:54.587 W ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 requeue in: 20s Nov 08 04:05:54.661 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-l7zj4 Node "ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal" drained Nov 08 04:05:54.666 I ns/openshift-dns pod/dns-default-qcntr Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:9a7e8297f7b70ee3a11fcbe4a78c59a5861e1afda5657a7437de6934bdc2458e" Nov 08 04:05:54.827 I ns/openshift-dns pod/dns-default-qcntr Created container dns Nov 08 04:05:54.853 I ns/openshift-dns pod/dns-default-qcntr Started container dns Nov 08 04:05:54.859 I ns/openshift-dns pod/dns-default-qcntr Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:37811ccc702371cbc91e86935f03b5d55040835fb8d653d211410587385034f8" Nov 08 04:05:55.674 W ns/openshift-machine-api machine/ci-op--b6wsl-w-d-l7zj4 requeue in: 20s Nov 08 04:05:55.750 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Node "ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal" drained (2 times) Nov 08 04:05:56.536 W ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m requeue in: 20s (2 times) Nov 08 04:05:56.597 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Node "ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal" drained (2 times) Nov 08 04:05:56.918 I ns/openshift-image-registry pod/node-ca-txp8c Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:f6eb3311f979eda2afbf98b9b8240237215076246bf2ea5d4a35f62aa09ff192" Nov 08 04:05:57.060 I ns/openshift-image-registry pod/node-ca-txp8c Created container node-ca Nov 08 04:05:57.142 I ns/openshift-image-registry pod/node-ca-txp8c Started container node-ca Nov 08 04:05:57.334 W ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 requeue in: 20s (2 times) Nov 08 04:05:57.534 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-l7zj4 Node "ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal" drained (2 times) Nov 08 04:05:58.304 W ns/openshift-machine-api machine/ci-op--b6wsl-w-d-l7zj4 requeue in: 20s (2 times) Nov 08 04:05:58.465 I ns/openshift-dns pod/dns-default-qcntr Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:37811ccc702371cbc91e86935f03b5d55040835fb8d653d211410587385034f8" Nov 08 04:05:58.605 I ns/openshift-dns pod/dns-default-qcntr Created container dns-node-resolver Nov 08 04:05:58.635 I ns/openshift-dns pod/dns-default-qcntr Started container dns-node-resolver Nov 08 04:06:13.607 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Node "ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal" drained (3 times) Nov 08 04:06:14.425 W ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m requeue in: 20s (3 times) Nov 08 04:06:14.646 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Node "ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal" drained (3 times) Nov 08 04:06:15.429 W ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 requeue in: 20s (3 times) Nov 08 04:06:15.735 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-l7zj4 Node "ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal" drained (3 times) Nov 08 04:06:16.505 W ns/openshift-machine-api machine/ci-op--b6wsl-w-d-l7zj4 requeue in: 20s (3 times) Nov 08 04:06:20.189 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (6 times) Nov 08 04:06:20.786 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (4 times) Nov 08 04:06:29.171 W node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal condition DiskPressure changed Nov 08 04:06:29.171 W node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal condition MemoryPressure changed Nov 08 04:06:29.171 W node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal condition PIDPressure changed Nov 08 04:06:29.171 W node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal condition Ready changed Nov 08 04:06:29.181 I node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal status is now: NodeNotReady Nov 08 04:06:29.320 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-l7zj4 Node "ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal" drained (4 times) Nov 08 04:06:30.117 W ns/openshift-machine-api machine/ci-op--b6wsl-w-d-l7zj4 requeue in: 20s (4 times) Nov 08 04:06:34.313 W node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal condition DiskPressure changed Nov 08 04:06:34.313 W node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal condition MemoryPressure changed Nov 08 04:06:34.313 W node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal condition PIDPressure changed Nov 08 04:06:34.313 W node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal condition Ready changed Nov 08 04:06:34.322 I node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal status is now: NodeNotReady Nov 08 04:06:34.473 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Node "ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal" drained (4 times) Nov 08 04:06:34.566 W clusteroperator/dns changed Degraded to False: AsExpected: All desired DNS DaemonSets available and operand Namespace exists Nov 08 04:06:35.333 W ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m requeue in: 20s (4 times) Nov 08 04:06:35.388 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Node "ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal" drained (5 times) Nov 08 04:06:36.208 W ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m requeue in: 20s (5 times) Nov 08 04:06:36.276 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Node "ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal" drained (4 times) Nov 08 04:06:37.045 W ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 requeue in: 20s (4 times) Nov 08 04:06:37.104 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-l7zj4 Node "ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal" drained (5 times) Nov 08 04:06:37.899 W ns/openshift-machine-api machine/ci-op--b6wsl-w-d-l7zj4 requeue in: 20s (5 times) Nov 08 04:06:39.018 - 15s W node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal node is not ready Nov 08 04:06:39.421 W node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal condition DiskPressure changed Nov 08 04:06:39.421 W node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal condition MemoryPressure changed Nov 08 04:06:39.421 W node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal condition PIDPressure changed Nov 08 04:06:39.421 W node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal condition Ready changed Nov 08 04:06:39.428 I node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal status is now: NodeNotReady Nov 08 04:06:39.540 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Node "ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal" drained (5 times) Nov 08 04:06:39.600 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal Nov 08 04:06:40.447 W ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 requeue in: 20s (5 times) Nov 08 04:06:50.210 I node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal event: DeletingNode Nov 08 04:06:50.217 W node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:06:54.018 W ns/openshift-machine-config-operator pod/machine-config-daemon-25t7n node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 04:06:54.018 W ns/openshift-dns pod/dns-default-rw249 node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 04:06:54.018 W ns/openshift-dns pod/dns-default-k2nm7 node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 04:06:54.018 W ns/openshift-image-registry pod/node-ca-l67zs node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 04:06:54.018 W ns/openshift-image-registry pod/node-ca-cbzg8 node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal pod has been pending longer than a minute Nov 08 04:06:54.502 I node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal event: Removing Node ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal from Controller Nov 08 04:06:55.400 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Node "ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal" drained (6 times) Nov 08 04:06:55.970 I ns/openshift-machine-api machine/ci-op--b6wsl-w-b-2545m Deleted machine ci-op--b6wsl-w-b-2545m Nov 08 04:06:56.075 I node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal event: DeletingNode Nov 08 04:06:56.077 W node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal deleted Nov 08 04:06:56.086 W node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:06:56.480 I node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal event: DeletingNode Nov 08 04:06:57.502 I ns/openshift-machine-api machine/ci-op--b6wsl-w-c-fqxt4 Deleted machine ci-op--b6wsl-w-c-fqxt4 Nov 08 04:06:58.485 I ns/openshift-machine-api machine/ci-op--b6wsl-w-d-l7zj4 Deleted machine ci-op--b6wsl-w-d-l7zj4 Nov 08 04:06:59.501 I node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal event: Removing Node ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal from Controller Nov 08 04:06:59.506 I node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal Node ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal event: Removing Node ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal from Controller Nov 08 04:07:04.652 W ns/openshift-sdn pod/sdn-hsd5p node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.659 W ns/openshift-sdn pod/sdn-hsd5p node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.671 W ns/openshift-image-registry pod/node-ca-cbzg8 node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.680 W ns/openshift-image-registry pod/node-ca-cbzg8 node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.691 W ns/openshift-cluster-node-tuning-operator pod/tuned-6w9pb node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.699 W ns/openshift-cluster-node-tuning-operator pod/tuned-6w9pb node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.706 W ns/openshift-monitoring pod/node-exporter-8t6jz node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.713 W ns/openshift-monitoring pod/node-exporter-8t6jz node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.727 W ns/openshift-sdn pod/sdn-pd4nk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.736 W ns/openshift-sdn pod/sdn-pd4nk node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.749 W ns/openshift-monitoring pod/node-exporter-lcz8z node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.756 W ns/openshift-monitoring pod/node-exporter-lcz8z node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.771 W ns/openshift-image-registry pod/node-ca-l67zs node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.776 W ns/openshift-image-registry pod/node-ca-l67zs node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.786 W ns/openshift-machine-config-operator pod/machine-config-daemon-rn2lz node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.800 W ns/openshift-machine-config-operator pod/machine-config-daemon-rn2lz node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.807 W ns/openshift-cluster-node-tuning-operator pod/tuned-rpxtr node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.813 W ns/openshift-cluster-node-tuning-operator pod/tuned-rpxtr node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.823 W ns/openshift-multus pod/multus-sk2hm node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.831 W ns/openshift-multus pod/multus-sk2hm node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.845 W ns/openshift-sdn pod/ovs-8475f node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.855 W ns/openshift-sdn pod/ovs-8475f node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.870 W ns/openshift-monitoring pod/node-exporter-dgbkw node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.888 W ns/openshift-monitoring pod/node-exporter-dgbkw node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.891 W clusteroperator/network changed Progressing to False Nov 08 04:07:04.898 W ns/openshift-multus pod/multus-ml6nh node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.908 W ns/openshift-multus pod/multus-ml6nh node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.919 W ns/openshift-sdn pod/ovs-s7w7m node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.932 W ns/openshift-sdn pod/ovs-s7w7m node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.942 W ns/openshift-dns pod/dns-default-rw249 node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.949 W ns/openshift-dns pod/dns-default-rw249 node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.961 W ns/openshift-dns pod/dns-default-k2nm7 node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.968 W ns/openshift-dns pod/dns-default-k2nm7 node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.979 W ns/openshift-image-registry pod/node-ca-nzk6g node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:04.986 W ns/openshift-image-registry pod/node-ca-nzk6g node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:04.995 W ns/openshift-sdn pod/ovs-tk9s2 node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:05.002 W ns/openshift-sdn pod/ovs-tk9s2 node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:05.010 W ns/openshift-multus pod/multus-d2p7l node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:05.021 W ns/openshift-multus pod/multus-d2p7l node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:05.033 W ns/openshift-machine-config-operator pod/machine-config-daemon-25t7n node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:05.088 W ns/openshift-machine-config-operator pod/machine-config-daemon-25t7n node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:05.110 W ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:05.121 W ns/openshift-machine-config-operator pod/machine-config-daemon-jxvsk node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:05.145 W ns/openshift-machine-config-operator endpoints/machine-config-daemon Failed to update endpoint openshift-machine-config-operator/machine-config-daemon: Operation cannot be fulfilled on endpoints "machine-config-daemon": the object has been modified; please apply your changes to the latest version and try again Nov 08 04:07:05.153 W ns/openshift-sdn pod/sdn-b692c node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:05.177 W ns/openshift-sdn pod/sdn-b692c node/ci-op--b6wsl-w-b-2545m.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:05.181 W ns/openshift-machine-config-operator endpoints/machine-config-daemon Failed to update endpoint openshift-machine-config-operator/machine-config-daemon: Operation cannot be fulfilled on endpoints "machine-config-daemon": the object has been modified; please apply your changes to the latest version and try again (2 times) Nov 08 04:07:05.192 W ns/openshift-cluster-node-tuning-operator pod/tuned-22cpw node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:05.206 W ns/openshift-cluster-node-tuning-operator pod/tuned-22cpw node/ci-op--b6wsl-w-c-fqxt4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:05.230 W ns/openshift-dns pod/dns-default-9df75 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal graceful deletion within 0s Nov 08 04:07:05.276 W ns/openshift-dns pod/dns-default-9df75 node/ci-op--b6wsl-w-d-l7zj4.c.openshift-gce-devel-ci.internal deleted Nov 08 04:07:06.804 I ns/openshift-ingress service/router-default Updated load balancer with new hosts Nov 08 04:08:04.920 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (9 times) Nov 08 04:08:05.516 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (7 times) Nov 08 04:09:02.391 W node/node1 deleted Nov 08 04:09:54.826 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (27 times) Nov 08 04:09:55.814 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (30 times) Nov 08 04:12:23.938 I ns/openshift-dns pod/dns-default-qcntr Marking for deletion Pod openshift-dns/dns-default-qcntr Nov 08 04:12:23.942 W ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal graceful deletion within 600s Nov 08 04:12:23.945 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-dktfr Nov 08 04:12:23.949 W ns/openshift-image-registry pod/node-ca-txp8c node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 04:12:23.950 W ns/openshift-dns pod/dns-default-qcntr node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 04:12:23.957 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-dktfr Nov 08 04:12:23.963 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Stopping container oauth-proxy Nov 08 04:12:23.967 I ns/openshift-image-registry pod/node-ca-txp8c Marking for deletion Pod openshift-image-registry/node-ca-txp8c Nov 08 04:12:23.972 I ns/openshift-dns daemonset/dns-default Deleted pod: dns-default-qcntr Nov 08 04:12:23.974 I ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr Stopping container machine-config-daemon Nov 08 04:12:23.982 I ns/openshift-image-registry pod/node-ca-txp8c Stopping container node-ca Nov 08 04:12:23.996 I ns/openshift-dns pod/dns-default-qcntr Stopping container dns-node-resolver Nov 08 04:12:24.003 I ns/openshift-dns pod/dns-default-qcntr Stopping container dns Nov 08 04:12:24.546 E ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 143 (Error): Nov 08 04:12:25.548 W ns/openshift-image-registry pod/node-ca-txp8c node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 04:12:25.548 W ns/openshift-image-registry pod/node-ca-txp8c node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal container=node-ca container stopped being ready Nov 08 04:12:25.560 W ns/openshift-dns pod/dns-default-qcntr node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 04:12:25.560 W ns/openshift-dns pod/dns-default-qcntr node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal container=dns container stopped being ready Nov 08 04:12:25.560 W ns/openshift-dns pod/dns-default-qcntr node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal container=dns-node-resolver container stopped being ready Nov 08 04:12:25.663 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available. Nov 08 04:12:30.019 W ns/openshift-dns pod/dns-default-qcntr node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal deleted Nov 08 04:12:30.034 I ns/openshift-dns pod/dns-default-vv5g8 node/ created Nov 08 04:12:30.042 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-vv5g8 Nov 08 04:12:30.048 W ns/openshift-machine-config-operator pod/machine-config-daemon-dktfr node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal deleted Nov 08 04:12:30.052 I ns/openshift-dns pod/dns-default-vv5g8 Successfully assigned openshift-dns/dns-default-vv5g8 to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:12:30.065 I ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz node/ created Nov 08 04:12:30.074 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-qpnxz Nov 08 04:12:30.077 W ns/openshift-image-registry pod/node-ca-txp8c node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal deleted Nov 08 04:12:30.079 I ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz Successfully assigned openshift-machine-config-operator/machine-config-daemon-qpnxz to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:12:30.106 I ns/openshift-image-registry pod/node-ca-w98qz node/ created Nov 08 04:12:30.112 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-w98qz Nov 08 04:12:30.124 I ns/openshift-image-registry pod/node-ca-w98qz Successfully assigned openshift-image-registry/node-ca-w98qz to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:12:30.841 I ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:cdabca18ca3136518c5c0f66c0ed643bd45e356fe10af7555e58a5697b942953" already present on machine Nov 08 04:12:30.987 I ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz Created container machine-config-daemon Nov 08 04:12:31.014 I ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz Started container machine-config-daemon Nov 08 04:12:31.018 I ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:56c87990597a959642670546823fa8e1965e6f9e744abeab33f2d6f018a8deb7" already present on machine Nov 08 04:12:31.171 I ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz Created container oauth-proxy Nov 08 04:12:31.205 I ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz Started container oauth-proxy Nov 08 04:12:37.808 I ns/openshift-image-registry pod/node-ca-w98qz Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:f6eb3311f979eda2afbf98b9b8240237215076246bf2ea5d4a35f62aa09ff192" already present on machine Nov 08 04:12:37.947 I ns/openshift-image-registry pod/node-ca-w98qz Created container node-ca Nov 08 04:12:37.974 I ns/openshift-image-registry pod/node-ca-w98qz Started container node-ca Nov 08 04:12:38.473 I ns/openshift-dns pod/dns-default-vv5g8 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:9a7e8297f7b70ee3a11fcbe4a78c59a5861e1afda5657a7437de6934bdc2458e" already present on machine Nov 08 04:12:38.641 I ns/openshift-dns pod/dns-default-vv5g8 Created container dns Nov 08 04:12:38.671 I ns/openshift-dns pod/dns-default-vv5g8 Started container dns Nov 08 04:12:38.675 I ns/openshift-dns pod/dns-default-vv5g8 Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:37811ccc702371cbc91e86935f03b5d55040835fb8d653d211410587385034f8" already present on machine Nov 08 04:12:38.825 I ns/openshift-dns pod/dns-default-vv5g8 Created container dns-node-resolver Nov 08 04:12:38.854 I ns/openshift-dns pod/dns-default-vv5g8 Started container dns-node-resolver Nov 08 04:12:55.862 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal Nov 08 04:16:20.193 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (36 times) Nov 08 04:16:20.787 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (40 times) Nov 08 04:18:05.002 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (32 times) Nov 08 04:18:05.602 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (10 times) Nov 08 04:18:08.527 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "" to "OperatorSyncDegraded: failed syncing configuration objects: config maps [v4-0-config-user-idp-0-ca] in openshift-authentication not synced" Nov 08 04:18:08.985 I ns/openshift-authentication-operator deployment/authentication-operator Created ConfigMap/v4-0-config-user-idp-0-ca -n openshift-authentication because it was missing Nov 08 04:18:11.783 I ns/openshift-authentication-operator deployment/authentication-operator Updated ConfigMap/v4-0-config-system-cliconfig -n openshift-authentication: cause by changes in data.v4-0-config-system-cliconfig Nov 08 04:18:12.425 I ns/openshift-authentication-operator deployment/authentication-operator Updated Deployment.apps/oauth-openshift -n openshift-authentication because it changed Nov 08 04:18:12.448 I ns/openshift-authentication deployment/oauth-openshift Scaled up replica set oauth-openshift-59c847d4d8 to 1 Nov 08 04:18:12.475 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-s6cxg node/ created Nov 08 04:18:12.489 I ns/openshift-authentication replicaset/oauth-openshift-59c847d4d8 Created pod: oauth-openshift-59c847d4d8-s6cxg Nov 08 04:18:12.506 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-s6cxg Successfully assigned openshift-authentication/oauth-openshift-59c847d4d8-s6cxg to ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal Nov 08 04:18:12.832 W clusteroperator/authentication changed Progressing to True: ProgressingOAuthServerDeploymentNotReady: Progressing: deployment's observed generation did not reach the expected generation Nov 08 04:18:12.841 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "OperatorSyncDegraded: failed syncing configuration objects: config maps [v4-0-config-user-idp-0-ca] in openshift-authentication not synced" to "",Progressing changed from False to True ("Progressing: deployment's observed generation did not reach the expected generation") Nov 08 04:18:16.246 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Progressing message changed from "Progressing: deployment's observed generation did not reach the expected generation" to "Progressing: not all deployment replicas are ready" Nov 08 04:18:20.433 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-s6cxg Pulling image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:098c91095a31cb7688012c69626f5d18f574151106e92f788131d2dd3c2f5112" Nov 08 04:18:23.352 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-s6cxg Successfully pulled image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:098c91095a31cb7688012c69626f5d18f574151106e92f788131d2dd3c2f5112" Nov 08 04:18:23.613 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-s6cxg Created container oauth-openshift Nov 08 04:18:23.657 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-s6cxg Started container oauth-openshift Nov 08 04:18:31.082 I ns/openshift-authentication deployment/oauth-openshift Scaled down replica set oauth-openshift-cc5b4c6c6 to 1 Nov 08 04:18:31.085 W ns/openshift-authentication pod/oauth-openshift-cc5b4c6c6-k7rcd node/ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 04:18:31.096 I ns/openshift-authentication replicaset/oauth-openshift-cc5b4c6c6 Deleted pod: oauth-openshift-cc5b4c6c6-k7rcd Nov 08 04:18:31.100 I ns/openshift-authentication deployment/oauth-openshift Scaled up replica set oauth-openshift-59c847d4d8 to 2 Nov 08 04:18:31.110 I ns/openshift-authentication pod/oauth-openshift-cc5b4c6c6-k7rcd Stopping container oauth-openshift Nov 08 04:18:31.141 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-n6k4c node/ created Nov 08 04:18:31.155 I ns/openshift-authentication replicaset/oauth-openshift-59c847d4d8 Created pod: oauth-openshift-59c847d4d8-n6k4c Nov 08 04:18:31.164 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-n6k4c Successfully assigned openshift-authentication/oauth-openshift-59c847d4d8-n6k4c to ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal Nov 08 04:18:39.232 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-n6k4c Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:098c91095a31cb7688012c69626f5d18f574151106e92f788131d2dd3c2f5112" already present on machine Nov 08 04:18:39.441 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-n6k4c Created container oauth-openshift Nov 08 04:18:39.475 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-n6k4c Started container oauth-openshift Nov 08 04:18:40.118 I ns/openshift-authentication deployment/oauth-openshift Scaled down replica set oauth-openshift-cc5b4c6c6 to 0 Nov 08 04:18:40.121 W ns/openshift-authentication pod/oauth-openshift-cc5b4c6c6-qjqsr node/ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 04:18:40.134 I ns/openshift-authentication replicaset/oauth-openshift-cc5b4c6c6 Deleted pod: oauth-openshift-cc5b4c6c6-qjqsr Nov 08 04:18:40.151 I ns/openshift-authentication pod/oauth-openshift-cc5b4c6c6-qjqsr Stopping container oauth-openshift Nov 08 04:18:41.409 W ns/openshift-authentication pod/oauth-openshift-cc5b4c6c6-qjqsr node/ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 04:18:41.409 W ns/openshift-authentication pod/oauth-openshift-cc5b4c6c6-qjqsr node/ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal container=oauth-openshift container stopped being ready Nov 08 04:18:41.824 W ns/openshift-authentication pod/oauth-openshift-cc5b4c6c6-k7rcd node/ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal deleted Nov 08 04:18:47.192 W ns/openshift-authentication pod/oauth-openshift-cc5b4c6c6-qjqsr node/ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal deleted Nov 08 04:18:51.038 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "" to "RouteHealthDegraded: failed to GET route: net/http: TLS handshake timeout" Nov 08 04:18:52.485 W clusteroperator/authentication changed Progressing to False Nov 08 04:18:52.493 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "RouteHealthDegraded: failed to GET route: net/http: TLS handshake timeout" to "",Progressing changed from True to False ("") Nov 08 04:18:54.246 I ns/openshift-authentication-operator deployment/authentication-operator Deleted target configmap openshift-authentication/v4-0-config-user-idp-0-ca because source config does not exist Nov 08 04:18:55.837 I ns/openshift-authentication-operator deployment/authentication-operator Updated ConfigMap/v4-0-config-system-cliconfig -n openshift-authentication: cause by changes in data.v4-0-config-system-cliconfig (2 times) Nov 08 04:18:56.680 I ns/openshift-authentication-operator deployment/authentication-operator Updated Deployment.apps/oauth-openshift -n openshift-authentication because it changed (2 times) Nov 08 04:18:56.704 I ns/openshift-authentication deployment/oauth-openshift Scaled up replica set oauth-openshift-66dcd788d to 1 Nov 08 04:18:56.739 I ns/openshift-authentication pod/oauth-openshift-66dcd788d-8bxtk node/ created Nov 08 04:18:56.746 I ns/openshift-authentication replicaset/oauth-openshift-66dcd788d Created pod: oauth-openshift-66dcd788d-8bxtk Nov 08 04:18:56.765 I ns/openshift-authentication pod/oauth-openshift-66dcd788d-8bxtk Successfully assigned openshift-authentication/oauth-openshift-66dcd788d-8bxtk to ci-op--b6wsl-m-0.c.openshift-gce-devel-ci.internal Nov 08 04:18:57.085 W clusteroperator/authentication changed Progressing to True: ProgressingOAuthServerDeploymentNotReady: Progressing: deployment's observed generation did not reach the expected generation Nov 08 04:18:57.093 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Progressing changed from False to True ("Progressing: deployment's observed generation did not reach the expected generation") Nov 08 04:19:00.493 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Progressing message changed from "Progressing: deployment's observed generation did not reach the expected generation" to "Progressing: not all deployment replicas are ready" (2 times) Nov 08 04:19:05.095 I ns/openshift-authentication pod/oauth-openshift-66dcd788d-8bxtk Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:098c91095a31cb7688012c69626f5d18f574151106e92f788131d2dd3c2f5112" already present on machine Nov 08 04:19:05.345 I ns/openshift-authentication pod/oauth-openshift-66dcd788d-8bxtk Created container oauth-openshift Nov 08 04:19:05.388 I ns/openshift-authentication pod/oauth-openshift-66dcd788d-8bxtk Started container oauth-openshift Nov 08 04:19:12.166 I ns/openshift-authentication deployment/oauth-openshift Scaled down replica set oauth-openshift-59c847d4d8 to 1 Nov 08 04:19:12.171 W ns/openshift-authentication pod/oauth-openshift-59c847d4d8-n6k4c node/ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 04:19:12.196 I ns/openshift-authentication replicaset/oauth-openshift-59c847d4d8 Deleted pod: oauth-openshift-59c847d4d8-n6k4c Nov 08 04:19:12.196 I ns/openshift-authentication deployment/oauth-openshift Scaled up replica set oauth-openshift-66dcd788d to 2 Nov 08 04:19:12.197 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-n6k4c Stopping container oauth-openshift Nov 08 04:19:12.229 I ns/openshift-authentication pod/oauth-openshift-66dcd788d-78wbw node/ created Nov 08 04:19:12.246 I ns/openshift-authentication replicaset/oauth-openshift-66dcd788d Created pod: oauth-openshift-66dcd788d-78wbw Nov 08 04:19:12.260 I ns/openshift-authentication pod/oauth-openshift-66dcd788d-78wbw Successfully assigned openshift-authentication/oauth-openshift-66dcd788d-78wbw to ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal Nov 08 04:19:14.046 W ns/openshift-authentication pod/oauth-openshift-59c847d4d8-n6k4c node/ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal deleted Nov 08 04:19:20.615 I ns/openshift-authentication pod/oauth-openshift-66dcd788d-78wbw Container image "registry.svc.ci.openshift.org/ocp/4.3-2019-11-08-025819@sha256:098c91095a31cb7688012c69626f5d18f574151106e92f788131d2dd3c2f5112" already present on machine Nov 08 04:19:20.841 I ns/openshift-authentication pod/oauth-openshift-66dcd788d-78wbw Created container oauth-openshift Nov 08 04:19:20.876 I ns/openshift-authentication pod/oauth-openshift-66dcd788d-78wbw Started container oauth-openshift Nov 08 04:19:24.479 I ns/openshift-authentication deployment/oauth-openshift Scaled down replica set oauth-openshift-59c847d4d8 to 0 Nov 08 04:19:24.486 W ns/openshift-authentication pod/oauth-openshift-59c847d4d8-s6cxg node/ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 04:19:24.501 I ns/openshift-authentication replicaset/oauth-openshift-59c847d4d8 Deleted pod: oauth-openshift-59c847d4d8-s6cxg Nov 08 04:19:24.506 I ns/openshift-authentication pod/oauth-openshift-59c847d4d8-s6cxg Stopping container oauth-openshift Nov 08 04:19:25.712 W ns/openshift-authentication pod/oauth-openshift-59c847d4d8-s6cxg node/ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 04:19:25.712 W ns/openshift-authentication pod/oauth-openshift-59c847d4d8-s6cxg node/ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal container=oauth-openshift container stopped being ready Nov 08 04:19:26.846 W clusteroperator/authentication changed Progressing to False Nov 08 04:19:26.856 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Progressing changed from True to False ("") Nov 08 04:19:35.163 W ns/openshift-authentication pod/oauth-openshift-59c847d4d8-s6cxg node/ci-op--b6wsl-m-2.c.openshift-gce-devel-ci.internal deleted Nov 08 04:19:54.825 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (7 times) Nov 08 04:19:55.814 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op--b6wsl-m-1.c.openshift-gce-devel-ci.internal Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (8 times) Nov 08 04:20:08.585 I persistentvolume/pvc-8bb509bf-9ece-41f6-bd7b-6897e7ec3c0b googleapi: Error 400: The disk resource 'projects/openshift-gce-devel-ci/zones/us-east1-d/disks/ci-op--b6wsl-dynamic-pvc-8bb509bf-9ece-41f6-bd7b-6897e7ec3c0b' is already being used by 'projects/openshift-gce-devel-ci/zones/us-east1-d/instances/ci-op--b6wsl-w-d-wmh8t', resourceInUseByAnotherResource Nov 08 04:21:13.168 I persistentvolume/pvc-e2741b8e-0b47-4169-8403-e70f9a2a2dfa googleapi: Error 400: The disk resource 'projects/openshift-gce-devel-ci/zones/us-east1-d/disks/ci-op--b6wsl-dynamic-pvc-e2741b8e-0b47-4169-8403-e70f9a2a2dfa' is already being used by 'projects/openshift-gce-devel-ci/zones/us-east1-d/instances/ci-op--b6wsl-w-d-wmh8t', resourceInUseByAnotherResource Nov 08 04:24:10.415 I ns/openshift-image-registry pod/node-ca-w98qz Marking for deletion Pod openshift-image-registry/node-ca-w98qz Nov 08 04:24:10.419 W ns/openshift-image-registry pod/node-ca-w98qz node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 04:24:10.422 W ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal graceful deletion within 600s Nov 08 04:24:10.424 I ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-qpnxz Nov 08 04:24:10.433 W ns/openshift-dns pod/dns-default-vv5g8 node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal graceful deletion within 30s Nov 08 04:24:10.437 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-qpnxz Nov 08 04:24:10.437 I ns/openshift-image-registry pod/node-ca-w98qz Stopping container node-ca Nov 08 04:24:10.454 I ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz Stopping container oauth-proxy Nov 08 04:24:10.454 I ns/openshift-dns daemonset/dns-default Deleted pod: dns-default-vv5g8 Nov 08 04:24:10.467 I ns/openshift-dns pod/dns-default-vv5g8 Marking for deletion Pod openshift-dns/dns-default-vv5g8 Nov 08 04:24:10.472 I ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz Stopping container machine-config-daemon Nov 08 04:24:10.483 I ns/openshift-dns pod/dns-default-vv5g8 Stopping container dns-node-resolver Nov 08 04:24:10.489 I ns/openshift-dns pod/dns-default-vv5g8 Stopping container dns Nov 08 04:24:10.983 E ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal container=oauth-proxy container exited with code 143 (Error): Nov 08 04:24:12.056 W ns/openshift-dns pod/dns-default-vv5g8 node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal invariant violation (bug): pod should not transition Running->Pending even when terminated Nov 08 04:24:12.056 W ns/openshift-dns pod/dns-default-vv5g8 node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal container=dns container stopped being ready Nov 08 04:24:12.056 W ns/openshift-dns pod/dns-default-vv5g8 node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal container=dns-node-resolver container stopped being ready Nov 08 04:24:20.016 W ns/openshift-image-registry pod/node-ca-w98qz node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal deleted Nov 08 04:24:20.043 W ns/openshift-machine-config-operator pod/machine-config-daemon-qpnxz node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal deleted Nov 08 04:24:20.072 W ns/openshift-dns pod/dns-default-vv5g8 node/ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal deleted Nov 08 04:24:20.123 I ns/openshift-dns pod/dns-default-8twvs node/ created Nov 08 04:24:20.139 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-8twvs Nov 08 04:24:20.148 I ns/openshift-dns pod/dns-default-8twvs Successfully assigned openshift-dns/dns-default-8twvs to ci-op--b6wsl-w-d-wmh8t.c.openshift-gce-devel-ci.internal Nov 08 04:24:20.162 I ns/openshift-machine-config-operator pod/machine-config-daemon-bg2jw node/ created Nov 08 04:24:20.162 I ns/openshift-image-registry pod/node-ca-5k4rd node/ created Nov 08 04:24:20.169 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-5k4rd
Find was mentions in log files
openshift-tests [Feature:Image][triggers][Serial] ImageStream API TestImageStreamMappingCreate [Suite:openshift/conformance/serial]
openshift-tests [Feature:Image][triggers][Serial] ImageStream API TestImageStreamTagLifecycleHook [Suite:openshift/conformance/serial]
openshift-tests [Feature:Image][triggers][Serial] ImageStream API TestImageStreamWithoutDockerImageConfig [Suite:openshift/conformance/serial]
openshift-tests [Feature:Image][triggers][Serial] ImageStream admission TestImageStreamAdmitSpecUpdate [Suite:openshift/conformance/serial]
openshift-tests [Feature:Image][triggers][Serial] ImageStream admission TestImageStreamAdmitStatusUpdate [Suite:openshift/conformance/serial]
openshift-tests [Feature:Image][triggers][Serial] ImageStream admission TestImageStreamTagsAdmission [Suite:openshift/conformance/serial]
openshift-tests [Feature:Machines][Serial] Managed cluster should grow and decrease when scaling different machineSets simultaneously [Suite:openshift/conformance/serial]
openshift-tests [Feature:OpenShiftAuthorization][Serial] authorization TestAuthorizationResourceAccessReview should succeed [Suite:openshift/conformance/serial]
openshift-tests [Feature:ProjectAPI][Serial] TestUnprivilegedNewProjectDenied [Suite:openshift/conformance/serial]
openshift-tests [Serial] API data in etcd should be stored at the correct location and version for all resources [Suite:openshift/conformance/serial]
openshift-tests [Serial] [Feature:OAuthServer] [RequestHeaders] [IdP] test RequestHeaders IdP [Suite:openshift/conformance/serial]
openshift-tests [Suite:openshift/oauth][Serial] ldap group sync can sync groups from ldap [Suite:openshift/conformance/serial]
openshift-tests [k8s.io] [sig-node] kubelet [k8s.io] [sig-node] Clean up pods on node kubelet should be able to delete 10 pods per node in 1m0s. [Suite:openshift/conformance/serial] [Suite:k8s] [Serial]
openshift-tests [sig-api-machinery] Namespaces [Serial] should always delete fast (ALL of 100 namespaces in 150 seconds) [Feature:ComprehensiveNamespaceDraining] [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-api-machinery] Namespaces [Serial] should delete fast enough (90 percent of 100 namespaces in 150 seconds) [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-api-machinery] Namespaces [Serial] should ensure that all pods are removed when a namespace is deleted [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-api-machinery] Namespaces [Serial] should ensure that all services are removed when a namespace is deleted [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-apps] Daemon set [Serial] should not update pod when spec was updated and update strategy is OnDelete [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-apps] Daemon set [Serial] should retry creating failed daemon pods [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-apps] Daemon set [Serial] should rollback without unnecessary restarts [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-apps] Daemon set [Serial] should run and stop complex daemon [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-apps] Daemon set [Serial] should run and stop complex daemon with node affinity [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-apps] Daemon set [Serial] should run and stop simple daemon [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-apps] Daemon set [Serial] should update pod when spec was updated and update strategy is RollingUpdate [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-cli] Kubectl client Kubectl taint [Serial] should remove all the taints with the same key off a node [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-cli] Kubectl client Kubectl taint [Serial] should update the taint on a node [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-network] Service endpoints latency should not be very high [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s] [Serial]
openshift-tests [sig-scheduling] NoExecuteTaintManager Multiple Pods [Serial] evicts pods with minTolerationSeconds [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-scheduling] NoExecuteTaintManager Multiple Pods [Serial] only evicts pods without tolerations from tainted nodes [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-scheduling] NoExecuteTaintManager Single Pod [Serial] doesn't evict pod with tolerations from tainted nodes [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-scheduling] NoExecuteTaintManager Single Pod [Serial] eventually evict pod with finite tolerations from tainted nodes [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-scheduling] NoExecuteTaintManager Single Pod [Serial] evicts pods from tainted nodes [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-scheduling] NoExecuteTaintManager Single Pod [Serial] removing taint cancels eviction [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-scheduling] PodPriorityResolution [Serial] validates critical system priorities are created and resolved [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-scheduling] SchedulerPredicates [Serial] validates resource limits of pods that are allowed to run [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-scheduling] SchedulerPredicates [Serial] validates that NodeAffinity is respected if not matching [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-scheduling] SchedulerPredicates [Serial] validates that NodeSelector is respected if matching [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-scheduling] SchedulerPredicates [Serial] validates that NodeSelector is respected if not matching [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-scheduling] SchedulerPredicates [Serial] validates that required NodeAffinity setting is respected if matching [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-scheduling] SchedulerPredicates [Serial] validates that taints-tolerations is respected if matching [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-scheduling] SchedulerPredicates [Serial] validates that taints-tolerations is respected if not matching [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-scheduling] SchedulerPredicates [Serial] validates that there is no conflict between pods with same hostPort but different hostIP and protocol [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-scheduling] SchedulerPriorities [Serial] Pod should avoid nodes that have avoidPod annotation [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-scheduling] SchedulerPriorities [Serial] Pod should be preferably scheduled to nodes pod can tolerate [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-scheduling] SchedulerPriorities [Serial] Pod should be scheduled to node that don't match the PodAntiAffinity terms [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-storage] EmptyDir wrapper volumes should not cause race condition when used for configmaps [Serial] [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
openshift-tests [sig-storage] PersistentVolumes-local Pods sharing a single local PV [Serial] all pods should be running [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-storage] PersistentVolumes-local Stress with local volumes [Serial] should be able to process many pods and reuse local volumes [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-storage] [Serial] Volume metrics should create volume metrics in Volume Manager [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-storage] [Serial] Volume metrics should create volume metrics with the correct PVC ref [Suite:openshift/conformance/serial] [Suite:k8s]
operator All images are built and tagged into stable
operator Create the release image containing all images built by this job
operator Find all of the input images from ocp/4.3:${component} and tag them into the output image stream
operator Run template e2e-gcp-serial - e2e-gcp-serial container lease
operator Run template e2e-gcp-serial - e2e-gcp-serial container setup
operator Run template e2e-gcp-serial - e2e-gcp-serial container teardown
operator Run template e2e-gcp-serial - e2e-gcp-serial container test
openshift-tests [registry][Serial][Suite:openshift/registry/serial] Image signature workflow can push a signed image to openshift registry and verify it [Suite:openshift/conformance/serial]
openshift-tests [sig-storage] [Serial] Volume metrics PVController should create bound pv/pvc count metrics for pvc controller after creating both pv and pvc [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-storage] [Serial] Volume metrics PVController should create none metrics for pvc controller before creating any PV or PVC [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-storage] [Serial] Volume metrics PVController should create unbound pv count metrics for pvc controller after creating pv only [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-storage] [Serial] Volume metrics PVController should create unbound pvc count metrics for pvc controller after creating pvc only [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-storage] [Serial] Volume metrics should create metrics for total number of volumes in A/D Controller [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-storage] [Serial] Volume metrics should create metrics for total time taken in volume operations in P/V Controller [Suite:openshift/conformance/serial] [Suite:k8s]
openshift-tests [sig-storage] [Serial] Volume metrics should create prometheus metrics for volume provisioning and attach/detach [Suite:openshift/conformance/serial] [Suite:k8s]