release-openshift-ocp-installer-e2e-azure-serial-4.3 #351

• artifacts
• build log

Test Failures

openshift-tests Monitor cluster while tests execute 1h20m

go run hack/e2e.go -v -test --test_args='--ginkgo.focus=openshift\-tests\sMonitor\scluster\swhile\stests\sexecute$'

24 error level events were detected during this test run:

Nov 08 10:58:53.870 E ns/openshift-ingress pod/router-default-595c859f98-5w8k6 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=router container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:56.812 E ns/openshift-ingress pod/router-default-595c859f98-w78dt node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=router container exited with code 2 (Error): Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:35:03.015Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:35:07.997Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:35:27.873Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:35:32.825Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:36:46.129Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:36:54.675Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:48:15.429Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:48:20.448Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:48:43.891Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:48:48.834Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:58:53.241Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n
Nov 08 10:58:56.936 E ns/openshift-machine-config-operator pod/machine-config-daemon-ls4r8 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=oauth-proxy container exited with code 143 (Error): 
Nov 08 10:58:57.621 E ns/openshift-monitoring pod/grafana-85bf74556f-kqv6c node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=grafana-proxy container exited with code 2 (Error): 
Nov 08 10:58:57.694 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus container exited with code 1 (Error): caller=main.go:657 msg="Starting TSDB ..."\nlevel=info ts=2019-11-08T10:29:46.363Z caller=web.go:450 component=web msg="Start listening for connections" address=127.0.0.1:9090\nlevel=info ts=2019-11-08T10:29:46.378Z caller=head.go:514 component=tsdb msg="replaying WAL, this may take awhile"\nlevel=info ts=2019-11-08T10:29:46.378Z caller=head.go:562 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:672 fs_type=XFS_SUPER_MAGIC\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:673 msg="TSDB started"\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:743 msg="Loading configuration file" filename=/etc/prometheus/config_out/prometheus.env.yaml\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:526 msg="Stopping scrape discovery manager..."\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:540 msg="Stopping notify discovery manager..."\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:562 msg="Stopping scrape manager..."\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:536 msg="Notify discovery manager stopped"\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:522 msg="Scrape discovery manager stopped"\nlevel=info ts=2019-11-08T10:29:46.380Z caller=main.go:556 msg="Scrape manager stopped"\nlevel=info ts=2019-11-08T10:29:46.380Z caller=manager.go:814 component="rule manager" msg="Stopping rule manager..."\nlevel=info ts=2019-11-08T10:29:46.380Z caller=manager.go:820 component="rule manager" msg="Rule manager stopped"\nlevel=info ts=2019-11-08T10:29:46.390Z caller=notifier.go:602 component=notifier msg="Stopping notification manager..."\nlevel=info ts=2019-11-08T10:29:46.390Z caller=main.go:727 msg="Notifier manager stopped"\nlevel=error ts=2019-11-08
Nov 08 10:58:57.694 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=rules-configmap-reloader container exited with code 2 (Error): 2019/11/08 10:29:54 Watching directory: "/etc/prometheus/rules/prometheus-k8s-rulefiles-0"\n2019/11/08 10:35:34 config map updated\n2019/11/08 10:35:34 successfully triggered reload\n
Nov 08 10:58:57.694 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus-config-reloader container exited with code 2 (Error): ts=2019-11-08T10:29:50.687672176Z caller=main.go:85 msg="Starting prometheus-config-reloader version '0.34.0'."\nlevel=info ts=2019-11-08T10:29:50.688145494Z caller=reloader.go:127 msg="started watching config file for changes" in=/etc/prometheus/config/prometheus.yaml.gz out=/etc/prometheus/config_out/prometheus.env.yaml\nlevel=error ts=2019-11-08T10:29:50.697755459Z caller=runutil.go:87 msg="function failed. Retrying in next tick" err="trigger reload: reload request failed: Post http://localhost:9090/-/reload: dial tcp [::1]:9090: connect: connection refused"\nlevel=error ts=2019-11-08T10:29:55.690768709Z caller=runutil.go:87 msg="function failed. Retrying in next tick" err="trigger reload: reload request failed: Post http://localhost:9090/-/reload: dial tcp [::1]:9090: connect: connection refused"\nlevel=error ts=2019-11-08T10:30:00.69064772Z caller=runutil.go:87 msg="function failed. Retrying in next tick" err="trigger reload: reload request failed: Post http://localhost:9090/-/reload: dial tcp [::1]:9090: connect: connection refused"\nlevel=error ts=2019-11-08T10:30:05.690371225Z caller=runutil.go:87 msg="function failed. Retrying in next tick" err="trigger reload: reload request failed: Post http://localhost:9090/-/reload: dial tcp [::1]:9090: connect: connection refused"\nlevel=info ts=2019-11-08T10:30:10.93625069Z caller=reloader.go:258 msg="Prometheus reload triggered" cfg_in=/etc/prometheus/config/prometheus.yaml.gz cfg_out=/etc/prometheus/config_out/prometheus.env.yaml rule_dirs=\nlevel=info ts=2019-11-08T10:30:11.161064038Z caller=reloader.go:258 msg="Prometheus reload triggered" cfg_in=/etc/prometheus/config/prometheus.yaml.gz cfg_out=/etc/prometheus/config_out/prometheus.env.yaml rule_dirs=\nlevel=info ts=2019-11-08T10:
Nov 08 10:58:57.721 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=kube-rbac-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.721 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prom-label-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.721 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.770 E ns/openshift-machine-config-operator pod/machine-config-daemon-27kgg node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=oauth-proxy container exited with code 143 (Error): 
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=rules-configmap-reloader container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=thanos-sidecar container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prometheus container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prom-label-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=kube-rbac-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prometheus-config-reloader container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prometheus-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:58.628 E ns/openshift-monitoring pod/alertmanager-main-2 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=config-reloader container exited with code 2 (Error): 2019/11/08 10:32:15 Watching directory: "/etc/alertmanager/config"\n
Nov 08 10:58:58.628 E ns/openshift-monitoring pod/alertmanager-main-2 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=alertmanager-proxy container exited with code 2 (Error): 2019/11/08 10:32:15 provider.go:117: Defaulting client-id to system:serviceaccount:openshift-monitoring:alertmanager-main\n2019/11/08 10:32:15 provider.go:122: Defaulting client-secret to service account token /var/run/secrets/kubernetes.io/serviceaccount/token\n2019/11/08 10:32:15 provider.go:310: Delegation of authentication and authorization to OpenShift is enabled for bearer tokens and client certificates.\n2019/11/08 10:32:15 oauthproxy.go:200: mapping path "/" => upstream "http://localhost:9093/"\n2019/11/08 10:32:15 oauthproxy.go:221: compiled skip-auth-regex => "^/metrics"\n2019/11/08 10:32:15 oauthproxy.go:227: OAuthProxy configured for  Client ID: system:serviceaccount:openshift-monitoring:alertmanager-main\n2019/11/08 10:32:15 oauthproxy.go:237: Cookie settings: name:_oauth_proxy secure(https):true httponly:true expiry:168h0m0s domain:<default> refresh:disabled\n2019/11/08 10:32:15 http.go:96: HTTPS: listening on [::]:9095\n
Nov 08 10:59:59.026 E clusteroperator/dns changed Degraded to True: NotAllDNSesAvailable: Not all desired DNS DaemonSets available
Nov 08 11:00:11.381 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus container exited with code 1 (Error): caller=main.go:657 msg="Starting TSDB ..."\nlevel=info ts=2019-11-08T11:00:07.871Z caller=web.go:450 component=web msg="Start listening for connections" address=127.0.0.1:9090\nlevel=info ts=2019-11-08T11:00:07.884Z caller=head.go:514 component=tsdb msg="replaying WAL, this may take awhile"\nlevel=info ts=2019-11-08T11:00:07.884Z caller=head.go:562 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:672 fs_type=XFS_SUPER_MAGIC\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:673 msg="TSDB started"\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:743 msg="Loading configuration file" filename=/etc/prometheus/config_out/prometheus.env.yaml\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:526 msg="Stopping scrape discovery manager..."\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:540 msg="Stopping notify discovery manager..."\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:562 msg="Stopping scrape manager..."\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:536 msg="Notify discovery manager stopped"\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:522 msg="Scrape discovery manager stopped"\nlevel=info ts=2019-11-08T11:00:07.885Z caller=manager.go:814 component="rule manager" msg="Stopping rule manager..."\nlevel=info ts=2019-11-08T11:00:07.885Z caller=manager.go:820 component="rule manager" msg="Rule manager stopped"\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:556 msg="Scrape manager stopped"\nlevel=info ts=2019-11-08T11:00:07.906Z caller=notifier.go:602 component=notifier msg="Stopping notification manager..."\nlevel=info ts=2019-11-08T11:00:07.906Z caller=main.go:727 msg="Notifier manager stopped"\nlevel=error ts=2019-11-08
Nov 08 11:00:11.525 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus container exited with code 1 (Error): caller=main.go:657 msg="Starting TSDB ..."\nlevel=info ts=2019-11-08T11:00:07.179Z caller=head.go:514 component=tsdb msg="replaying WAL, this may take awhile"\nlevel=info ts=2019-11-08T11:00:07.179Z caller=head.go:562 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0\nlevel=info ts=2019-11-08T11:00:07.180Z caller=main.go:672 fs_type=XFS_SUPER_MAGIC\nlevel=info ts=2019-11-08T11:00:07.180Z caller=main.go:673 msg="TSDB started"\nlevel=info ts=2019-11-08T11:00:07.181Z caller=web.go:450 component=web msg="Start listening for connections" address=127.0.0.1:9090\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:743 msg="Loading configuration file" filename=/etc/prometheus/config_out/prometheus.env.yaml\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:526 msg="Stopping scrape discovery manager..."\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:540 msg="Stopping notify discovery manager..."\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:562 msg="Stopping scrape manager..."\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:536 msg="Notify discovery manager stopped"\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:522 msg="Scrape discovery manager stopped"\nlevel=info ts=2019-11-08T11:00:07.183Z caller=manager.go:814 component="rule manager" msg="Stopping rule manager..."\nlevel=info ts=2019-11-08T11:00:07.183Z caller=manager.go:820 component="rule manager" msg="Rule manager stopped"\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:556 msg="Scrape manager stopped"\nlevel=info ts=2019-11-08T11:00:07.191Z caller=notifier.go:602 component=notifier msg="Stopping notification manager..."\nlevel=info ts=2019-11-08T11:00:07.192Z caller=main.go:727 msg="Notifier manager stopped"\nlevel=error ts=2019-11-08
Nov 08 11:48:19.636 E ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 node/ci-op-7i03490c-09f59-zzxg9-master-1 container=oauth-openshift container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated

				

Timeline:

Nov 08 10:41:32.187 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "RouteHealthDegraded: failed to GET route: dial tcp 13.86.137.153:443: i/o timeout" to "" (3 times)
Nov 08 10:41:46.049 I ns/openshift-ingress service/router-default Ensuring load balancer (8 times)
Nov 08 10:41:46.643 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (5 times)
Nov 08 10:43:03.872 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (8 times)
Nov 08 10:43:03.909 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-000" not found) (3 times)
Nov 08 10:43:03.939 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-001" not found) (2 times)
Nov 08 10:43:04.260 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-002" not found) (2 times)
Nov 08 10:43:04.663 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-003" not found) (3 times)
Nov 08 10:44:57.198 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (3 times)
Nov 08 10:44:57.209 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-000" not found) (3 times)
Nov 08 10:44:57.389 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-001" not found) (8 times)
Nov 08 10:44:57.811 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-002" not found) (9 times)
Nov 08 10:44:58.186 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-003" not found) (10 times)
Nov 08 10:45:49.978 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "" to "RouteHealthDegraded: failed to GET route: dial tcp 13.86.137.153:443: i/o timeout" (6 times)
Nov 08 10:46:44.440 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (3 times)
Nov 08 10:46:44.461 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-000" not found) (5 times)
Nov 08 10:46:44.622 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-001" not found) (3 times)
Nov 08 10:46:45.028 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-002" not found) (6 times)
Nov 08 10:46:45.440 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-003" not found) (2 times)
Nov 08 10:46:46.643 I ns/openshift-ingress service/router-default Ensuring load balancer (9 times)
Nov 08 10:46:47.313 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (6 times)
Nov 08 10:48:16.555 W node/node1 deleted
Nov 08 10:51:47.325 I ns/openshift-ingress service/router-default Ensuring load balancer (10 times)
Nov 08 10:51:47.862 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (7 times)
Nov 08 10:53:03.887 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (14 times)
Nov 08 10:53:04.864 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (2 times)
Nov 08 10:54:57.197 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (4 times)
Nov 08 10:54:58.184 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (3 times)
Nov 08 10:56:44.443 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (4 times)
Nov 08 10:56:45.033 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (2 times)
Nov 08 10:56:47.859 I ns/openshift-ingress service/router-default Ensuring load balancer (11 times)
Nov 08 10:56:48.378 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (8 times)
Nov 08 10:58:53.067 I ns/openshift-monitoring pod/alertmanager-main-0 Marking for deletion Pod openshift-monitoring/alertmanager-main-0
Nov 08 10:58:53.112 W ns/openshift-monitoring pod/alertmanager-main-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 120s
Nov 08 10:58:53.112 W ns/openshift-machine-config-operator pod/machine-config-daemon-ls4r8 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 600s
Nov 08 10:58:53.112 W ns/openshift-image-registry pod/node-ca-6p5w4 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 10:58:53.142 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 600s
Nov 08 10:58:53.184 I ns/openshift-dns pod/dns-default-gv52j Marking for deletion Pod openshift-dns/dns-default-gv52j
Nov 08 10:58:53.184 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-ls4r8
Nov 08 10:58:53.184 W ns/openshift-ingress pod/router-default-595c859f98-w78dt node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 10:58:53.184 I ns/openshift-monitoring pod/alertmanager-main-0 Stopping container alertmanager-proxy
Nov 08 10:58:53.184 I ns/openshift-image-registry pod/node-ca-6p5w4 Marking for deletion Pod openshift-image-registry/node-ca-6p5w4
Nov 08 10:58:53.184 I ns/openshift-image-registry daemonset/node-ca Deleted pod: node-ca-6p5w4
Nov 08 10:58:53.184 I ns/openshift-machine-config-operator pod/machine-config-daemon-ls4r8 Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-ls4r8
Nov 08 10:58:53.184 I ns/openshift-monitoring pod/prometheus-k8s-1 Marking for deletion Pod openshift-monitoring/prometheus-k8s-1
Nov 08 10:58:53.184 W ns/openshift-dns pod/dns-default-gv52j node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 10:58:53.185 I ns/openshift-ingress pod/router-default-595c859f98-w78dt Marking for deletion Pod openshift-ingress/router-default-595c859f98-w78dt
Nov 08 10:58:53.185 I ns/openshift-monitoring pod/alertmanager-main-0 Stopping container config-reloader
Nov 08 10:58:53.199 I ns/openshift-ingress pod/router-default-595c859f98-5w8k6 node/ created
Nov 08 10:58:53.229 I ns/openshift-ingress replicaset/router-default-595c859f98 Created pod: router-default-595c859f98-5w8k6
Nov 08 10:58:53.243 I ns/openshift-monitoring pod/alertmanager-main-0 Stopping container alertmanager
Nov 08 10:58:53.268 I ns/openshift-image-registry pod/node-ca-6p5w4 Stopping container node-ca
Nov 08 10:58:53.293 I ns/openshift-ingress pod/router-default-595c859f98-5w8k6 Successfully assigned openshift-ingress/router-default-595c859f98-5w8k6 to ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn
Nov 08 10:58:53.293 I ns/openshift-machine-config-operator pod/machine-config-daemon-ls4r8 Stopping container oauth-proxy
Nov 08 10:58:53.314 I ns/openshift-monitoring pod/grafana-85bf74556f-kqv6c Marking for deletion Pod openshift-monitoring/grafana-85bf74556f-kqv6c
Nov 08 10:58:53.314 I ns/openshift-machine-config-operator pod/machine-config-daemon-ls4r8 Stopping container machine-config-daemon
Nov 08 10:58:53.342 W ns/openshift-image-registry pod/node-ca-tn4qt node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn graceful deletion within 30s
Nov 08 10:58:53.343 W ns/openshift-dns pod/dns-default-bddrz node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn graceful deletion within 30s
Nov 08 10:58:53.346 I ns/openshift-dns pod/dns-default-gv52j Stopping container dns
Nov 08 10:58:53.347 I ns/openshift-machine-config-operator pod/machine-config-daemon-27kgg Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-27kgg
Nov 08 10:58:53.347 W ns/openshift-machine-config-operator pod/machine-config-daemon-27kgg node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn graceful deletion within 600s
Nov 08 10:58:53.351 W ns/openshift-monitoring pod/alertmanager-main-2 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn graceful deletion within 120s
Nov 08 10:58:53.353 W ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn graceful deletion within 600s
Nov 08 10:58:53.354 W ns/openshift-ingress pod/router-default-595c859f98-5w8k6 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn graceful deletion within 30s
Nov 08 10:58:53.355 W ns/openshift-monitoring pod/grafana-85bf74556f-kqv6c node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn graceful deletion within 30s
Nov 08 10:58:53.365 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-27kgg
Nov 08 10:58:53.376 I ns/openshift-monitoring pod/prometheus-k8s-1 Stopping container prometheus-config-reloader
Nov 08 10:58:53.376 I ns/openshift-image-registry pod/node-ca-tn4qt Stopping container node-ca
Nov 08 10:58:53.376 I ns/openshift-image-registry pod/node-ca-tn4qt Marking for deletion Pod openshift-image-registry/node-ca-tn4qt
Nov 08 10:58:53.387 I ns/openshift-dns daemonset/dns-default Deleted pod: dns-default-bddrz
Nov 08 10:58:53.392 I ns/openshift-dns pod/dns-default-bddrz Stopping container dns-node-resolver
Nov 08 10:58:53.407 I ns/openshift-dns pod/dns-default-bddrz Marking for deletion Pod openshift-dns/dns-default-bddrz
Nov 08 10:58:53.407 I ns/openshift-ingress pod/router-default-595c859f98-w78dt Stopping container router
Nov 08 10:58:53.417 I ns/openshift-ingress pod/router-default-595c859f98-5w8k6 Marking for deletion Pod openshift-ingress/router-default-595c859f98-5w8k6
Nov 08 10:58:53.428 I ns/openshift-dns pod/dns-default-gv52j Stopping container dns-node-resolver
Nov 08 10:58:53.428 I ns/openshift-monitoring pod/alertmanager-main-2 Marking for deletion Pod openshift-monitoring/alertmanager-main-2
Nov 08 10:58:53.440 I ns/openshift-monitoring pod/prometheus-k8s-0 Marking for deletion Pod openshift-monitoring/prometheus-k8s-0
Nov 08 10:58:53.457 I ns/openshift-ingress pod/router-default-595c859f98-2kwcs node/ created
Nov 08 10:58:53.466 W ns/openshift-ingress pod/router-default-595c859f98-2kwcs 0/6 nodes are available: 1 node(s) didn't match pod affinity/anti-affinity, 1 node(s) didn't satisfy existing pods anti-affinity rules, 2 node(s) had taints that the pod didn't tolerate, 3 node(s) didn't match node selector.
Nov 08 10:58:53.479 I ns/openshift-monitoring pod/prometheus-k8s-1 Stopping container prometheus
Nov 08 10:58:53.479 I ns/openshift-ingress replicaset/router-default-595c859f98 Created pod: router-default-595c859f98-2kwcs
Nov 08 10:58:53.494 I ns/openshift-monitoring pod/prometheus-k8s-1 Stopping container prom-label-proxy
Nov 08 10:58:53.534 I ns/openshift-monitoring pod/grafana-85bf74556f-cfrdb node/ created
Nov 08 10:58:53.546 I ns/openshift-monitoring replicaset/grafana-85bf74556f Created pod: grafana-85bf74556f-cfrdb
Nov 08 10:58:53.582 I ns/openshift-dns pod/dns-default-bddrz Stopping container dns
Nov 08 10:58:53.653 I ns/openshift-machine-config-operator pod/machine-config-daemon-27kgg Stopping container machine-config-daemon
Nov 08 10:58:53.659 I ns/openshift-monitoring pod/grafana-85bf74556f-cfrdb Successfully assigned openshift-monitoring/grafana-85bf74556f-cfrdb to ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4
Nov 08 10:58:53.677 W clusteroperator/ingress changed Available to False: IngressUnavailable: Not all ingress controllers are available.
Nov 08 10:58:53.677 W clusteroperator/ingress changed Progressing to True: Reconciling: Not all ingress controllers are available.
Nov 08 10:58:53.679 I ns/openshift-machine-config-operator pod/machine-config-daemon-27kgg Stopping container oauth-proxy
Nov 08 10:58:53.714 I ns/openshift-monitoring pod/prometheus-k8s-0 Stopping container prometheus
Nov 08 10:58:53.721 I ns/openshift-monitoring pod/prometheus-k8s-1 Stopping container kube-rbac-proxy
Nov 08 10:58:53.752 I ns/openshift-monitoring pod/prometheus-k8s-0 Stopping container prom-label-proxy
Nov 08 10:58:53.767 I ns/openshift-monitoring pod/prometheus-k8s-0 Stopping container kube-rbac-proxy
Nov 08 10:58:53.785 I ns/openshift-monitoring pod/prometheus-k8s-0 Stopping container prometheus-proxy
Nov 08 10:58:53.812 I ns/openshift-monitoring pod/prometheus-k8s-0 Stopping container thanos-sidecar
Nov 08 10:58:53.828 I ns/openshift-monitoring pod/alertmanager-main-2 Stopping container alertmanager-proxy
Nov 08 10:58:53.837 I ns/openshift-monitoring pod/alertmanager-main-2 Stopping container config-reloader
Nov 08 10:58:53.870 E ns/openshift-ingress pod/router-default-595c859f98-5w8k6 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=router container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:53.891 I ns/openshift-monitoring pod/prometheus-k8s-1 Stopping container prometheus-proxy
Nov 08 10:58:53.971 I ns/openshift-monitoring pod/alertmanager-main-2 Stopping container alertmanager
Nov 08 10:58:54.173 I ns/openshift-monitoring pod/grafana-85bf74556f-kqv6c Stopping container grafana
Nov 08 10:58:54.363 I ns/openshift-monitoring pod/grafana-85bf74556f-kqv6c Stopping container grafana-proxy
Nov 08 10:58:55.938 W ns/openshift-monitoring pod/grafana-85bf74556f-kqv6c Readiness probe failed: dial tcp 10.128.2.7:3000: connect: connection refused
Nov 08 10:58:56.812 E ns/openshift-ingress pod/router-default-595c859f98-w78dt node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=router container exited with code 2 (Error): Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:35:03.015Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:35:07.997Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:35:27.873Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:35:32.825Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:36:46.129Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:36:54.675Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:48:15.429Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:48:20.448Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:48:43.891Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:48:48.834Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n2019-11-08T10:58:53.241Z	INFO	router.template	template/router.go:548	router reloaded	{"output": " - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n"}\n
Nov 08 10:58:56.842 W ns/openshift-monitoring pod/alertmanager-main-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 10:58:56.842 W ns/openshift-monitoring pod/alertmanager-main-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=alertmanager container stopped being ready
Nov 08 10:58:56.842 W ns/openshift-monitoring pod/alertmanager-main-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=alertmanager-proxy container stopped being ready
Nov 08 10:58:56.842 W ns/openshift-monitoring pod/alertmanager-main-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=config-reloader container stopped being ready
Nov 08 10:58:56.936 E ns/openshift-machine-config-operator pod/machine-config-daemon-ls4r8 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=oauth-proxy container exited with code 143 (Error): 
Nov 08 10:58:57.621 E ns/openshift-monitoring pod/grafana-85bf74556f-kqv6c node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=grafana-proxy container exited with code 2 (Error): 
Nov 08 10:58:57.694 W ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 10:58:57.694 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus container exited with code 1 (Error): caller=main.go:657 msg="Starting TSDB ..."\nlevel=info ts=2019-11-08T10:29:46.363Z caller=web.go:450 component=web msg="Start listening for connections" address=127.0.0.1:9090\nlevel=info ts=2019-11-08T10:29:46.378Z caller=head.go:514 component=tsdb msg="replaying WAL, this may take awhile"\nlevel=info ts=2019-11-08T10:29:46.378Z caller=head.go:562 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:672 fs_type=XFS_SUPER_MAGIC\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:673 msg="TSDB started"\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:743 msg="Loading configuration file" filename=/etc/prometheus/config_out/prometheus.env.yaml\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:526 msg="Stopping scrape discovery manager..."\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:540 msg="Stopping notify discovery manager..."\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:562 msg="Stopping scrape manager..."\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:536 msg="Notify discovery manager stopped"\nlevel=info ts=2019-11-08T10:29:46.379Z caller=main.go:522 msg="Scrape discovery manager stopped"\nlevel=info ts=2019-11-08T10:29:46.380Z caller=main.go:556 msg="Scrape manager stopped"\nlevel=info ts=2019-11-08T10:29:46.380Z caller=manager.go:814 component="rule manager" msg="Stopping rule manager..."\nlevel=info ts=2019-11-08T10:29:46.380Z caller=manager.go:820 component="rule manager" msg="Rule manager stopped"\nlevel=info ts=2019-11-08T10:29:46.390Z caller=notifier.go:602 component=notifier msg="Stopping notification manager..."\nlevel=info ts=2019-11-08T10:29:46.390Z caller=main.go:727 msg="Notifier manager stopped"\nlevel=error ts=2019-11-08
Nov 08 10:58:57.694 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=rules-configmap-reloader container exited with code 2 (Error): 2019/11/08 10:29:54 Watching directory: "/etc/prometheus/rules/prometheus-k8s-rulefiles-0"\n2019/11/08 10:35:34 config map updated\n2019/11/08 10:35:34 successfully triggered reload\n
Nov 08 10:58:57.694 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus-config-reloader container exited with code 2 (Error): ts=2019-11-08T10:29:50.687672176Z caller=main.go:85 msg="Starting prometheus-config-reloader version '0.34.0'."\nlevel=info ts=2019-11-08T10:29:50.688145494Z caller=reloader.go:127 msg="started watching config file for changes" in=/etc/prometheus/config/prometheus.yaml.gz out=/etc/prometheus/config_out/prometheus.env.yaml\nlevel=error ts=2019-11-08T10:29:50.697755459Z caller=runutil.go:87 msg="function failed. Retrying in next tick" err="trigger reload: reload request failed: Post http://localhost:9090/-/reload: dial tcp [::1]:9090: connect: connection refused"\nlevel=error ts=2019-11-08T10:29:55.690768709Z caller=runutil.go:87 msg="function failed. Retrying in next tick" err="trigger reload: reload request failed: Post http://localhost:9090/-/reload: dial tcp [::1]:9090: connect: connection refused"\nlevel=error ts=2019-11-08T10:30:00.69064772Z caller=runutil.go:87 msg="function failed. Retrying in next tick" err="trigger reload: reload request failed: Post http://localhost:9090/-/reload: dial tcp [::1]:9090: connect: connection refused"\nlevel=error ts=2019-11-08T10:30:05.690371225Z caller=runutil.go:87 msg="function failed. Retrying in next tick" err="trigger reload: reload request failed: Post http://localhost:9090/-/reload: dial tcp [::1]:9090: connect: connection refused"\nlevel=info ts=2019-11-08T10:30:10.93625069Z caller=reloader.go:258 msg="Prometheus reload triggered" cfg_in=/etc/prometheus/config/prometheus.yaml.gz cfg_out=/etc/prometheus/config_out/prometheus.env.yaml rule_dirs=\nlevel=info ts=2019-11-08T10:30:11.161064038Z caller=reloader.go:258 msg="Prometheus reload triggered" cfg_in=/etc/prometheus/config/prometheus.yaml.gz cfg_out=/etc/prometheus/config_out/prometheus.env.yaml rule_dirs=\nlevel=info ts=2019-11-08T10:
Nov 08 10:58:57.694 W ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus container restarted
Nov 08 10:58:57.694 W ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus-proxy container stopped being ready
Nov 08 10:58:57.694 W ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prom-label-proxy container stopped being ready
Nov 08 10:58:57.694 W ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=kube-rbac-proxy container stopped being ready
Nov 08 10:58:57.721 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=kube-rbac-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.721 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prom-label-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.721 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.732 W ns/openshift-image-registry pod/node-ca-tn4qt node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 10:58:57.732 W ns/openshift-image-registry pod/node-ca-tn4qt node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=node-ca container stopped being ready
Nov 08 10:58:57.770 E ns/openshift-machine-config-operator pod/machine-config-daemon-27kgg node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=oauth-proxy container exited with code 143 (Error): 
Nov 08 10:58:57.878 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 10:58:57.878 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prometheus-proxy container stopped being ready
Nov 08 10:58:57.878 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=thanos-sidecar container stopped being ready
Nov 08 10:58:57.878 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prom-label-proxy container stopped being ready
Nov 08 10:58:57.878 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prometheus-config-reloader container stopped being ready
Nov 08 10:58:57.878 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=kube-rbac-proxy container stopped being ready
Nov 08 10:58:57.878 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=rules-configmap-reloader container stopped being ready
Nov 08 10:58:57.878 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prometheus container stopped being ready
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=rules-configmap-reloader container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=thanos-sidecar container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prometheus container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prom-label-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=kube-rbac-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prometheus-config-reloader container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:57.918 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=prometheus-proxy container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 10:58:58.628 E ns/openshift-monitoring pod/alertmanager-main-2 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=config-reloader container exited with code 2 (Error): 2019/11/08 10:32:15 Watching directory: "/etc/alertmanager/config"\n
Nov 08 10:58:58.628 E ns/openshift-monitoring pod/alertmanager-main-2 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=alertmanager-proxy container exited with code 2 (Error): 2019/11/08 10:32:15 provider.go:117: Defaulting client-id to system:serviceaccount:openshift-monitoring:alertmanager-main\n2019/11/08 10:32:15 provider.go:122: Defaulting client-secret to service account token /var/run/secrets/kubernetes.io/serviceaccount/token\n2019/11/08 10:32:15 provider.go:310: Delegation of authentication and authorization to OpenShift is enabled for bearer tokens and client certificates.\n2019/11/08 10:32:15 oauthproxy.go:200: mapping path "/" => upstream "http://localhost:9093/"\n2019/11/08 10:32:15 oauthproxy.go:221: compiled skip-auth-regex => "^/metrics"\n2019/11/08 10:32:15 oauthproxy.go:227: OAuthProxy configured for  Client ID: system:serviceaccount:openshift-monitoring:alertmanager-main\n2019/11/08 10:32:15 oauthproxy.go:237: Cookie settings: name:_oauth_proxy secure(https):true httponly:true expiry:168h0m0s domain:<default> refresh:disabled\n2019/11/08 10:32:15 http.go:96: HTTPS: listening on [::]:9095\n
Nov 08 10:59:01.088 I ns/openshift-monitoring pod/grafana-85bf74556f-cfrdb Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705"
Nov 08 10:59:03.192 W ns/openshift-ingress pod/router-default-595c859f98-2kwcs 0/6 nodes are available: 1 node(s) didn't match pod affinity/anti-affinity, 1 node(s) didn't satisfy existing pods anti-affinity rules, 2 node(s) had taints that the pod didn't tolerate, 3 node(s) didn't match node selector.
Nov 08 10:59:03.194 W ns/openshift-ingress pod/router-default-595c859f98-w78dt node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 10:59:03.265 W ns/openshift-dns pod/dns-default-gv52j node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 10:59:03.279 W ns/openshift-image-registry pod/node-ca-6p5w4 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 10:59:03.342 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 10:59:03.381 W ns/openshift-monitoring pod/alertmanager-main-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 10:59:03.445 I ns/openshift-monitoring pod/alertmanager-main-0 node/ created
Nov 08 10:59:03.477 I ns/openshift-monitoring pod/prometheus-k8s-1 node/ created
Nov 08 10:59:03.478 I ns/openshift-monitoring statefulset/alertmanager-main create Pod alertmanager-main-0 in StatefulSet alertmanager-main successful (2 times)
Nov 08 10:59:03.485 I ns/openshift-monitoring pod/alertmanager-main-0 Successfully assigned openshift-monitoring/alertmanager-main-0 to ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4
Nov 08 10:59:03.496 I ns/openshift-monitoring statefulset/prometheus-k8s create Pod prometheus-k8s-1 in StatefulSet prometheus-k8s successful
Nov 08 10:59:03.503 W ns/openshift-monitoring pod/prometheus-k8s-1 0/6 nodes are available: 2 Insufficient cpu, 4 node(s) had taints that the pod didn't tolerate.
Nov 08 10:59:03.538 W ns/openshift-monitoring pod/prometheus-k8s-1 0/6 nodes are available: 2 Insufficient cpu, 4 node(s) had taints that the pod didn't tolerate.
Nov 08 10:59:05.720 W ns/openshift-ingress pod/router-default-595c859f98-2kwcs 0/6 nodes are available: 1 node(s) didn't match pod affinity/anti-affinity, 1 node(s) didn't satisfy existing pods anti-affinity rules, 2 node(s) had taints that the pod didn't tolerate, 3 node(s) didn't match node selector.
Nov 08 10:59:07.167 W ns/openshift-machine-config-operator pod/machine-config-daemon-27kgg node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn deleted
Nov 08 10:59:07.230 W ns/openshift-monitoring pod/prometheus-k8s-1 0/6 nodes are available: 2 Insufficient cpu, 4 node(s) had taints that the pod didn't tolerate.
Nov 08 10:59:07.231 W ns/openshift-image-registry pod/node-ca-tn4qt node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn deleted
Nov 08 10:59:07.304 W ns/openshift-monitoring pod/alertmanager-main-2 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn deleted
Nov 08 10:59:07.314 W ns/openshift-dns pod/dns-default-bddrz node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn deleted
Nov 08 10:59:07.362 I ns/openshift-monitoring pod/alertmanager-main-2 node/ created
Nov 08 10:59:07.385 I ns/openshift-monitoring statefulset/alertmanager-main create Pod alertmanager-main-2 in StatefulSet alertmanager-main successful (2 times)
Nov 08 10:59:07.403 W ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn deleted
Nov 08 10:59:07.406 I ns/openshift-monitoring pod/alertmanager-main-2 Successfully assigned openshift-monitoring/alertmanager-main-2 to ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4
Nov 08 10:59:07.472 W ns/openshift-monitoring pod/grafana-85bf74556f-kqv6c node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn deleted
Nov 08 10:59:07.528 W ns/openshift-ingress pod/router-default-595c859f98-5w8k6 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn deleted
Nov 08 10:59:07.566 I ns/openshift-monitoring pod/prometheus-k8s-0 node/ created
Nov 08 10:59:07.579 I ns/openshift-monitoring statefulset/prometheus-k8s create Pod prometheus-k8s-0 in StatefulSet prometheus-k8s successful
Nov 08 10:59:07.594 W ns/openshift-monitoring pod/prometheus-k8s-0 0/6 nodes are available: 1 Insufficient cpu, 5 node(s) had taints that the pod didn't tolerate.
Nov 08 10:59:12.035 I ns/openshift-monitoring pod/alertmanager-main-0 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736" already present on machine
Nov 08 10:59:12.284 I ns/openshift-monitoring pod/grafana-85bf74556f-cfrdb Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705"
Nov 08 10:59:12.730 I ns/openshift-monitoring pod/grafana-85bf74556f-cfrdb Created container grafana
Nov 08 10:59:12.738 I ns/openshift-monitoring pod/alertmanager-main-0 Created container alertmanager
Nov 08 10:59:12.839 I ns/openshift-monitoring pod/grafana-85bf74556f-cfrdb Started container grafana
Nov 08 10:59:12.846 I ns/openshift-monitoring pod/grafana-85bf74556f-cfrdb Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 10:59:12.859 I ns/openshift-monitoring pod/alertmanager-main-0 Started container alertmanager
Nov 08 10:59:12.913 I ns/openshift-monitoring pod/alertmanager-main-0 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d" already present on machine
Nov 08 10:59:13.142 I ns/openshift-monitoring pod/grafana-85bf74556f-cfrdb Created container grafana-proxy
Nov 08 10:59:13.186 I ns/openshift-monitoring pod/grafana-85bf74556f-cfrdb Started container grafana-proxy
Nov 08 10:59:13.450 I ns/openshift-monitoring pod/alertmanager-main-0 Created container config-reloader
Nov 08 10:59:13.475 I ns/openshift-monitoring pod/alertmanager-main-0 Started container config-reloader
Nov 08 10:59:13.492 I ns/openshift-monitoring pod/alertmanager-main-0 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 10:59:13.764 I ns/openshift-monitoring pod/alertmanager-main-0 Created container alertmanager-proxy
Nov 08 10:59:13.826 I ns/openshift-monitoring pod/alertmanager-main-0 Started container alertmanager-proxy
Nov 08 10:59:15.860 I ns/openshift-monitoring pod/alertmanager-main-2 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736" already present on machine
Nov 08 10:59:16.109 I ns/openshift-monitoring pod/alertmanager-main-2 Created container alertmanager
Nov 08 10:59:16.135 I ns/openshift-monitoring pod/alertmanager-main-2 Started container alertmanager
Nov 08 10:59:16.143 I ns/openshift-monitoring pod/alertmanager-main-2 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d" already present on machine
Nov 08 10:59:16.459 I ns/openshift-monitoring pod/alertmanager-main-2 Created container config-reloader
Nov 08 10:59:16.492 I ns/openshift-monitoring pod/alertmanager-main-2 Started container config-reloader
Nov 08 10:59:16.499 I ns/openshift-monitoring pod/alertmanager-main-2 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 10:59:17.147 I ns/openshift-monitoring pod/alertmanager-main-2 Created container alertmanager-proxy
Nov 08 10:59:17.195 I ns/openshift-monitoring pod/alertmanager-main-2 Started container alertmanager-proxy
Nov 08 10:59:43.129 W ns/openshift-machine-config-operator pod/machine-config-daemon-ls4r8 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 10:59:43.191 W ns/openshift-monitoring pod/prometheus-k8s-0 0/6 nodes are available: 1 Insufficient cpu, 5 node(s) had taints that the pod didn't tolerate.
Nov 08 10:59:43.191 W ns/openshift-monitoring pod/prometheus-k8s-1 0/6 nodes are available: 1 Insufficient cpu, 5 node(s) had taints that the pod didn't tolerate.
Nov 08 10:59:53.162 W ns/openshift-ingress pod/router-default-595c859f98-2kwcs node/ pod has been pending longer than a minute
Nov 08 10:59:58.693 I ns/openshift-monitoring pod/prometheus-k8s-1 Successfully assigned openshift-monitoring/prometheus-k8s-1 to ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn
Nov 08 10:59:58.693 I ns/openshift-monitoring pod/prometheus-k8s-0 Successfully assigned openshift-monitoring/prometheus-k8s-0 to ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn
Nov 08 10:59:58.693 I ns/openshift-ingress pod/router-default-595c859f98-2kwcs Successfully assigned openshift-ingress/router-default-595c859f98-2kwcs to ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn
Nov 08 10:59:58.693 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-qcvjj
Nov 08 10:59:58.693 I ns/openshift-machine-config-operator pod/machine-config-daemon-qcvjj Successfully assigned openshift-machine-config-operator/machine-config-daemon-qcvjj to ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn
Nov 08 10:59:58.694 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-2c8hj
Nov 08 10:59:58.694 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-vdjd4
Nov 08 10:59:58.694 I ns/openshift-machine-config-operator pod/machine-config-daemon-qcvjj node/ created
Nov 08 10:59:58.694 I ns/openshift-image-registry pod/node-ca-2c8hj node/ created
Nov 08 10:59:58.695 I ns/openshift-dns pod/dns-default-vdjd4 node/ created
Nov 08 10:59:58.727 I ns/openshift-image-registry pod/node-ca-2c8hj Successfully assigned openshift-image-registry/node-ca-2c8hj to ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn
Nov 08 10:59:58.765 I ns/openshift-dns pod/dns-default-vdjd4 Successfully assigned openshift-dns/dns-default-vdjd4 to ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn
Nov 08 10:59:58.804 I ns/openshift-machine-config-operator pod/machine-config-daemon-x427v node/ created
Nov 08 10:59:58.825 I ns/openshift-machine-config-operator pod/machine-config-daemon-x427v Successfully assigned openshift-machine-config-operator/machine-config-daemon-x427v to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 10:59:58.828 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-x427v
Nov 08 10:59:58.840 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available.
Nov 08 10:59:58.849 I ns/openshift-dns pod/dns-default-5djcm node/ created
Nov 08 10:59:58.863 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-5djcm
Nov 08 10:59:58.881 I ns/openshift-dns pod/dns-default-5djcm Successfully assigned openshift-dns/dns-default-5djcm to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 10:59:58.903 I ns/openshift-image-registry pod/node-ca-rkf8x node/ created
Nov 08 10:59:58.909 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-rkf8x
Nov 08 10:59:58.935 I ns/openshift-image-registry pod/node-ca-rkf8x Successfully assigned openshift-image-registry/node-ca-rkf8x to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 10:59:59.026 E clusteroperator/dns changed Degraded to True: NotAllDNSesAvailable: Not all desired DNS DaemonSets available
Nov 08 10:59:59.943 I ns/openshift-machine-config-operator pod/machine-config-daemon-x427v Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6" already present on machine
Nov 08 11:00:00.242 I ns/openshift-machine-config-operator pod/machine-config-daemon-x427v Created container machine-config-daemon
Nov 08 11:00:00.331 I ns/openshift-machine-config-operator pod/machine-config-daemon-x427v Started container machine-config-daemon
Nov 08 11:00:00.342 I ns/openshift-machine-config-operator pod/machine-config-daemon-x427v Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 11:00:00.644 I ns/openshift-machine-config-operator pod/machine-config-daemon-x427v Created container oauth-proxy
Nov 08 11:00:00.679 I ns/openshift-machine-config-operator pod/machine-config-daemon-x427v Started container oauth-proxy
Nov 08 11:00:00.790 I ns/openshift-machine-config-operator pod/machine-config-daemon-qcvjj Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6" already present on machine
Nov 08 11:00:01.038 I ns/openshift-machine-config-operator pod/machine-config-daemon-qcvjj Created container machine-config-daemon
Nov 08 11:00:01.097 I ns/openshift-machine-config-operator pod/machine-config-daemon-qcvjj Started container machine-config-daemon
Nov 08 11:00:01.114 I ns/openshift-machine-config-operator pod/machine-config-daemon-qcvjj Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 11:00:01.547 I ns/openshift-machine-config-operator pod/machine-config-daemon-qcvjj Created container oauth-proxy
Nov 08 11:00:01.605 I ns/openshift-machine-config-operator pod/machine-config-daemon-qcvjj Started container oauth-proxy
Nov 08 11:00:06.889 I ns/openshift-monitoring pod/prometheus-k8s-1 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757" already present on machine
Nov 08 11:00:06.908 I ns/openshift-dns pod/dns-default-5djcm Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2" already present on machine
Nov 08 11:00:07.115 I ns/openshift-monitoring pod/prometheus-k8s-1 Created container prometheus
Nov 08 11:00:07.158 I ns/openshift-dns pod/dns-default-5djcm Created container dns
Nov 08 11:00:07.176 I ns/openshift-monitoring pod/prometheus-k8s-1 Started container prometheus
Nov 08 11:00:07.184 I ns/openshift-monitoring pod/prometheus-k8s-1 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade" already present on machine
Nov 08 11:00:07.204 I ns/openshift-dns pod/dns-default-5djcm Started container dns
Nov 08 11:00:07.211 I ns/openshift-dns pod/dns-default-5djcm Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29" already present on machine
Nov 08 11:00:07.301 I ns/openshift-monitoring pod/prometheus-k8s-0 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757" already present on machine
Nov 08 11:00:07.416 I ns/openshift-dns pod/dns-default-5djcm Created container dns-node-resolver
Nov 08 11:00:07.454 I ns/openshift-dns pod/dns-default-5djcm Started container dns-node-resolver
Nov 08 11:00:07.512 I ns/openshift-monitoring pod/prometheus-k8s-1 Created container prometheus-config-reloader
Nov 08 11:00:07.623 I ns/openshift-monitoring pod/prometheus-k8s-1 Started container prometheus-config-reloader
Nov 08 11:00:07.640 I ns/openshift-monitoring pod/prometheus-k8s-1 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d" already present on machine
Nov 08 11:00:07.736 I ns/openshift-ingress pod/router-default-595c859f98-2kwcs Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35"
Nov 08 11:00:07.790 I ns/openshift-monitoring pod/prometheus-k8s-0 Created container prometheus
Nov 08 11:00:07.848 I ns/openshift-monitoring pod/prometheus-k8s-0 Started container prometheus
Nov 08 11:00:07.860 I ns/openshift-monitoring pod/prometheus-k8s-0 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade" already present on machine
Nov 08 11:00:07.909 I ns/openshift-image-registry pod/node-ca-rkf8x Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee" already present on machine
Nov 08 11:00:08.147 I ns/openshift-monitoring pod/prometheus-k8s-1 Created container rules-configmap-reloader
Nov 08 11:00:08.162 W ns/openshift-ingress pod/router-default-595c859f98-2kwcs node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn pod has been pending longer than a minute
Nov 08 11:00:08.162 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn pod has been pending longer than a minute
Nov 08 11:00:08.162 W ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn pod has been pending longer than a minute
Nov 08 11:00:08.189 I ns/openshift-image-registry pod/node-ca-rkf8x Created container node-ca
Nov 08 11:00:08.201 I ns/openshift-monitoring pod/prometheus-k8s-1 Started container rules-configmap-reloader
Nov 08 11:00:08.220 I ns/openshift-monitoring pod/prometheus-k8s-1 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55" already present on machine
Nov 08 11:00:08.229 I ns/openshift-image-registry pod/node-ca-rkf8x Started container node-ca
Nov 08 11:00:08.236 I ns/openshift-monitoring pod/prometheus-k8s-0 Created container prometheus-config-reloader
Nov 08 11:00:08.311 I ns/openshift-monitoring pod/prometheus-k8s-0 Started container prometheus-config-reloader
Nov 08 11:00:08.516 I ns/openshift-image-registry pod/node-ca-2c8hj Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee" already present on machine
Nov 08 11:00:08.722 I ns/openshift-monitoring pod/prometheus-k8s-0 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d" already present on machine
Nov 08 11:00:08.928 I ns/openshift-monitoring pod/prometheus-k8s-1 Created container thanos-sidecar
Nov 08 11:00:09.125 I ns/openshift-monitoring pod/prometheus-k8s-1 Started container thanos-sidecar
Nov 08 11:00:09.294 I ns/kube-system pod/pod0-system-node-critical node/ created
Nov 08 11:00:09.312 I ns/openshift-dns pod/dns-default-vdjd4 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2" already present on machine
Nov 08 11:00:09.323 I ns/kube-system pod/pod0-system-node-critical Successfully assigned kube-system/pod0-system-node-critical to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:00:09.375 I ns/kube-system pod/pod1-system-cluster-critical node/ created
Nov 08 11:00:09.390 I ns/kube-system pod/pod1-system-cluster-critical Successfully assigned kube-system/pod1-system-cluster-critical to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:00:09.460 W ns/kube-system pod/pod1-system-cluster-critical node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 0s
Nov 08 11:00:09.467 W ns/kube-system pod/pod1-system-cluster-critical node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:00:09.522 I ns/openshift-monitoring pod/prometheus-k8s-1 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 11:00:09.558 W ns/kube-system pod/pod0-system-node-critical node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 0s
Nov 08 11:00:09.565 W ns/kube-system pod/pod0-system-node-critical node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:00:09.712 I ns/openshift-image-registry pod/node-ca-2c8hj Created container node-ca
Nov 08 11:00:09.911 I ns/openshift-image-registry pod/node-ca-2c8hj Started container node-ca
Nov 08 11:00:10.124 I ns/openshift-monitoring pod/prometheus-k8s-0 Created container rules-configmap-reloader
Nov 08 11:00:10.315 I ns/openshift-monitoring pod/prometheus-k8s-0 Started container rules-configmap-reloader
Nov 08 11:00:10.512 I ns/openshift-monitoring pod/prometheus-k8s-0 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55" already present on machine
Nov 08 11:00:10.711 I ns/openshift-dns pod/dns-default-vdjd4 Created container dns
Nov 08 11:00:10.912 I ns/openshift-dns pod/dns-default-vdjd4 Started container dns
Nov 08 11:00:11.112 I ns/openshift-dns pod/dns-default-vdjd4 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29" already present on machine
Nov 08 11:00:11.312 I ns/openshift-monitoring pod/prometheus-k8s-1 Created container prometheus-proxy
Nov 08 11:00:11.381 E ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus container exited with code 1 (Error): caller=main.go:657 msg="Starting TSDB ..."\nlevel=info ts=2019-11-08T11:00:07.871Z caller=web.go:450 component=web msg="Start listening for connections" address=127.0.0.1:9090\nlevel=info ts=2019-11-08T11:00:07.884Z caller=head.go:514 component=tsdb msg="replaying WAL, this may take awhile"\nlevel=info ts=2019-11-08T11:00:07.884Z caller=head.go:562 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:672 fs_type=XFS_SUPER_MAGIC\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:673 msg="TSDB started"\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:743 msg="Loading configuration file" filename=/etc/prometheus/config_out/prometheus.env.yaml\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:526 msg="Stopping scrape discovery manager..."\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:540 msg="Stopping notify discovery manager..."\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:562 msg="Stopping scrape manager..."\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:536 msg="Notify discovery manager stopped"\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:522 msg="Scrape discovery manager stopped"\nlevel=info ts=2019-11-08T11:00:07.885Z caller=manager.go:814 component="rule manager" msg="Stopping rule manager..."\nlevel=info ts=2019-11-08T11:00:07.885Z caller=manager.go:820 component="rule manager" msg="Rule manager stopped"\nlevel=info ts=2019-11-08T11:00:07.885Z caller=main.go:556 msg="Scrape manager stopped"\nlevel=info ts=2019-11-08T11:00:07.906Z caller=notifier.go:602 component=notifier msg="Stopping notification manager..."\nlevel=info ts=2019-11-08T11:00:07.906Z caller=main.go:727 msg="Notifier manager stopped"\nlevel=error ts=2019-11-08
Nov 08 11:00:11.519 I ns/openshift-monitoring pod/prometheus-k8s-1 Started container prometheus-proxy
Nov 08 11:00:11.525 E ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus container exited with code 1 (Error): caller=main.go:657 msg="Starting TSDB ..."\nlevel=info ts=2019-11-08T11:00:07.179Z caller=head.go:514 component=tsdb msg="replaying WAL, this may take awhile"\nlevel=info ts=2019-11-08T11:00:07.179Z caller=head.go:562 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0\nlevel=info ts=2019-11-08T11:00:07.180Z caller=main.go:672 fs_type=XFS_SUPER_MAGIC\nlevel=info ts=2019-11-08T11:00:07.180Z caller=main.go:673 msg="TSDB started"\nlevel=info ts=2019-11-08T11:00:07.181Z caller=web.go:450 component=web msg="Start listening for connections" address=127.0.0.1:9090\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:743 msg="Loading configuration file" filename=/etc/prometheus/config_out/prometheus.env.yaml\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:526 msg="Stopping scrape discovery manager..."\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:540 msg="Stopping notify discovery manager..."\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:562 msg="Stopping scrape manager..."\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:536 msg="Notify discovery manager stopped"\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:522 msg="Scrape discovery manager stopped"\nlevel=info ts=2019-11-08T11:00:07.183Z caller=manager.go:814 component="rule manager" msg="Stopping rule manager..."\nlevel=info ts=2019-11-08T11:00:07.183Z caller=manager.go:820 component="rule manager" msg="Rule manager stopped"\nlevel=info ts=2019-11-08T11:00:07.183Z caller=main.go:556 msg="Scrape manager stopped"\nlevel=info ts=2019-11-08T11:00:07.191Z caller=notifier.go:602 component=notifier msg="Stopping notification manager..."\nlevel=info ts=2019-11-08T11:00:07.192Z caller=main.go:727 msg="Notifier manager stopped"\nlevel=error ts=2019-11-08
Nov 08 11:00:11.715 I ns/openshift-monitoring pod/prometheus-k8s-1 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8" already present on machine
Nov 08 11:00:11.914 I ns/openshift-monitoring pod/prometheus-k8s-0 Created container thanos-sidecar
Nov 08 11:00:12.112 I ns/openshift-monitoring pod/prometheus-k8s-0 Started container thanos-sidecar
Nov 08 11:00:12.323 I ns/openshift-monitoring pod/prometheus-k8s-0 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 11:00:12.516 I ns/openshift-dns pod/dns-default-vdjd4 Created container dns-node-resolver
Nov 08 11:00:12.614 W ns/openshift-monitoring pod/prometheus-k8s-0 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus container restarted
Nov 08 11:00:12.709 W ns/openshift-monitoring pod/prometheus-k8s-1 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn container=prometheus container restarted
Nov 08 11:00:12.713 I ns/openshift-dns pod/dns-default-vdjd4 Started container dns-node-resolver
Nov 08 11:00:12.918 I ns/openshift-monitoring pod/prometheus-k8s-1 Created container kube-rbac-proxy
Nov 08 11:00:13.119 I ns/openshift-monitoring pod/prometheus-k8s-1 Started container kube-rbac-proxy
Nov 08 11:00:13.318 I ns/openshift-monitoring pod/prometheus-k8s-1 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e" already present on machine
Nov 08 11:00:13.514 I ns/openshift-monitoring pod/prometheus-k8s-0 Created container prometheus-proxy
Nov 08 11:00:13.801 I ns/openshift-monitoring pod/prometheus-k8s-0 Started container prometheus-proxy
Nov 08 11:00:13.944 I ns/openshift-monitoring pod/prometheus-k8s-0 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8" already present on machine
Nov 08 11:00:14.124 I ns/openshift-monitoring pod/prometheus-k8s-1 Created container prom-label-proxy
Nov 08 11:00:14.311 I ns/openshift-monitoring pod/prometheus-k8s-1 Started container prom-label-proxy
Nov 08 11:00:14.512 I ns/openshift-monitoring pod/prometheus-k8s-0 Created container kube-rbac-proxy
Nov 08 11:00:14.713 I ns/openshift-monitoring pod/prometheus-k8s-0 Started container kube-rbac-proxy
Nov 08 11:00:14.934 I ns/openshift-monitoring pod/prometheus-k8s-0 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e" already present on machine
Nov 08 11:00:15.118 I ns/openshift-monitoring pod/prometheus-k8s-0 Created container prom-label-proxy
Nov 08 11:00:15.314 I ns/openshift-monitoring pod/prometheus-k8s-0 Started container prom-label-proxy
Nov 08 11:00:15.516 I ns/openshift-monitoring pod/prometheus-k8s-0 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757" already present on machine (2 times)
Nov 08 11:00:15.714 I ns/openshift-monitoring pod/prometheus-k8s-1 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757" already present on machine (2 times)
Nov 08 11:00:15.913 I ns/openshift-monitoring pod/prometheus-k8s-0 Created container prometheus (2 times)
Nov 08 11:00:16.113 I ns/openshift-monitoring pod/prometheus-k8s-0 Started container prometheus (2 times)
Nov 08 11:00:16.313 I ns/openshift-monitoring pod/prometheus-k8s-1 Created container prometheus (2 times)
Nov 08 11:00:16.514 I ns/openshift-monitoring pod/prometheus-k8s-1 Started container prometheus (2 times)
Nov 08 11:00:16.710 I ns/openshift-ingress pod/router-default-595c859f98-2kwcs Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35"
Nov 08 11:00:16.911 I ns/openshift-ingress pod/router-default-595c859f98-2kwcs Created container router
Nov 08 11:00:17.116 I ns/openshift-ingress pod/router-default-595c859f98-2kwcs Started container router
Nov 08 11:00:18.129 W clusteroperator/dns changed Degraded to False: AsExpected: All desired DNS DaemonSets available and operand Namespace exists
Nov 08 11:00:21.068 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal
Nov 08 11:00:30.221 W clusteroperator/ingress changed Available to True: desired and current number of IngressControllers are equal
Nov 08 11:00:30.221 W clusteroperator/ingress changed Progressing to False: desired and current number of IngressControllers are equal
Nov 08 11:00:56.297 W ns/openshift-ingress pod/router-default-595c859f98-5w8k6 Unable to attach or mount volumes: unmounted volumes=[metrics-certs router-token-hf796 default-certificate], unattached volumes=[metrics-certs router-token-hf796 default-certificate]: timed out waiting for the condition
Nov 08 11:01:48.380 I ns/openshift-ingress service/router-default Ensuring load balancer (12 times)
Nov 08 11:01:49.116 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (9 times)
Nov 08 11:02:12.362 W ns/kube-system pod/pod0-system-node-critical Unable to attach or mount volumes: unmounted volumes=[default-token-662rj], unattached volumes=[default-token-662rj]: timed out waiting for the condition
Nov 08 11:02:12.428 W ns/kube-system pod/pod1-system-cluster-critical Unable to attach or mount volumes: unmounted volumes=[default-token-662rj], unattached volumes=[default-token-662rj]: timed out waiting for the condition
Nov 08 11:03:03.876 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (3 times)
Nov 08 11:03:04.478 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (4 times)
Nov 08 11:04:57.209 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (20 times)
Nov 08 11:04:57.790 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (5 times)
Nov 08 11:05:34.637 W ns/openshift-image-registry pod/node-ca-rkf8x node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:05:34.685 I ns/openshift-image-registry pod/node-ca-rkf8x Marking for deletion Pod openshift-image-registry/node-ca-rkf8x
Nov 08 11:05:34.685 I ns/openshift-image-registry daemonset/node-ca Deleted pod: node-ca-rkf8x
Nov 08 11:05:34.685 I ns/openshift-machine-config-operator pod/machine-config-daemon-x427v Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-x427v
Nov 08 11:05:34.686 I ns/openshift-dns daemonset/dns-default Deleted pod: dns-default-5djcm
Nov 08 11:05:34.686 W ns/openshift-dns pod/dns-default-5djcm node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:05:34.686 W ns/openshift-machine-config-operator pod/machine-config-daemon-x427v node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 600s
Nov 08 11:05:34.689 I ns/openshift-image-registry pod/node-ca-rkf8x Stopping container node-ca
Nov 08 11:05:34.695 I ns/openshift-dns pod/dns-default-5djcm Marking for deletion Pod openshift-dns/dns-default-5djcm
Nov 08 11:05:34.703 I ns/openshift-dns pod/dns-default-5djcm Stopping container dns-node-resolver
Nov 08 11:05:34.722 I ns/openshift-dns pod/dns-default-5djcm Stopping container dns
Nov 08 11:05:34.736 I ns/openshift-machine-config-operator pod/machine-config-daemon-x427v Stopping container oauth-proxy
Nov 08 11:05:34.760 I ns/openshift-machine-config-operator pod/machine-config-daemon-x427v Stopping container machine-config-daemon
Nov 08 11:05:36.951 W ns/openshift-dns pod/dns-default-5djcm node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:05:36.951 W ns/openshift-dns pod/dns-default-5djcm node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns-node-resolver container stopped being ready
Nov 08 11:05:36.951 W ns/openshift-dns pod/dns-default-5djcm node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns container stopped being ready
Nov 08 11:05:37.024 W ns/openshift-machine-config-operator pod/machine-config-daemon-x427v node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:05:37.024 W ns/openshift-machine-config-operator pod/machine-config-daemon-x427v node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=machine-config-daemon container stopped being ready
Nov 08 11:05:37.024 W ns/openshift-machine-config-operator pod/machine-config-daemon-x427v node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=oauth-proxy container stopped being ready
Nov 08 11:05:37.024 W ns/openshift-image-registry pod/node-ca-rkf8x node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:05:37.024 W ns/openshift-image-registry pod/node-ca-rkf8x node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=node-ca container stopped being ready
Nov 08 11:05:37.102 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available.
Nov 08 11:05:38.000 W ns/openshift-dns pod/dns-default-5djcm node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:05:38.029 I ns/openshift-dns pod/dns-default-nc7sc node/ created
Nov 08 11:05:38.033 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-nc7sc
Nov 08 11:05:38.053 I ns/openshift-dns pod/dns-default-nc7sc Successfully assigned openshift-dns/dns-default-nc7sc to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:05:38.058 W ns/openshift-machine-config-operator pod/machine-config-daemon-x427v node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:05:38.079 I ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 node/ created
Nov 08 11:05:38.084 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-6d8f7
Nov 08 11:05:38.114 I ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 Successfully assigned openshift-machine-config-operator/machine-config-daemon-6d8f7 to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:05:38.154 W ns/openshift-image-registry pod/node-ca-rkf8x node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:05:38.196 I ns/openshift-image-registry pod/node-ca-6q48m node/ created
Nov 08 11:05:38.210 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-6q48m
Nov 08 11:05:38.219 I ns/openshift-image-registry pod/node-ca-6q48m Successfully assigned openshift-image-registry/node-ca-6q48m to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:05:39.421 I ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6" already present on machine
Nov 08 11:05:39.709 I ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 Created container machine-config-daemon
Nov 08 11:05:39.789 I ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 Started container machine-config-daemon
Nov 08 11:05:39.800 I ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 11:05:40.087 I ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 Created container oauth-proxy
Nov 08 11:05:40.130 I ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 Started container oauth-proxy
Nov 08 11:05:46.392 I ns/openshift-dns pod/dns-default-nc7sc Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2" already present on machine
Nov 08 11:05:46.450 I ns/openshift-image-registry pod/node-ca-6q48m Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee" already present on machine
Nov 08 11:05:46.743 I ns/openshift-dns pod/dns-default-nc7sc Created container dns
Nov 08 11:05:46.787 I ns/openshift-image-registry pod/node-ca-6q48m Created container node-ca
Nov 08 11:05:46.807 I ns/openshift-dns pod/dns-default-nc7sc Started container dns
Nov 08 11:05:46.816 I ns/openshift-dns pod/dns-default-nc7sc Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29" already present on machine
Nov 08 11:05:46.841 I ns/openshift-image-registry pod/node-ca-6q48m Started container node-ca
Nov 08 11:05:47.005 I ns/openshift-dns pod/dns-default-nc7sc Created container dns-node-resolver
Nov 08 11:05:47.058 I ns/openshift-dns pod/dns-default-nc7sc Started container dns-node-resolver
Nov 08 11:05:57.477 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal
Nov 08 11:06:44.443 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (17 times)
Nov 08 11:06:45.035 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (20 times)
Nov 08 11:06:49.123 I ns/openshift-ingress service/router-default Ensuring load balancer (13 times)
Nov 08 11:06:49.689 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (10 times)
Nov 08 11:08:22.870 W ns/openshift-monitoring pod/prometheus-k8s-1 0/6 nodes are available: 2 Insufficient cpu, 4 node(s) had taints that the pod didn't tolerate.
Nov 08 11:08:22.879 W ns/openshift-ingress pod/router-default-595c859f98-2kwcs 0/6 nodes are available: 1 node(s) didn't match pod affinity/anti-affinity, 1 node(s) didn't satisfy existing pods anti-affinity rules, 2 node(s) had taints that the pod didn't tolerate, 3 node(s) didn't match node selector.
Nov 08 11:11:49.698 I ns/openshift-ingress service/router-default Ensuring load balancer (14 times)
Nov 08 11:11:50.214 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (11 times)
Nov 08 11:13:03.885 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (5 times)
Nov 08 11:13:04.479 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (6 times)
Nov 08 11:13:40.941 W ns/openshift-dns pod/dns-default-nc7sc node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:13:40.985 I ns/openshift-image-registry pod/node-ca-6q48m Marking for deletion Pod openshift-image-registry/node-ca-6q48m
Nov 08 11:13:40.985 I ns/openshift-image-registry daemonset/node-ca Deleted pod: node-ca-6q48m
Nov 08 11:13:40.985 I ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-6d8f7
Nov 08 11:13:40.985 I ns/openshift-dns pod/dns-default-nc7sc Stopping container dns-node-resolver
Nov 08 11:13:40.985 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-6d8f7
Nov 08 11:13:40.985 W ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 600s
Nov 08 11:13:40.986 W ns/openshift-image-registry pod/node-ca-6q48m node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:13:40.992 I ns/openshift-dns pod/dns-default-nc7sc Marking for deletion Pod openshift-dns/dns-default-nc7sc
Nov 08 11:13:40.997 I ns/openshift-dns pod/dns-default-nc7sc Stopping container dns
Nov 08 11:13:41.027 I ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 Stopping container oauth-proxy
Nov 08 11:13:41.075 I ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 Stopping container machine-config-daemon
Nov 08 11:13:41.103 I ns/openshift-image-registry pod/node-ca-6q48m Stopping container node-ca
Nov 08 11:13:43.212 W ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:13:43.212 W ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=oauth-proxy container stopped being ready
Nov 08 11:13:43.212 W ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=machine-config-daemon container stopped being ready
Nov 08 11:13:43.233 W ns/openshift-image-registry pod/node-ca-6q48m node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:13:43.233 W ns/openshift-image-registry pod/node-ca-6q48m node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=node-ca container stopped being ready
Nov 08 11:13:43.266 W ns/openshift-dns pod/dns-default-nc7sc node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:13:43.266 W ns/openshift-dns pod/dns-default-nc7sc node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns container stopped being ready
Nov 08 11:13:43.266 W ns/openshift-dns pod/dns-default-nc7sc node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns-node-resolver container stopped being ready
Nov 08 11:13:53.130 W ns/openshift-machine-config-operator pod/machine-config-daemon-6d8f7 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:13:53.162 W ns/openshift-image-registry pod/node-ca-6q48m node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh pod has been pending longer than a minute
Nov 08 11:13:53.162 W ns/openshift-dns pod/dns-default-nc7sc node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh pod has been pending longer than a minute
Nov 08 11:13:53.202 W ns/openshift-image-registry pod/node-ca-6q48m node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:13:53.235 W ns/openshift-dns pod/dns-default-nc7sc node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:14:57.209 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (7 times)
Nov 08 11:14:57.794 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (7 times)
Nov 08 11:15:03.326 I ns/openshift-dns pod/dns-default-qz28f node/ created
Nov 08 11:15:03.333 I ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 node/ created
Nov 08 11:15:03.376 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-qz28f
Nov 08 11:15:03.376 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-mzpm2
Nov 08 11:15:03.403 I ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 Successfully assigned openshift-machine-config-operator/machine-config-daemon-mzpm2 to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:15:03.403 I ns/openshift-dns pod/dns-default-qz28f Successfully assigned openshift-dns/dns-default-qz28f to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:15:03.432 I ns/openshift-image-registry pod/node-ca-jnb5k node/ created
Nov 08 11:15:03.446 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-jnb5k
Nov 08 11:15:03.473 I ns/openshift-image-registry pod/node-ca-jnb5k Successfully assigned openshift-image-registry/node-ca-jnb5k to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:15:03.541 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available.
Nov 08 11:15:04.807 I ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6" already present on machine
Nov 08 11:15:05.073 I ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 Created container machine-config-daemon
Nov 08 11:15:05.121 I ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 Started container machine-config-daemon
Nov 08 11:15:05.131 I ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 11:15:05.520 I ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 Created container oauth-proxy
Nov 08 11:15:05.555 I ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 Started container oauth-proxy
Nov 08 11:15:11.772 I ns/openshift-dns pod/dns-default-qz28f Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2" already present on machine
Nov 08 11:15:11.970 I ns/openshift-image-registry pod/node-ca-jnb5k Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee" already present on machine
Nov 08 11:15:12.008 I ns/openshift-dns pod/dns-default-qz28f Created container dns
Nov 08 11:15:12.061 I ns/openshift-dns pod/dns-default-qz28f Started container dns
Nov 08 11:15:12.080 I ns/openshift-dns pod/dns-default-qz28f Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29" already present on machine
Nov 08 11:15:12.226 I ns/openshift-image-registry pod/node-ca-jnb5k Created container node-ca
Nov 08 11:15:12.319 I ns/openshift-image-registry pod/node-ca-jnb5k Started container node-ca
Nov 08 11:15:12.340 I ns/openshift-dns pod/dns-default-qz28f Created container dns-node-resolver
Nov 08 11:15:12.379 I ns/openshift-dns pod/dns-default-qz28f Started container dns-node-resolver
Nov 08 11:15:24.084 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal
Nov 08 11:16:44.451 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (6 times)
Nov 08 11:16:45.041 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (26 times)
Nov 08 11:16:50.210 I ns/openshift-ingress service/router-default Ensuring load balancer (15 times)
Nov 08 11:16:50.740 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (12 times)
Nov 08 11:18:18.962 I ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 Stopping container oauth-proxy
Nov 08 11:18:18.962 I ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-mzpm2
Nov 08 11:18:18.962 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-mzpm2
Nov 08 11:18:18.962 W ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 600s
Nov 08 11:18:18.962 I ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 Stopping container machine-config-daemon
Nov 08 11:18:18.963 W ns/openshift-image-registry pod/node-ca-jnb5k node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:18:18.963 I ns/openshift-image-registry pod/node-ca-jnb5k Marking for deletion Pod openshift-image-registry/node-ca-jnb5k
Nov 08 11:18:18.963 I ns/openshift-dns daemonset/dns-default Deleted pod: dns-default-qz28f
Nov 08 11:18:18.963 I ns/openshift-image-registry pod/node-ca-jnb5k Stopping container node-ca
Nov 08 11:18:18.963 I ns/openshift-dns pod/dns-default-qz28f Stopping container dns-node-resolver
Nov 08 11:18:18.963 I ns/openshift-dns pod/dns-default-qz28f Marking for deletion Pod openshift-dns/dns-default-qz28f
Nov 08 11:18:18.963 I ns/openshift-dns pod/dns-default-qz28f Stopping container dns
Nov 08 11:18:18.963 W ns/openshift-dns pod/dns-default-qz28f node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:18:20.845 W ns/openshift-image-registry pod/node-ca-jnb5k node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:18:20.845 W ns/openshift-image-registry pod/node-ca-jnb5k node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=node-ca container stopped being ready
Nov 08 11:18:20.869 W ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:18:20.869 W ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=oauth-proxy container stopped being ready
Nov 08 11:18:20.869 W ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=machine-config-daemon container stopped being ready
Nov 08 11:18:20.918 W ns/openshift-dns pod/dns-default-qz28f node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:18:20.918 W ns/openshift-dns pod/dns-default-qz28f node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns-node-resolver container stopped being ready
Nov 08 11:18:20.918 W ns/openshift-dns pod/dns-default-qz28f node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns container stopped being ready
Nov 08 11:18:21.008 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available.
Nov 08 11:18:21.877 W ns/openshift-image-registry pod/node-ca-jnb5k node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:18:21.950 W ns/openshift-dns pod/dns-default-qz28f node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:18:21.951 I ns/openshift-image-registry pod/node-ca-7hvwd node/ created
Nov 08 11:18:21.977 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-7hvwd
Nov 08 11:18:21.977 I ns/openshift-dns pod/dns-default-6qwwj node/ created
Nov 08 11:18:22.014 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-6qwwj
Nov 08 11:18:22.014 I ns/openshift-dns pod/dns-default-6qwwj Successfully assigned openshift-dns/dns-default-6qwwj to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:18:22.014 I ns/openshift-image-registry pod/node-ca-7hvwd Successfully assigned openshift-image-registry/node-ca-7hvwd to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:18:23.138 W ns/openshift-machine-config-operator pod/machine-config-daemon-mzpm2 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:18:23.189 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-f2fxs
Nov 08 11:18:23.189 I ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs node/ created
Nov 08 11:18:23.190 I ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs Successfully assigned openshift-machine-config-operator/machine-config-daemon-f2fxs to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:18:23.893 I ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6" already present on machine
Nov 08 11:18:24.125 I ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs Created container machine-config-daemon
Nov 08 11:18:24.165 I ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs Started container machine-config-daemon
Nov 08 11:18:24.174 I ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 11:18:24.500 I ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs Created container oauth-proxy
Nov 08 11:18:24.537 I ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs Started container oauth-proxy
Nov 08 11:18:30.252 I ns/openshift-image-registry pod/node-ca-7hvwd Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee" already present on machine
Nov 08 11:18:30.320 I ns/openshift-dns pod/dns-default-6qwwj Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2" already present on machine
Nov 08 11:18:30.506 I ns/openshift-image-registry pod/node-ca-7hvwd Created container node-ca
Nov 08 11:18:30.588 I ns/openshift-image-registry pod/node-ca-7hvwd Started container node-ca
Nov 08 11:18:30.619 I ns/openshift-dns pod/dns-default-6qwwj Created container dns
Nov 08 11:18:30.668 I ns/openshift-dns pod/dns-default-6qwwj Started container dns
Nov 08 11:18:30.677 I ns/openshift-dns pod/dns-default-6qwwj Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29" already present on machine
Nov 08 11:18:30.846 I ns/openshift-dns pod/dns-default-6qwwj Created container dns-node-resolver
Nov 08 11:18:30.892 I ns/openshift-dns pod/dns-default-6qwwj Started container dns-node-resolver
Nov 08 11:18:46.436 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal
Nov 08 11:19:56.438 I ns/openshift-dns pod/dns-default-6qwwj Marking for deletion Pod openshift-dns/dns-default-6qwwj
Nov 08 11:19:56.443 W ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 600s
Nov 08 11:19:56.445 W ns/openshift-image-registry pod/node-ca-7hvwd node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:19:56.477 I ns/openshift-image-registry daemonset/node-ca Deleted pod: node-ca-7hvwd
Nov 08 11:19:56.477 I ns/openshift-image-registry pod/node-ca-7hvwd Marking for deletion Pod openshift-image-registry/node-ca-7hvwd
Nov 08 11:19:56.477 I ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs Stopping container oauth-proxy
Nov 08 11:19:56.477 W ns/openshift-dns pod/dns-default-6qwwj node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:19:56.479 I ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-f2fxs
Nov 08 11:19:56.490 I ns/openshift-dns daemonset/dns-default Deleted pod: dns-default-6qwwj
Nov 08 11:19:56.490 I ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs Stopping container machine-config-daemon
Nov 08 11:19:56.527 I ns/openshift-image-registry pod/node-ca-7hvwd Stopping container node-ca
Nov 08 11:19:56.536 I ns/openshift-dns pod/dns-default-6qwwj Stopping container dns-node-resolver
Nov 08 11:19:56.555 I ns/openshift-dns pod/dns-default-6qwwj Stopping container dns
Nov 08 11:19:58.133 W ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:19:58.133 W ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=oauth-proxy container stopped being ready
Nov 08 11:19:59.133 W ns/openshift-dns pod/dns-default-6qwwj node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:19:59.133 W ns/openshift-dns pod/dns-default-6qwwj node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns container stopped being ready
Nov 08 11:19:59.133 W ns/openshift-dns pod/dns-default-6qwwj node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns-node-resolver container stopped being ready
Nov 08 11:19:59.213 W ns/openshift-machine-config-operator pod/machine-config-daemon-f2fxs node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:19:59.213 W ns/openshift-image-registry pod/node-ca-7hvwd node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:19:59.213 W ns/openshift-image-registry pod/node-ca-7hvwd node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=node-ca container stopped being ready
Nov 08 11:20:03.128 W ns/openshift-image-registry pod/node-ca-7hvwd node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:20:03.201 W ns/openshift-dns pod/dns-default-6qwwj node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:21:01.728 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-vgxg9
Nov 08 11:21:01.728 I ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 node/ created
Nov 08 11:21:01.744 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-tpvbq
Nov 08 11:21:01.747 I ns/openshift-image-registry pod/node-ca-tpvbq node/ created
Nov 08 11:21:01.747 I ns/openshift-dns pod/dns-default-28h2c node/ created
Nov 08 11:21:01.778 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-28h2c
Nov 08 11:21:01.817 I ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 Successfully assigned openshift-machine-config-operator/machine-config-daemon-vgxg9 to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:21:01.817 I ns/openshift-image-registry pod/node-ca-tpvbq Successfully assigned openshift-image-registry/node-ca-tpvbq to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:21:01.817 I ns/openshift-dns pod/dns-default-28h2c Successfully assigned openshift-dns/dns-default-28h2c to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:21:01.942 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available.
Nov 08 11:21:03.089 I ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6" already present on machine
Nov 08 11:21:03.353 I ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 Created container machine-config-daemon
Nov 08 11:21:03.402 I ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 Started container machine-config-daemon
Nov 08 11:21:03.409 I ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 11:21:03.677 I ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 Created container oauth-proxy
Nov 08 11:21:03.708 I ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 Started container oauth-proxy
Nov 08 11:21:09.928 I ns/openshift-dns pod/dns-default-28h2c Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2" already present on machine
Nov 08 11:21:10.100 I ns/openshift-image-registry pod/node-ca-tpvbq Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee" already present on machine
Nov 08 11:21:10.174 I ns/openshift-dns pod/dns-default-28h2c Created container dns
Nov 08 11:21:10.251 I ns/openshift-dns pod/dns-default-28h2c Started container dns
Nov 08 11:21:10.263 I ns/openshift-dns pod/dns-default-28h2c Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29" already present on machine
Nov 08 11:21:10.383 I ns/openshift-image-registry pod/node-ca-tpvbq Created container node-ca
Nov 08 11:21:10.440 I ns/openshift-image-registry pod/node-ca-tpvbq Started container node-ca
Nov 08 11:21:10.549 I ns/openshift-dns pod/dns-default-28h2c Created container dns-node-resolver
Nov 08 11:21:10.580 I ns/openshift-dns pod/dns-default-28h2c Started container dns-node-resolver
Nov 08 11:21:28.384 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal
Nov 08 11:21:50.741 I ns/openshift-ingress service/router-default Ensuring load balancer (16 times)
Nov 08 11:21:51.192 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (13 times)
Nov 08 11:23:03.944 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (7 times)
Nov 08 11:23:04.098 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-005" not found) (33 times)
Nov 08 11:24:57.209 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (9 times)
Nov 08 11:24:57.801 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (9 times)
Nov 08 11:26:44.467 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (30 times)
Nov 08 11:26:45.041 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (31 times)
Nov 08 11:26:51.196 I ns/openshift-ingress service/router-default Ensuring load balancer (17 times)
Nov 08 11:26:52.135 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (14 times)
Nov 08 11:28:26.112 I ns/openshift-image-registry pod/node-ca-tpvbq Marking for deletion Pod openshift-image-registry/node-ca-tpvbq
Nov 08 11:28:26.116 W ns/openshift-image-registry pod/node-ca-tpvbq node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:28:26.153 I ns/openshift-image-registry daemonset/node-ca Deleted pod: node-ca-tpvbq
Nov 08 11:28:26.153 I ns/openshift-dns pod/dns-default-28h2c Marking for deletion Pod openshift-dns/dns-default-28h2c
Nov 08 11:28:26.153 I ns/openshift-image-registry pod/node-ca-tpvbq Stopping container node-ca
Nov 08 11:28:26.154 W ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 600s
Nov 08 11:28:26.154 W ns/openshift-dns pod/dns-default-28h2c node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:28:26.178 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-vgxg9
Nov 08 11:28:26.178 I ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-vgxg9
Nov 08 11:28:26.184 I ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 Stopping container oauth-proxy
Nov 08 11:28:26.213 I ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 Stopping container machine-config-daemon
Nov 08 11:28:26.320 I ns/openshift-dns pod/dns-default-28h2c Stopping container dns-node-resolver
Nov 08 11:28:26.328 I ns/openshift-dns pod/dns-default-28h2c Stopping container dns
Nov 08 11:28:26.650 W ns/openshift-dns pod/dns-default-28h2c Liveness probe failed: Get http://10.129.2.49:8080/health: dial tcp 10.129.2.49:8080: connect: connection refused
Nov 08 11:28:27.915 W ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:28:27.915 W ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=machine-config-daemon container stopped being ready
Nov 08 11:28:27.915 W ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=oauth-proxy container stopped being ready
Nov 08 11:28:28.923 W ns/openshift-dns pod/dns-default-28h2c node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:28:28.923 W ns/openshift-dns pod/dns-default-28h2c node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns-node-resolver container stopped being ready
Nov 08 11:28:28.923 W ns/openshift-dns pod/dns-default-28h2c node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns container stopped being ready
Nov 08 11:28:28.964 W ns/openshift-image-registry pod/node-ca-tpvbq node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:28:28.964 W ns/openshift-image-registry pod/node-ca-tpvbq node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=node-ca container stopped being ready
Nov 08 11:28:33.193 W ns/openshift-dns pod/dns-default-28h2c node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:28:33.200 W ns/openshift-machine-config-operator pod/machine-config-daemon-vgxg9 node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:28:33.265 W ns/openshift-image-registry pod/node-ca-tpvbq node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:28:33.473 I ns/openshift-dns pod/dns-default-rmzdv node/ created
Nov 08 11:28:33.479 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-rmzdv
Nov 08 11:28:33.511 I ns/openshift-dns pod/dns-default-rmzdv Successfully assigned openshift-dns/dns-default-rmzdv to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:28:33.512 I ns/openshift-image-registry pod/node-ca-8tqkg node/ created
Nov 08 11:28:33.531 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-8tqkg
Nov 08 11:28:33.532 I ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf node/ created
Nov 08 11:28:33.548 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-xgbnf
Nov 08 11:28:33.560 I ns/openshift-image-registry pod/node-ca-8tqkg Successfully assigned openshift-image-registry/node-ca-8tqkg to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:28:33.568 I ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf Successfully assigned openshift-machine-config-operator/machine-config-daemon-xgbnf to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:28:33.657 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available.
Nov 08 11:28:34.745 I ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6" already present on machine
Nov 08 11:28:34.957 I ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf Created container machine-config-daemon
Nov 08 11:28:35.004 I ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf Started container machine-config-daemon
Nov 08 11:28:35.013 I ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 11:28:35.268 I ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf Created container oauth-proxy
Nov 08 11:28:35.311 I ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf Started container oauth-proxy
Nov 08 11:28:42.184 I ns/openshift-dns pod/dns-default-rmzdv Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2" already present on machine
Nov 08 11:28:42.406 I ns/openshift-image-registry pod/node-ca-8tqkg Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee" already present on machine
Nov 08 11:28:42.441 I ns/openshift-dns pod/dns-default-rmzdv Created container dns
Nov 08 11:28:42.518 I ns/openshift-dns pod/dns-default-rmzdv Started container dns
Nov 08 11:28:42.535 I ns/openshift-dns pod/dns-default-rmzdv Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29" already present on machine
Nov 08 11:28:42.704 I ns/openshift-image-registry pod/node-ca-8tqkg Created container node-ca
Nov 08 11:28:42.777 I ns/openshift-image-registry pod/node-ca-8tqkg Started container node-ca
Nov 08 11:28:42.843 I ns/openshift-dns pod/dns-default-rmzdv Created container dns-node-resolver
Nov 08 11:28:42.876 I ns/openshift-dns pod/dns-default-rmzdv Started container dns-node-resolver
Nov 08 11:29:00.323 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal
Nov 08 11:29:04.738 - 724s  I test="[Feature:Machines][Serial] Managed cluster should grow and decrease when scaling different machineSets simultaneously [Suite:openshift/conformance/serial]" running
Nov 08 11:29:13.035 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : failed to create or get machine: compute.VirtualMachinesCreateOrUpdateFuture: asynchronous operation has not completed
Nov 08 11:29:14.328 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile
Nov 08 11:29:15.982 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (2 times)
Nov 08 11:29:17.213 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (3 times)
Nov 08 11:29:34.452 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (4 times)
Nov 08 11:29:56.005 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (5 times)
Nov 08 11:30:17.135 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (6 times)
Nov 08 11:30:38.422 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (7 times)
Nov 08 11:30:59.947 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (8 times)
Nov 08 11:31:21.265 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (9 times)
Nov 08 11:31:42.872 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (10 times)
Nov 08 11:31:52.146 I ns/openshift-ingress service/router-default Ensuring load balancer (18 times)
Nov 08 11:31:52.733 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (15 times)
Nov 08 11:32:03.992 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (11 times)
Nov 08 11:32:25.378 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (12 times)
Nov 08 11:32:46.841 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (13 times)
Nov 08 11:33:03.889 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (9 times)
Nov 08 11:33:04.489 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (10 times)
Nov 08 11:33:08.325 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (14 times)
Nov 08 11:33:29.809 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (15 times)
Nov 08 11:33:51.295 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (16 times)
Nov 08 11:34:12.746 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (17 times)
Nov 08 11:34:34.092 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (18 times)
Nov 08 11:34:55.272 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (19 times)
Nov 08 11:34:57.214 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (41 times)
Nov 08 11:34:57.805 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (11 times)
Nov 08 11:35:16.407 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (20 times)
Nov 08 11:35:37.713 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (21 times)
Nov 08 11:35:59.070 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (22 times)
Nov 08 11:36:20.301 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (23 times)
Nov 08 11:36:42.065 W ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp CreateError: failed to reconcile machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"s: failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile (24 times)
Nov 08 11:36:44.458 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (36 times)
Nov 08 11:36:45.044 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (3 times)
Nov 08 11:36:52.738 I ns/openshift-ingress service/router-default Ensuring load balancer (19 times)
Nov 08 11:36:53.601 W ns/openshift-ingress service/router-default Error syncing load balancer: failed to ensure load balancer: ensure(openshift-ingress/router-default): backendPoolID(/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Network/loadBalancers/ci-op-7i03490c-09f59-zzxg9/backendAddressPools/ci-op-7i03490c-09f59-zzxg9) - failed to ensure host in pool: "azure - cloud provider rate limited(read) for operation:NicGet" (16 times)
Nov 08 11:37:02.999 I ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp Updated machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp"
Nov 08 11:40:10.624 I node/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp Node ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp status is now: NodeHasSufficientMemory (8 times)
Nov 08 11:40:10.655 I node/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp Node ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp status is now: NodeHasSufficientPID (8 times)
Nov 08 11:40:10.682 I ns/openshift-multus daemonset/multus Created pod: multus-7z8sv
Nov 08 11:40:10.683 I ns/openshift-multus pod/multus-7z8sv node/ created
Nov 08 11:40:10.717 I ns/openshift-multus pod/multus-7z8sv Successfully assigned openshift-multus/multus-7z8sv to ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp
Nov 08 11:40:10.718 W clusteroperator/network changed Progressing to True: Deploying: DaemonSet "openshift-multus/multus" update is rolling out (6 out of 7 updated)
Nov 08 11:40:10.729 I ns/openshift-cluster-node-tuning-operator pod/tuned-tnprt node/ created
Nov 08 11:40:10.729 I ns/openshift-sdn pod/ovs-c59pv node/ created
Nov 08 11:40:10.755 I ns/openshift-cluster-node-tuning-operator daemonset/tuned Created pod: tuned-tnprt
Nov 08 11:40:10.790 I ns/openshift-sdn pod/ovs-c59pv Successfully assigned openshift-sdn/ovs-c59pv to ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp
Nov 08 11:40:10.790 I ns/openshift-sdn daemonset/ovs Created pod: ovs-c59pv
Nov 08 11:40:10.797 I ns/openshift-sdn pod/sdn-tr8gj node/ created
Nov 08 11:40:10.801 I ns/openshift-cluster-node-tuning-operator pod/tuned-tnprt Successfully assigned openshift-cluster-node-tuning-operator/tuned-tnprt to ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp
Nov 08 11:40:10.820 I ns/openshift-sdn daemonset/sdn Created pod: sdn-tr8gj
Nov 08 11:40:10.835 I ns/openshift-sdn pod/sdn-tr8gj Successfully assigned openshift-sdn/sdn-tr8gj to ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp
Nov 08 11:40:10.927 I ns/openshift-monitoring pod/node-exporter-h9rmz node/ created
Nov 08 11:40:10.937 I ns/openshift-monitoring daemonset/node-exporter Created pod: node-exporter-h9rmz
Nov 08 11:40:10.978 I ns/openshift-monitoring pod/node-exporter-h9rmz Successfully assigned openshift-monitoring/node-exporter-h9rmz to ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp
Nov 08 11:40:11.943 I ns/openshift-machine-api machine/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp Updated machine "ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp" (4 times)
Nov 08 11:40:13.166 I node/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp Node ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp event: Registered Node ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp in Controller
Nov 08 11:40:23.162 - 45s   W node/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp node is not ready
Nov 08 11:40:37.498 I ns/openshift-sdn pod/ovs-c59pv Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce"
Nov 08 11:40:37.701 I ns/openshift-sdn pod/sdn-tr8gj Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58"
Nov 08 11:40:37.898 I ns/openshift-monitoring pod/node-exporter-h9rmz Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a"
Nov 08 11:40:37.918 I ns/openshift-multus pod/multus-7z8sv Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58"
Nov 08 11:40:37.950 I ns/openshift-cluster-node-tuning-operator pod/tuned-tnprt Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368"
Nov 08 11:40:47.169 I ns/openshift-monitoring pod/node-exporter-h9rmz Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a"
Nov 08 11:40:48.589 I ns/openshift-monitoring pod/node-exporter-h9rmz Created container node-exporter
Nov 08 11:40:48.636 I ns/openshift-monitoring pod/node-exporter-h9rmz Started container node-exporter
Nov 08 11:40:48.644 I ns/openshift-monitoring pod/node-exporter-h9rmz Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8"
Nov 08 11:41:09.362 I test="[Feature:Machines][Serial] Managed cluster should grow and decrease when scaling different machineSets simultaneously [Suite:openshift/conformance/serial]" failed
Nov 08 11:41:12.595 I ns/openshift-multus pod/multus-7z8sv Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58"
Nov 08 11:41:12.729 I ns/openshift-sdn pod/sdn-tr8gj Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58"
Nov 08 11:41:12.825 I ns/openshift-sdn pod/ovs-c59pv Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce"
Nov 08 11:41:12.833 I ns/openshift-monitoring pod/node-exporter-h9rmz Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8"
Nov 08 11:41:13.007 I ns/openshift-cluster-node-tuning-operator pod/tuned-tnprt Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368"
Nov 08 11:41:13.117 I ns/openshift-sdn pod/sdn-tr8gj Created container install-cni-plugins
Nov 08 11:41:13.165 I ns/openshift-sdn pod/sdn-tr8gj Started container install-cni-plugins
Nov 08 11:41:13.430 I ns/openshift-sdn pod/ovs-c59pv Created container openvswitch
Nov 08 11:41:13.498 I ns/openshift-sdn pod/ovs-c59pv Started container openvswitch
Nov 08 11:41:13.530 I ns/openshift-multus pod/multus-7z8sv Created container cni-plugins
Nov 08 11:41:13.555 I ns/openshift-cluster-node-tuning-operator pod/tuned-tnprt Created container tuned
Nov 08 11:41:13.618 I ns/openshift-multus pod/multus-7z8sv Started container cni-plugins
Nov 08 11:41:13.764 I ns/openshift-monitoring pod/node-exporter-h9rmz Created container kube-rbac-proxy
Nov 08 11:41:13.776 I ns/openshift-cluster-node-tuning-operator pod/tuned-tnprt Started container tuned
Nov 08 11:41:13.846 I ns/openshift-monitoring pod/node-exporter-h9rmz Started container kube-rbac-proxy
Nov 08 11:41:14.038 I ns/openshift-sdn pod/sdn-tr8gj Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce" already present on machine
Nov 08 11:41:14.053 I ns/openshift-multus pod/multus-7z8sv Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f"
Nov 08 11:41:14.211 I ns/openshift-sdn pod/sdn-tr8gj Created container sdn
Nov 08 11:41:14.383 I ns/openshift-sdn pod/sdn-tr8gj Started container sdn
Nov 08 11:41:15.728 I node/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp openshift-sdn done initializing node networking.
Nov 08 11:41:18.706 I ns/openshift-multus pod/multus-7z8sv Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f"
Nov 08 11:41:18.880 I ns/openshift-multus pod/multus-7z8sv Created container kube-multus
Nov 08 11:41:18.911 I ns/openshift-multus pod/multus-7z8sv Started container kube-multus
Nov 08 11:41:22.356 W node/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp condition Ready changed
Nov 08 11:41:22.424 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n node/ created
Nov 08 11:41:22.445 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-9zn2n
Nov 08 11:41:22.465 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Successfully assigned openshift-machine-config-operator/machine-config-daemon-9zn2n to ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp
Nov 08 11:41:22.493 I ns/openshift-dns pod/dns-default-kgpbz node/ created
Nov 08 11:41:22.496 I ns/openshift-image-registry pod/node-ca-km2jv node/ created
Nov 08 11:41:22.502 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-km2jv
Nov 08 11:41:22.538 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-kgpbz
Nov 08 11:41:22.540 I ns/openshift-dns pod/dns-default-kgpbz Successfully assigned openshift-dns/dns-default-kgpbz to ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp
Nov 08 11:41:22.540 I ns/openshift-image-registry pod/node-ca-km2jv Successfully assigned openshift-image-registry/node-ca-km2jv to ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp
Nov 08 11:41:22.646 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available.
Nov 08 11:41:23.381 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6"
Nov 08 11:41:29.649 W clusteroperator/network changed Progressing to False
Nov 08 11:41:31.234 I ns/openshift-image-registry pod/node-ca-km2jv Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee"
Nov 08 11:41:31.247 I ns/openshift-dns pod/dns-default-kgpbz Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2"
Nov 08 11:41:39.246 I ns/openshift-dns pod/dns-default-kgpbz Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2"
Nov 08 11:41:39.591 I ns/openshift-dns pod/dns-default-kgpbz Created container dns
Nov 08 11:41:39.697 I ns/openshift-dns pod/dns-default-kgpbz Started container dns
Nov 08 11:41:39.711 I ns/openshift-dns pod/dns-default-kgpbz Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29"
Nov 08 11:41:53.604 I ns/openshift-ingress service/router-default Ensuring load balancer (20 times)
Nov 08 11:41:58.170 I ns/openshift-dns pod/dns-default-kgpbz Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29"
Nov 08 11:41:58.685 I ns/openshift-dns pod/dns-default-kgpbz Created container dns-node-resolver
Nov 08 11:41:58.769 I ns/openshift-dns pod/dns-default-kgpbz Started container dns-node-resolver
Nov 08 11:42:02.957 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal
Nov 08 11:42:23.162 - 45s   W ns/openshift-image-registry pod/node-ca-km2jv node/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp pod has been pending longer than a minute
Nov 08 11:42:23.162 - 269s  W ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n node/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp pod has been pending longer than a minute
Nov 08 11:43:03.901 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (11 times)
Nov 08 11:43:04.493 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (45 times)
Nov 08 11:43:08.674 I ns/openshift-image-registry pod/node-ca-km2jv Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee"
Nov 08 11:43:09.086 I ns/openshift-image-registry pod/node-ca-km2jv Created container node-ca
Nov 08 11:43:09.194 I ns/openshift-image-registry pod/node-ca-km2jv Started container node-ca
Nov 08 11:44:57.215 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (12 times)
Nov 08 11:44:57.806 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (13 times)
Nov 08 11:46:03.888 I ns/openshift-authentication-operator deployment/authentication-operator Created ConfigMap/v4-0-config-user-idp-0-ca -n openshift-authentication because it was missing
Nov 08 11:46:03.909 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "" to "OperatorSyncDegraded: failed syncing configuration objects: config maps [v4-0-config-user-idp-0-ca] in openshift-authentication not synced"
Nov 08 11:46:06.849 I ns/openshift-authentication-operator deployment/authentication-operator Updated ConfigMap/v4-0-config-system-cliconfig -n openshift-authentication: cause by changes in data.v4-0-config-system-cliconfig
Nov 08 11:46:07.499 I ns/openshift-authentication-operator deployment/authentication-operator Updated Deployment.apps/oauth-openshift -n openshift-authentication because it changed
Nov 08 11:46:07.540 I ns/openshift-authentication deployment/oauth-openshift Scaled up replica set oauth-openshift-67696765bc to 1
Nov 08 11:46:07.591 I ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 node/ created
Nov 08 11:46:07.608 I ns/openshift-authentication replicaset/oauth-openshift-67696765bc Created pod: oauth-openshift-67696765bc-bkxd9
Nov 08 11:46:07.663 I ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 Successfully assigned openshift-authentication/oauth-openshift-67696765bc-bkxd9 to ci-op-7i03490c-09f59-zzxg9-master-1
Nov 08 11:46:07.902 W clusteroperator/authentication changed Progressing to True: ProgressingOAuthServerDeploymentNotReady: Progressing: deployment's observed generation did not reach the expected generation
Nov 08 11:46:07.914 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "OperatorSyncDegraded: failed syncing configuration objects: config maps [v4-0-config-user-idp-0-ca] in openshift-authentication not synced" to "",Progressing changed from False to True ("Progressing: deployment's observed generation did not reach the expected generation")
Nov 08 11:46:11.300 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Progressing message changed from "Progressing: deployment's observed generation did not reach the expected generation" to "Progressing: not all deployment replicas are ready"
Nov 08 11:46:15.202 I ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:748d8c1c889ad7aaa90dca2ede7435bfd94c5af44a9dc4cb741032bddf8fd3ed"
Nov 08 11:46:20.087 I ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:748d8c1c889ad7aaa90dca2ede7435bfd94c5af44a9dc4cb741032bddf8fd3ed"
Nov 08 11:46:20.356 I ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 Created container oauth-openshift
Nov 08 11:46:20.411 I ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 Started container oauth-openshift
Nov 08 11:46:27.386 I ns/openshift-authentication deployment/oauth-openshift Scaled down replica set oauth-openshift-67f54bfc64 to 1
Nov 08 11:46:27.402 W ns/openshift-authentication pod/oauth-openshift-67f54bfc64-6qgqx node/ci-op-7i03490c-09f59-zzxg9-master-2 graceful deletion within 30s
Nov 08 11:46:27.405 I ns/openshift-authentication replicaset/oauth-openshift-67f54bfc64 Deleted pod: oauth-openshift-67f54bfc64-6qgqx
Nov 08 11:46:27.446 I ns/openshift-authentication deployment/oauth-openshift Scaled up replica set oauth-openshift-67696765bc to 2
Nov 08 11:46:27.451 I ns/openshift-authentication pod/oauth-openshift-67f54bfc64-6qgqx Stopping container oauth-openshift
Nov 08 11:46:27.494 I ns/openshift-authentication pod/oauth-openshift-67696765bc-blq74 node/ created
Nov 08 11:46:27.511 I ns/openshift-authentication replicaset/oauth-openshift-67696765bc Created pod: oauth-openshift-67696765bc-blq74
Nov 08 11:46:27.586 I ns/openshift-authentication pod/oauth-openshift-67696765bc-blq74 Successfully assigned openshift-authentication/oauth-openshift-67696765bc-blq74 to ci-op-7i03490c-09f59-zzxg9-master-2
Nov 08 11:46:33.484 W ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Failed to pull image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6": rpc error: code = Unknown desc = Error writing blob: error storing blob to file "/var/tmp/storage931176874/1": read tcp 10.0.32.7:54654->99.84.201.190:443: read: connection timed out
Nov 08 11:46:33.498 W ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Error: ErrImagePull
Nov 08 11:46:33.512 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945"
Nov 08 11:46:35.929 I ns/openshift-authentication pod/oauth-openshift-67696765bc-blq74 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:748d8c1c889ad7aaa90dca2ede7435bfd94c5af44a9dc4cb741032bddf8fd3ed" already present on machine
Nov 08 11:46:36.222 I ns/openshift-authentication pod/oauth-openshift-67696765bc-blq74 Created container oauth-openshift
Nov 08 11:46:36.264 I ns/openshift-authentication pod/oauth-openshift-67696765bc-blq74 Started container oauth-openshift
Nov 08 11:46:38.273 I ns/openshift-authentication deployment/oauth-openshift Scaled down replica set oauth-openshift-67f54bfc64 to 0
Nov 08 11:46:38.273 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945"
Nov 08 11:46:38.273 W ns/openshift-authentication pod/oauth-openshift-67f54bfc64-f425s node/ci-op-7i03490c-09f59-zzxg9-master-0 graceful deletion within 30s
Nov 08 11:46:38.279 I ns/openshift-authentication replicaset/oauth-openshift-67f54bfc64 Deleted pod: oauth-openshift-67f54bfc64-f425s
Nov 08 11:46:38.301 I ns/openshift-authentication pod/oauth-openshift-67f54bfc64-f425s Stopping container oauth-openshift
Nov 08 11:46:38.422 W ns/openshift-authentication pod/oauth-openshift-67f54bfc64-6qgqx node/ci-op-7i03490c-09f59-zzxg9-master-2 deleted
Nov 08 11:46:38.489 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Created container oauth-proxy
Nov 08 11:46:38.531 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Started container oauth-proxy
Nov 08 11:46:38.608 W ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Error: ImagePullBackOff
Nov 08 11:46:38.637 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Back-off pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6"
Nov 08 11:46:39.610 W ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Error: ImagePullBackOff (2 times)
Nov 08 11:46:39.630 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Back-off pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6" (2 times)
Nov 08 11:46:41.731 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "" to "RouteHealthDegraded: failed to GET route: net/http: TLS handshake timeout"
Nov 08 11:46:43.171 W clusteroperator/authentication changed Progressing to False
Nov 08 11:46:43.179 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "RouteHealthDegraded: failed to GET route: net/http: TLS handshake timeout" to "",Progressing changed from True to False ("")
Nov 08 11:46:44.459 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (42 times)
Nov 08 11:46:45.053 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (5 times)
Nov 08 11:46:50.871 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6" (2 times)
Nov 08 11:46:52.942 I ns/openshift-authentication-operator deployment/authentication-operator Updated ConfigMap/v4-0-config-system-cliconfig -n openshift-authentication: cause by changes in data.v4-0-config-system-cliconfig (2 times)
Nov 08 11:46:53.773 I ns/openshift-authentication-operator deployment/authentication-operator Updated Deployment.apps/oauth-openshift -n openshift-authentication because it changed (2 times)
Nov 08 11:46:53.800 I ns/openshift-authentication deployment/oauth-openshift Scaled up replica set oauth-openshift-b885cbd85 to 1
Nov 08 11:46:53.840 I ns/openshift-authentication pod/oauth-openshift-b885cbd85-2fsjn node/ created
Nov 08 11:46:53.857 I ns/openshift-authentication replicaset/oauth-openshift-b885cbd85 Created pod: oauth-openshift-b885cbd85-2fsjn
Nov 08 11:46:53.912 I ns/openshift-authentication pod/oauth-openshift-b885cbd85-2fsjn Successfully assigned openshift-authentication/oauth-openshift-b885cbd85-2fsjn to ci-op-7i03490c-09f59-zzxg9-master-2
Nov 08 11:46:54.034 I ns/openshift-ingress service/router-default Ensuring load balancer (21 times)
Nov 08 11:46:54.194 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Progressing changed from False to True ("Progressing: deployment's observed generation did not reach the expected generation")
Nov 08 11:46:55.209 W clusteroperator/authentication changed Progressing to True: ProgressingOAuthServerDeploymentNotReady: Progressing: deployment's observed generation did not reach the expected generation
Nov 08 11:46:57.584 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Progressing message changed from "Progressing: deployment's observed generation did not reach the expected generation" to "Progressing: not all deployment replicas are ready" (2 times)
Nov 08 11:46:59.615 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6"
Nov 08 11:46:59.778 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Created container machine-config-daemon
Nov 08 11:46:59.853 I ns/openshift-machine-config-operator pod/machine-config-daemon-9zn2n Started container machine-config-daemon
Nov 08 11:47:03.471 W ns/openshift-authentication pod/oauth-openshift-67f54bfc64-f425s node/ci-op-7i03490c-09f59-zzxg9-master-0 container=oauth-openshift container stopped being ready
Nov 08 11:47:09.339 W ns/openshift-authentication pod/oauth-openshift-67f54bfc64-f425s node/ci-op-7i03490c-09f59-zzxg9-master-0 invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:47:15.523 W ns/openshift-authentication pod/oauth-openshift-67f54bfc64-f425s node/ci-op-7i03490c-09f59-zzxg9-master-0 deleted
Nov 08 11:47:16.142 I node/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp Setting node ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp, currentConfig rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 to Done
Nov 08 11:47:31.402 I ns/openshift-authentication pod/oauth-openshift-b885cbd85-2fsjn Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:748d8c1c889ad7aaa90dca2ede7435bfd94c5af44a9dc4cb741032bddf8fd3ed" already present on machine
Nov 08 11:47:31.682 I ns/openshift-authentication pod/oauth-openshift-b885cbd85-2fsjn Created container oauth-openshift
Nov 08 11:47:31.717 I ns/openshift-authentication pod/oauth-openshift-b885cbd85-2fsjn Started container oauth-openshift
Nov 08 11:47:33.786 W ns/openshift-authentication pod/oauth-openshift-67696765bc-blq74 node/ci-op-7i03490c-09f59-zzxg9-master-2 graceful deletion within 30s
Nov 08 11:47:33.810 I ns/openshift-authentication deployment/oauth-openshift Scaled down replica set oauth-openshift-67696765bc to 1
Nov 08 11:47:33.810 I ns/openshift-authentication replicaset/oauth-openshift-67696765bc Deleted pod: oauth-openshift-67696765bc-blq74
Nov 08 11:47:33.811 I ns/openshift-authentication pod/oauth-openshift-67696765bc-blq74 Stopping container oauth-openshift
Nov 08 11:47:33.821 I ns/openshift-authentication deployment/oauth-openshift Scaled up replica set oauth-openshift-b885cbd85 to 2
Nov 08 11:47:33.877 I ns/openshift-authentication pod/oauth-openshift-b885cbd85-cm8gk node/ created
Nov 08 11:47:33.909 I ns/openshift-authentication replicaset/oauth-openshift-b885cbd85 Created pod: oauth-openshift-b885cbd85-cm8gk
Nov 08 11:47:33.936 I ns/openshift-authentication pod/oauth-openshift-b885cbd85-cm8gk Successfully assigned openshift-authentication/oauth-openshift-b885cbd85-cm8gk to ci-op-7i03490c-09f59-zzxg9-master-0
Nov 08 11:47:38.478 W ns/openshift-authentication pod/oauth-openshift-67696765bc-blq74 node/ci-op-7i03490c-09f59-zzxg9-master-2 deleted
Nov 08 11:47:41.764 I ns/openshift-authentication pod/oauth-openshift-b885cbd85-cm8gk Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:748d8c1c889ad7aaa90dca2ede7435bfd94c5af44a9dc4cb741032bddf8fd3ed" already present on machine
Nov 08 11:47:42.015 I ns/openshift-authentication pod/oauth-openshift-b885cbd85-cm8gk Created container oauth-openshift
Nov 08 11:47:42.046 I ns/openshift-authentication pod/oauth-openshift-b885cbd85-cm8gk Started container oauth-openshift
Nov 08 11:47:44.503 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "" to "RouteHealthDegraded: failed to GET route: net/http: TLS handshake timeout" (2 times)
Nov 08 11:47:45.954 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Degraded message changed from "RouteHealthDegraded: failed to GET route: net/http: TLS handshake timeout" to ""
Nov 08 11:47:48.917 I ns/openshift-authentication deployment/oauth-openshift Scaled down replica set oauth-openshift-67696765bc to 0
Nov 08 11:47:48.943 I ns/openshift-authentication replicaset/oauth-openshift-67696765bc Deleted pod: oauth-openshift-67696765bc-bkxd9
Nov 08 11:47:48.944 W ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 node/ci-op-7i03490c-09f59-zzxg9-master-1 graceful deletion within 30s
Nov 08 11:47:48.947 I ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 Stopping container oauth-openshift
Nov 08 11:47:52.346 W clusteroperator/authentication changed Progressing to False
Nov 08 11:47:52.353 I ns/openshift-authentication-operator deployment/authentication-operator Status for clusteroperator/authentication changed: Progressing changed from True to False ("")
Nov 08 11:48:10.825 I ns/openshift-image-registry pod/node-ca-8tqkg Marking for deletion Pod openshift-image-registry/node-ca-8tqkg
Nov 08 11:48:10.873 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Deleted pod: machine-config-daemon-xgbnf
Nov 08 11:48:10.873 I ns/openshift-dns pod/dns-default-rmzdv Marking for deletion Pod openshift-dns/dns-default-rmzdv
Nov 08 11:48:10.873 I ns/openshift-image-registry pod/node-ca-8tqkg Stopping container node-ca
Nov 08 11:48:10.873 W ns/openshift-image-registry pod/node-ca-8tqkg node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:48:10.874 W ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 600s
Nov 08 11:48:10.874 W ns/openshift-dns pod/dns-default-rmzdv node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh graceful deletion within 30s
Nov 08 11:48:10.909 I ns/openshift-image-registry daemonset/node-ca Deleted pod: node-ca-8tqkg
Nov 08 11:48:10.909 I ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf Stopping container machine-config-daemon
Nov 08 11:48:10.909 I ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf Stopping container oauth-proxy
Nov 08 11:48:10.909 I ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf Marking for deletion Pod openshift-machine-config-operator/machine-config-daemon-xgbnf
Nov 08 11:48:10.919 I ns/openshift-dns pod/dns-default-rmzdv Stopping container dns-node-resolver
Nov 08 11:48:10.948 I ns/openshift-dns pod/dns-default-rmzdv Stopping container dns
Nov 08 11:48:12.757 W ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:48:12.757 W ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=oauth-proxy container stopped being ready
Nov 08 11:48:12.830 W ns/openshift-dns pod/dns-default-rmzdv node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:48:12.830 W ns/openshift-dns pod/dns-default-rmzdv node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns-node-resolver container stopped being ready
Nov 08 11:48:12.830 W ns/openshift-dns pod/dns-default-rmzdv node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh container=dns container stopped being ready
Nov 08 11:48:13.772 W ns/openshift-image-registry pod/node-ca-8tqkg node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:48:13.844 W ns/openshift-dns pod/dns-default-rmzdv node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:48:13.891 W ns/openshift-machine-config-operator pod/machine-config-daemon-xgbnf node/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh deleted
Nov 08 11:48:17.310 W ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 node/ci-op-7i03490c-09f59-zzxg9-master-1 container=oauth-openshift container stopped being ready
Nov 08 11:48:19.564 W ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 node/ci-op-7i03490c-09f59-zzxg9-master-1 invariant violation (bug): pod should not transition Running->Pending even when terminated
Nov 08 11:48:19.636 E ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 node/ci-op-7i03490c-09f59-zzxg9-master-1 container=oauth-openshift container exited with code 137 (ContainerStatusUnknown): The container could not be located when the pod was terminated
Nov 08 11:48:23.162 W ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 node/ci-op-7i03490c-09f59-zzxg9-master-1 pod has been pending longer than a minute
Nov 08 11:48:28.487 W ns/openshift-authentication pod/oauth-openshift-67696765bc-bkxd9 node/ci-op-7i03490c-09f59-zzxg9-master-1 deleted
Nov 08 11:48:44.312 I ns/openshift-dns pod/dns-default-6m5gv node/ created
Nov 08 11:48:44.312 I ns/openshift-machine-config-operator pod/machine-config-daemon-qzqg9 node/ created
Nov 08 11:48:44.348 I ns/openshift-dns daemonset/dns-default Created pod: dns-default-6m5gv
Nov 08 11:48:44.348 I ns/openshift-machine-config-operator daemonset/machine-config-daemon Created pod: machine-config-daemon-qzqg9
Nov 08 11:48:44.348 I ns/openshift-machine-config-operator pod/machine-config-daemon-qzqg9 Successfully assigned openshift-machine-config-operator/machine-config-daemon-qzqg9 to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:48:44.363 I ns/openshift-dns pod/dns-default-6m5gv Successfully assigned openshift-dns/dns-default-6m5gv to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:48:44.409 I ns/openshift-image-registry pod/node-ca-qbl2k node/ created
Nov 08 11:48:44.438 I ns/openshift-image-registry daemonset/node-ca Created pod: node-ca-qbl2k
Nov 08 11:48:44.447 I ns/openshift-image-registry pod/node-ca-qbl2k Successfully assigned openshift-image-registry/node-ca-qbl2k to ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov 08 11:48:44.516 W clusteroperator/dns changed Progressing to True: Reconciling: Not all DNS DaemonSets available.
Nov 08 11:48:45.843 I ns/openshift-machine-config-operator pod/machine-config-daemon-qzqg9 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6" already present on machine
Nov 08 11:48:46.050 I ns/openshift-machine-config-operator pod/machine-config-daemon-qzqg9 Created container machine-config-daemon
Nov 08 11:48:46.098 I ns/openshift-machine-config-operator pod/machine-config-daemon-qzqg9 Started container machine-config-daemon
Nov 08 11:48:46.109 I ns/openshift-machine-config-operator pod/machine-config-daemon-qzqg9 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945" already present on machine
Nov 08 11:48:46.379 I ns/openshift-machine-config-operator pod/machine-config-daemon-qzqg9 Created container oauth-proxy
Nov 08 11:48:46.420 I ns/openshift-machine-config-operator pod/machine-config-daemon-qzqg9 Started container oauth-proxy
Nov 08 11:48:53.671 I ns/openshift-dns pod/dns-default-6m5gv Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2" already present on machine
Nov 08 11:48:53.671 I ns/openshift-image-registry pod/node-ca-qbl2k Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee" already present on machine
Nov 08 11:48:53.847 I ns/openshift-dns pod/dns-default-6m5gv Created container dns
Nov 08 11:48:53.909 I ns/openshift-dns pod/dns-default-6m5gv Started container dns
Nov 08 11:48:53.923 I ns/openshift-dns pod/dns-default-6m5gv Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29" already present on machine
Nov 08 11:48:53.963 I ns/openshift-image-registry pod/node-ca-qbl2k Created container node-ca
Nov 08 11:48:54.023 I ns/openshift-image-registry pod/node-ca-qbl2k Started container node-ca
Nov 08 11:48:54.136 I ns/openshift-dns pod/dns-default-6m5gv Created container dns-node-resolver
Nov 08 11:48:54.165 I ns/openshift-dns pod/dns-default-6m5gv Started container dns-node-resolver
Nov 08 11:49:10.577 W clusteroperator/dns changed Progressing to False: AsExpected: Desired and available number of DNS DaemonSets are equal
Nov 08 11:51:54.407 I ns/openshift-ingress service/router-default Ensuring load balancer (22 times)
Nov 08 11:53:03.903 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 (combined from similar events): Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (48 times)
Nov 08 11:53:04.501 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-2 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (13 times)
Nov 08 11:54:57.219 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (14 times)
Nov 08 11:54:57.811 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-1 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (15 times)
Nov 08 11:56:44.463 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert" not found) (8 times)
Nov 08 11:56:45.054 W ns/openshift-kube-apiserver pod/kube-apiserver-ci-op-7i03490c-09f59-zzxg9-master-0 Removed file for secret: /%!(EXTRA *errors.StatusError=secrets "user-serving-cert-008" not found) (7 times)
Nov 08 11:56:54.781 I ns/openshift-ingress service/router-default Ensuring load balancer (23 times)


				Click to see stdout/stderrfrom junit_e2e_20191108-120052.xml

Find was mentions in log files

openshift-tests [Feature:Machines][Serial] Managed cluster should grow and decrease when scaling different machineSets simultaneously [Suite:openshift/conformance/serial] 12m5s

go run hack/e2e.go -v -test --test_args='--ginkgo.focus=openshift\-tests\s\[Feature\:Machines\]\[Serial\]\sManaged\scluster\sshould\sgrow\sand\sdecrease\swhen\sscaling\sdifferent\smachineSets\ssimultaneously\s\[Suite\:openshift\/conformance\/serial\]$'

fail [github.com/openshift/origin/test/extended/machines/scale.go:201]: Timed out after 720.002s.
Expected
    <bool>: false
to be true
				
Nov  8 11:29:06.197: INFO: >>> kubeConfig: /tmp/admin.kubeconfig
Nov  8 11:29:06.200: INFO: >>> kubeConfig: /tmp/admin.kubeconfig
Nov  8 11:29:06.663: INFO: >>> kubeConfig: /tmp/admin.kubeconfig
Nov  8 11:29:07.876: INFO: >>> kubeConfig: /tmp/admin.kubeconfig
Nov  8 11:29:07.877: INFO: Waiting up to 30m0s for all (but 100) nodes to be schedulable
Nov  8 11:29:08.098: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'kube-system' to be running and ready
Nov  8 11:29:08.349: INFO: 0 / 0 pods in namespace 'kube-system' are running and ready (0 seconds elapsed)
Nov  8 11:29:08.349: INFO: expected 0 pod replicas in namespace 'kube-system', 0 are Running and Ready.
Nov  8 11:29:08.349: INFO: Waiting up to 5m0s for all daemonsets in namespace 'kube-system' to start
Nov  8 11:29:08.431: INFO: e2e test version: v1.16.2
Nov  8 11:29:08.504: INFO: kube-apiserver version: v1.16.2
Nov  8 11:29:08.504: INFO: >>> kubeConfig: /tmp/admin.kubeconfig
Nov  8 11:29:08.587: INFO: Cluster IP family: ipv4
[BeforeEach] [Top Level]
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/util/test.go:60
[It] grow and decrease when scaling different machineSets simultaneously [Suite:openshift/conformance/serial]
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/machines/scale.go:142
Nov  8 11:29:08.591: INFO: >>> kubeConfig: /tmp/admin.kubeconfig
Nov  8 11:29:08.592: INFO: >>> kubeConfig: /tmp/admin.kubeconfig
STEP: fetching worker machineSets
Nov  8 11:29:08.675: INFO: Labels map[string]interface {}{"machine.openshift.io/cluster-api-cluster":"ci-op-7i03490c-09f59-zzxg9", "machine.openshift.io/cluster-api-machine-role":"worker", "machine.openshift.io/cluster-api-machine-type":"worker", "machine.openshift.io/cluster-api-machineset":"ci-op-7i03490c-09f59-zzxg9-worker-westus"}
STEP: checking initial cluster workers size
STEP: initial cluster workers size is 3
STEP: scaling "ci-op-7i03490c-09f59-zzxg9-worker-westus" from 3 to 4 replicas
Nov  8 11:29:08.758: INFO: >>> kubeConfig: /tmp/admin.kubeconfig
STEP: checking scaled up worker nodes are ready
Nov  8 11:29:09.478: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 54882 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 55114 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 54879 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:29:09.730: INFO: node count : 3, expectedCount 4
Nov  8 11:29:09.730: INFO: node: ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4
Nov  8 11:29:09.730: INFO: node: ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh
Nov  8 11:29:09.730: INFO: node: ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn
Nov  8 11:29:14.963: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56557 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 54882 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 55114 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 54879 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:29:14.964: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:29:20.198: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 54882 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 55114 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 54879 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:29:20.199: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:29:25.431: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 54882 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 55114 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 54879 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:29:25.433: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:29:30.666: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 54882 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 55114 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:29:30.667: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:29:35.901: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56637 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 55114 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:29:35.903: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:29:41.137: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56637 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 55114 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:29:41.139: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:29:46.375: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56637 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 55114 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:28:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:29:46.377: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:29:51.611: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56637 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:29:51.613: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:29:56.846: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56637 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:29:56.847: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:02.080: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56637 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:02.081: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:07.315: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56637 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:07.315: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:12.549: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56637 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:12.550: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:17.784: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56637 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:17.785: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:23.018: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56637 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:23.019: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:28.258: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56637 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56632 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:28.259: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:33.491: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56915 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56910 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:33.492: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:38.724: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56915 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56910 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:38.725: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:43.959: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56915 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56910 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:43.960: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:49.192: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56915 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 56744 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:29:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56910 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:49.193: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:54.431: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56915 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 57017 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56910 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:54.432: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:30:59.664: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56915 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 57017 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56910 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:30:59.665: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:31:04.898: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56915 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 57017 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56910 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:31:04.899: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:31:10.131: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56915 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 57017 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56910 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:31:10.132: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:31:15.365: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:13731 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:569f6dd5-2042-4354-88ef-22a01b9ea9da] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.5 type:InternalIP]] lastUpdated:2019-11-08T10:26:52Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 uid:089934ba-667c-4a66-85c6-813c5b632428] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:30Z lastTransitionTime:2019-11-08T10:20:00Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Creating] creationTimestamp:2019-11-08T11:29:09Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:2 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:56567 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp uid:be07b524-387a-4b2c-b265-c5284d8d858f] spec:map[metadata:map[creationTimestamp:<nil>] providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[lastUpdated:2019-11-08T11:29:14Z phase:Provisioning providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T11:29:14Z lastTransitionTime:2019-11-08T11:29:12Z message:failed to create vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp : vm ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp is still in provisioning state Creating, reconcile reason:MachineCreationFailed status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-hbmqp vmState:Creating]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14531 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:dbb75d3f-0c39-4acf-8395-ff3f93ab5a74] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.4 type:InternalIP]] lastUpdated:2019-11-08T10:28:07Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh uid:95fb8133-7dcf-4e64-8c6d-5c226f2eed8c] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:22:09Z lastTransitionTime:2019-11-08T10:19:57Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh vmState:Running]]] map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn namespace:openshift-machine-api ownerReferences:[map[apiVersion:machine.openshift.io/v1beta1 blockOwnerDeletion:true controller:true kind:MachineSet name:ci-op-7i03490c-09f59-zzxg9-worker-westus uid:15fda01e-f286-4c34-aa6d-b2b3bc6e67d3]] resourceVersion:14365 selfLink:/apis/machine.openshift.io/v1beta1/namespaces/openshift-machine-api/machines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:281f7c44-361d-4631-96ff-cf0b0e85b701] spec:map[metadata:map[creationTimestamp:<nil>] providerID:azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn providerSpec:map[value:map[apiVersion:azureproviderconfig.openshift.io/v1beta1 credentialsSecret:map[name:azure-cloud-credentials namespace:openshift-machine-api] image:map[offer: publisher: resourceID:/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/images/ci-op-7i03490c-09f59-zzxg9 sku: version:] kind:AzureMachineProviderSpec location:westus managedIdentity:ci-op-7i03490c-09f59-zzxg9-identity metadata:map[creationTimestamp:<nil>] networkResourceGroup:ci-op-7i03490c-09f59-zzxg9-rg osDisk:map[diskSizeGB:128 managedDisk:map[storageAccountType:Premium_LRS] osType:Linux] publicIP:false resourceGroup:ci-op-7i03490c-09f59-zzxg9-rg subnet:ci-op-7i03490c-09f59-zzxg9-worker-subnet userDataSecret:map[name:worker-user-data] vmSize:Standard_D2s_v3 vnet:ci-op-7i03490c-09f59-zzxg9-vnet zone:]]] status:map[addresses:[map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:Hostname] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn type:InternalDNS] map[address:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn.krzifrpokn0urg1f1vklc1us5f.dx.internal.cloudapp.net type:InternalDNS] map[address:10.0.32.6 type:InternalIP]] lastUpdated:2019-11-08T10:27:55Z nodeRef:map[kind:Node name:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn uid:66485f99-8ce5-4d42-bff0-e833825d7705] phase:Running providerStatus:map[conditions:[map[lastProbeTime:2019-11-08T10:21:59Z lastTransitionTime:2019-11-08T10:20:03Z message:machine successfully created reason:MachineCreationSucceeded status:True type:MachineCreated]] metadata:map[creationTimestamp:<nil>] vmId:/subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn vmState:Running]]]], nodes found: [{{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 089934ba-667c-4a66-85c6-813c5b632428 56915 0 2019-11-08 10:25:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:25:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:31 +0000 UTC 2019-11-08 10:26:52 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4} {InternalIP 10.0.32.5}] {{10250}} {088b36547a9b4f8c986af2acbb7b98cc 3a160a1d-aa9b-a448-9a4e-e6477c6e4739 a4a5240e-7eb2-4c4b-97af-c49d04a53747 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:448858c7b1f70b8c0955965ef9970b59504b220bf03b760203305c81e5f606da <none>:<none>] 459488467} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4753bca36792206b5e9df9612f695fc2c3a80a54d56b01a10f774dc1b62899be <none>:<none>] 300114146} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24ef740f2376db3bc5e0f8ba14da8ee6ad52aa2dce357781b6fccc9081bf008f <none>:<none>] 297967111} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4842a43d24fb9658a83ab8accad8cf1b8fb07141124517a0ec39a09637a5d186 <none>:<none>] 281283135} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b0c04ed78fe07c8c7ba6efec2be18908955710281189051eaea6942d424a56f <none>:<none>] 279301724} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh 95fb8133-7dcf-4e64-8c6d-5c226f2eed8c 57017 0 2019-11-08 10:26:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:26:45 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:51 +0000 UTC 2019-11-08 10:28:07 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh} {InternalIP 10.0.32.4}] {{10250}} {2213e79eeea045adad90fe5853d1b097 13d0f4b8-feb8-5b4d-ac72-e0718cf7c5dd 9235aa8d-4f4b-4e66-97a3-274e76d3c9f5 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}} {{ } {ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn   /api/v1/nodes/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn 66485f99-8ce5-4d42-bff0-e833825d7705 56910 0 2019-11-08 10:26:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn kubernetes.io/os:linux node-role.kubernetes.io/worker: node.openshift.io/os_id:rhcos] map[machine.openshift.io/machine:openshift-machine-api/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn machineconfiguration.openshift.io/currentConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/desiredConfig:rendered-worker-5e41d1a29d450d4619d976ee68ec1b37 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  []} { [] azure:///subscriptions/d38f1e38-4bed-438e-b227-833f997adf6a/resourceGroups/ci-op-7i03490c-09f59-zzxg9-rg/providers/Microsoft.Compute/virtualMachines/ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn false [] nil } {map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{2 0} {<nil>} 2 DecimalSI} ephemeral-storage:{{136890527744 0} {<nil>} 133682156Ki BinarySI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{8335872000 0} {<nil>} 8140500Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}] map[attachable-volumes-azure-disk:{{4 0} {<nil>} 4 DecimalSI} cpu:{{1500 -3} {<nil>} 1500m DecimalSI} ephemeral-storage:{{123201474766 0} {<nil>} 123201474766 DecimalSI} hugepages-1Gi:{{0 0} {<nil>} 0 DecimalSI} hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{7706726400 0} {<nil>} 7526100Ki BinarySI} pods:{{250 0} {<nil>} 250 DecimalSI}]  [{MemoryPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:26:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-08 11:30:30 +0000 UTC 2019-11-08 10:27:55 +0000 UTC KubeletReady kubelet is posting ready status}] [{Hostname ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn} {InternalIP 10.0.32.6}] {{10250}} {e60defc721d04993a45647095cdf41d1 c5886c8e-4982-3f42-adc7-509e7f2f6091 d3dc666c-ddf8-4396-b65a-b172576b2dab 4.18.0-147.el8.x86_64 Red Hat Enterprise Linux CoreOS 43.81.201911080455.0 (Ootpa) cri-o://1.16.0-0.6.dev.rhaos4.3.git9ad059b.el8-rc2 v1.16.2 v1.16.2 linux amd64} [{[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3191fc23d0d7e820100498c5085592219a747743f06fc059436945df6ab3e8ee <none>:<none>] 1532594613} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b308839b51f004db51879b9ea80789b6577e906e70f895a245f893bd39fb5a58 <none>:<none>] 467733144} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9bff84c0b9b83894b9340f11a98428b8d561dc5c0d28ab8661c6032cc4c08705 <none>:<none>] 445135574} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076edf7d71cc9dea037972fafa0d7a25c5cbb827a2a3bdbce97010657e751cb6 <none>:<none>] 441815244} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26e239b1b6588f0a3bdfd921bb1e816f9d64e7a400fc334817521f3d9c67d2ce <none>:<none>] 393711139} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce5cf60d260dd8be75a016c30c7724b254f607573b9388da266d78fb3ac49757 <none>:<none>] 339783374} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd150f3e4a29d160fae9610f1096180eaeb29ff29b63bf490b0022b4d3913e29 <none>:<none>] 332659736} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf187f44c7273f1328d614d1dcd9f701c5f66cf8849143e34c8d1f88d5e2ce55 <none>:<none>] 315054604} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ece12ae9ebfcce0c5b8d8a2eff009a1706a070e9021e96112dbbe6711795a35 <none>:<none>] 314415218} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3207589b466325f1ee9decd9f41416ca20597d409d6071c3614ce2f5e9626368 <none>:<none>] 311838751} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:614764223d37c466a211f456a9d02c5881d947e1f05d541689dc34a3ec19acf2 <none>:<none>] 306447854} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d96246be6464e56863cc2b85ad14586e5034d0ee39aced7c90adab6f46e260f <none>:<none>] 290516496} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5366da9d7c15f912b609cdbb2851d01ea863fb22d452081914d923d8208c39c8 <none>:<none>] 285868112} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78ba454f09557364dabd918265784493287ed242fb51ac2ffde695ae78823736 <none>:<none>] 277788312} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f711682524b64033a4ce9193bd2cd9621e08b4bae44cffffb4e397a43a8f945 <none>:<none>] 271210379} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db10cd1f5efd9e9e6f2b0eea0a665f53399e25de374cf916ad7d8141f8ac643d <none>:<none>] 257960046} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9a3a81674e3aa3d54fc056ba4907a2f48b867c375d8fe86e05d9e1c99489eade <none>:<none>] 256929413} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3f70f20ce6be55711b54bc266019d215963935779c178e52ea4bc717da58508 <none>:<none>] 250744382} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7d5edb31f42f0b66d3f9848af5a65fa82c12014aecdc916b846d0b40a2d46e0a <none>:<none>] 244022997} {[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8aefd089984c2e7d9dd7a162bd8e23bb9e492b494f6c285c2a8272f8230ff9e <none>:<none>] 238782787} {[docker.io/library/fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 docker.io/library/fedora@sha256:d4f7df6b691d61af6cee7328f82f1d8afdef63bc38f58516858ae3045083924a docker.io/library/fedora:latest] 201096840} {[docker.io/library/httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine] 128894988} {[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4273341f784390e3fd568bee1bf86efe6ef4ad4a7a1a75c0dcd01776683d669a gcr.io/kubernetes-e2e-test-images/agnhost:2.6] 59923897} {[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 docker.io/library/busybox:1.29] 1374850} {[k8s.gcr.io/pause@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1] 748776}] [] [] nil}}]
Nov  8 11:31:15.366: INFO: Error getting nodes from machineSet: not all machines have a node reference: map[ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4:ci-op-7i03490c-09f59-zzxg9-worker-westus-6vgr4 ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh:ci-op-7i03490c-09f59-zzxg9-worker-westus-r85gh ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn:ci-op-7i03490c-09f59-zzxg9-worker-westus-v8drn]
Nov  8 11:31:20.670: INFO: Machines found [map[apiVersion:machine.openshift.io/v1beta1 kind:Machine metadata:map[annotations:map[machine.openshift.io/instance-state:Running] creationTimestamp:2019-11-08T10:19:50Z finalizers:[machine.machine.openshift.io] generateName:ci-op-7i03490c-09f59-zzxg9-worker-westus- generation:3 labels:map[machine.openshift.io/cluster-api-cluster:ci-op-7i03490c-09f59-zzxg9 machine.openshift.io/cluster-api-machine-role:worker machine.openshift.io/cluster-api-machine-type:worker machine.openshift.io/cluster-api-machineset:ci-op-7i03490c-09f59-zzxg9-worker-westus machine.openshift.io/instance-type:Standard_D2s_v3 machine.openshift.io/region:westus] name:ci-op-7i03490