ResultFAILURE
Tests 4 failed / 845 succeeded
Started2019-11-05 09:58
Elapsed3h19m
Work namespaceci-op-247ct78f
pod4.2.0-0.nightly-2019-11-05-094918-metal

Test Failures

openshift-tests Monitor cluster while tests execute 1h17m

go run hack/e2e.go -v -test --test_args='--ginkgo.focus=openshift\-tests\sMonitor\scluster\swhile\stests\sexecute$'
1 error level events were detected during this test run:

Nov 05 11:43:30.490 E ns/openshift-ingress pod/router-prometheus-75cf87856c-6s4ww node/worker-0.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com container=router container exited with code 2 (Error): go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:40:25.509820       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:40:30.514086       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:40:35.511192       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:40:43.011250       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:40:52.960393       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:40:57.961030       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:41:19.985028       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:42:23.143345       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:42:48.763255       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:42:53.765062       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:43:04.943298       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:43:09.942303       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:43:14.945336       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\nI1105 11:43:24.537463       1 router.go:561] Router reloaded:\n - Checking http://localhost:80 ...\n - Health check ok : 0 retry attempt(s).\n

				
				Click to see stdout/stderrfrom junit_e2e_20191105-124433.xml

Filter through log files

openshift-tests [Feature:Prometheus][Conformance] Prometheus when installed on the cluster should report less than two alerts in firing or pending state [Suite:openshift/conformance/parallel/minimal] 15m57s

go run hack/e2e.go -v -test --test_args='--ginkgo.focus=openshift\-tests\s\[Feature\:Prometheus\]\[Conformance\]\sPrometheus\swhen\sinstalled\son\sthe\scluster\sshould\sreport\sless\sthan\stwo\salerts\sin\sfiring\sor\spending\sstate\s\[Suite\:openshift\/conformance\/parallel\/minimal\]$'
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956604.592,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:23:25.710: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:23:28.589: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:23:28.589: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956608.47,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956608.47,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:23:29.590: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:23:33.023: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:23:33.023: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956612.907,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956612.907,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:23:34.025: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:23:37.482: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:23:37.482: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956617.363,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956617.363,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:23:38.484: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:23:40.507: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:23:40.507: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956620.45,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956620.45,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:23:41.507: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:23:43.185: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:23:43.185: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956623.129,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956623.129,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:23:44.186: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:23:47.239: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:23:47.239: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956627.127,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956627.127,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:23:48.239: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:23:51.523: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:23:51.523: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956631.407,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956631.407,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:23:52.523: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:23:55.686: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:23:55.686: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956635.569,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956635.569,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:23:56.686: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:23:59.582: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:23:59.582: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956639.468,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956639.468,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:24:00.583: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:24:03.481: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:24:03.481: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956643.368,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956643.368,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:24:04.482: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:24:07.527: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:24:07.527: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956647.412,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956647.412,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:24:08.528: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:24:11.663: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:24:11.663: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956651.547,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956651.547,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:24:12.664: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:24:15.439: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:24:15.439: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956655.318,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956655.318,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:24:16.441: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:24:19.881: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:24:19.881: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956659.753,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956659.753,"22"]}]}}
---------------------------------------------------------
Received interrupt.  Running AfterSuite...
^C again to terminate immediately
Nov  5 12:24:20.378: INFO: Running AfterSuite actions on all nodes
Nov  5 12:24:20.378: INFO: Waiting up to 3m0s for all (but 100) nodes to be ready
STEP: Destroying namespace "e2e-test-prometheus-c7rdk" for this suite.
STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:24:20.882: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:24:22.982: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:24:22.982: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956662.925,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956662.925,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:24:23.983: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:24:25.656: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:24:25.656: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956665.602,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956665.602,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:24:26.657: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:24:29.411: INFO: stderr: "+ curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29'\n"
Nov  5 12:24:29.411: INFO: stdout: "{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{},\"value\":[1572956669.286,\"22\"]}]}}"
query sum(ALERTS{alertstate="firing"}) for tests []prometheus.metricTest{prometheus.metricTest{labels:map[string]string(nil), greaterThanEqual:false, value:2, success:false}} had results {"status":"success","data":{"resultType":"vector","result":[{"metric":{},"value":[1572956669.286,"22"]}]}}STEP: perform prometheus metric query sum(ALERTS{alertstate="firing"})
Nov  5 12:24:30.416: INFO: Running '/usr/bin/kubectl --server=https://api.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com:6443 --kubeconfig=/tmp/admin.kubeconfig exec --namespace=e2e-test-prometheus-c7rdk execpodkn2h7 -- /bin/sh -x -c curl -s -k -H 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJvcGVuc2hpZnQtbW9uaXRvcmluZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJwcm9tZXRoZXVzLWFkYXB0ZXItdG9rZW4ta2N3ZHEiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoicHJvbWV0aGV1cy1hZGFwdGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiMGNlNWQ5MWUtZmZiYi0xMWU5LWI3NjItMGNjNDdhYjI5OWRlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50Om9wZW5zaGlmdC1tb25pdG9yaW5nOnByb21ldGhldXMtYWRhcHRlciJ9.pZtO0JFe13BYyQb0TP8B0aCN1U-sBnBFMx3OTCmKUcRHKDZO1xGnCyde-TEddepp64dmrTMdf8W2o2qKwbu4A5U9jb6Cm6a4Ct_yqKouIIxrh7ipFvCx_XdY24A8unaCIHT2U8gtIyGJcX6_x2Pq6hMqmkw4905SHZKpVAIFBZf1G-h1_wjAu6MFW0jg0MWKbC2AnwQO1ah7J4ksBnyAnX_GEJ6OPnEWJQ8NG3N5BX8rOfCA29Fj40GwqXlIM0GbOogYWzYY281nDRnteghxt5rg60t9YdF9S_qvaySBw2F1ixafGK_yNRcNJvz0W25PKM0Hc313T_-oydpRgaPE8g' "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=sum%28ALERTS%7Balertstate%3D%22firing%22%7D%29"'
Nov  5 12:24:31.212: INFO: rc: 1
[AfterEach] [Feature:Prometheus][Conformance] Prometheus
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/util/client.go:120
STEP: Collecting events from namespace "e2e-test-prometheus-c7rdk".
STEP: Found 4 events.
Nov  5 12:24:31.776: INFO: At 2019-11-05 12:10:03 +0000 UTC - event for execpodkn2h7: {default-scheduler } Scheduled: Successfully assigned e2e-test-prometheus-c7rdk/execpodkn2h7 to worker-1.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com
Nov  5 12:24:31.776: INFO: At 2019-11-05 12:10:12 +0000 UTC - event for execpodkn2h7: {kubelet worker-1.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com} Pulled: Container image "centos:7" already present on machine
Nov  5 12:24:31.776: INFO: At 2019-11-05 12:10:12 +0000 UTC - event for execpodkn2h7: {kubelet worker-1.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com} Created: Created container exec
Nov  5 12:24:31.777: INFO: At 2019-11-05 12:10:12 +0000 UTC - event for execpodkn2h7: {kubelet worker-1.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com} Started: Started container exec
Nov  5 12:24:32.046: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov  5 12:24:32.046: INFO: 
Nov  5 12:24:32.466: INFO: skipping dumping cluster info - cluster too large
Nov  5 12:24:33.217: INFO: Deleted {user.openshift.io/v1, Resource=users  e2e-test-prometheus-c7rdk-user}, err: <nil>
Nov  5 12:24:34.157: INFO: Deleted {oauth.openshift.io/v1, Resource=oauthclients  e2e-client-e2e-test-prometheus-c7rdk}, err: <nil>
Nov  5 12:24:35.096: INFO: Deleted {oauth.openshift.io/v1, Resource=oauthaccesstokens  6ALggEacTLaX6Xt4YUBCpwAAAAAAAAAA}, err: <nil>
[AfterEach] [Feature:Prometheus][Conformance] Prometheus
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150
Nov  5 12:24:35.096: INFO: Waiting up to 3m0s for all (but 100) nodes to be ready
STEP: Destroying namespace "e2e-test-prometheus-c7rdk" for this suite.
Nov  5 12:24:35.804: INFO: Couldn't delete ns: "e2e-test-prometheus-c7rdk": Operation cannot be fulfilled on namespaces "e2e-test-prometheus-c7rdk": The system is ensuring all content is removed from this namespace.  Upon completion, this namespace will automatically be purged by the system. (&errors.StatusError{ErrStatus:v1.Status{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ListMeta:v1.ListMeta{SelfLink:"", ResourceVersion:"", Continue:""}, Status:"Failure", Message:"Operation cannot be fulfilled on namespaces \"e2e-test-prometheus-c7rdk\": The system is ensuring all content is removed from this namespace.  Upon completion, this namespace will automatically be purged by the system.", Reason:"Conflict", Details:(*v1.StatusDetails)(0xc00365ed80), Code:409}})
Nov  5 12:24:55.669: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered
Nov  5 12:25:17.081: INFO: namespace e2e-test-prometheus-c7rdk deletion completed in 56.289485679s
Nov  5 12:25:17.081: INFO: Running AfterSuite actions on node 1
				
				Click to see stdout/stderrfrom junit_e2e_20191105-124433.xml

Filter through log files

openshift-tests [cli] oc adm must-gather runs successfully [Suite:openshift/conformance/parallel] 16m0s

go run hack/e2e.go -v -test --test_args='--ginkgo.focus=openshift\-tests\s\[cli\]\soc\sadm\smust\-gather\sruns\ssuccessfully\s\[Suite\:openshift\/conformance\/parallel\]$'
github.com/openshift/origin/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc003f121c0, 0xc002df65a0, 0x0, 0x0, 0x0)
	/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/golang.org/x/net/http2/frame.go:492 +0xa1
github.com/openshift/origin/vendor/golang.org/x/net/http2.(*clientConnReadLoop).run(0xc003ebbfb8, 0x5afa398, 0xc00077cfb8)
	/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/golang.org/x/net/http2/transport.go:1679 +0x8d
github.com/openshift/origin/vendor/golang.org/x/net/http2.(*ClientConn).readLoop(0xc001610000)
	/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/golang.org/x/net/http2/transport.go:1607 +0x76
created by github.com/openshift/origin/vendor/golang.org/x/net/http2.(*Transport).newClientConn
	/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/golang.org/x/net/http2/transport.go:670 +0x637

goroutine 196 [IO wait, 15 minutes]:
internal/poll.runtime_pollWait(0x7f9357436f30, 0x72, 0xffffffffffffffff)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc001ef6f98, 0x72, 0xb00, 0xb2d, 0xffffffffffffffff)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc001ef6f80, 0xc001716000, 0xb2d, 0xb2d, 0x0, 0x0, 0x0)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc001ef6f80, 0xc001716000, 0xb2d, 0xb2d, 0x203000, 0x0, 0xb20)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc004078b28, 0xc001716000, 0xb2d, 0xb2d, 0x0, 0x0, 0x0)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc0034a6840, 0xc001716000, 0xb2d, 0xb2d, 0x34f, 0x639f080, 0xc00009a9e0)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc003ef5058, 0x639ee40, 0xc0034a6840, 0x40f965, 0x4ee93e0, 0x56e0a80)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc003ef4e00, 0x63a4a80, 0xc004078b28, 0x5, 0xc004078b28, 0x332)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc003ef4e00, 0x5b02f00, 0xc003ef4f38, 0x0)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc003ef4e00, 0xc0021b9000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/crypto/tls/conn.go:1236 +0x137
bufio.(*Reader).Read(0xc0024ad080, 0xc003737378, 0x9, 0x9, 0xc00009ad00, 0x446ddb, 0xc00009ad28)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/bufio/bufio.go:223 +0x23e
io.ReadAtLeast(0x639eba0, 0xc0024ad080, 0xc003737378, 0x9, 0x9, 0x9, 0xc003f16700, 0x329, 0x34b)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/io/io.go:310 +0x88
io.ReadFull(...)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/io/io.go:329
github.com/openshift/origin/vendor/golang.org/x/net/http2.readFrameHeader(0xc003737378, 0x9, 0x9, 0x639eba0, 0xc0024ad080, 0x0, 0x0, 0x0, 0x0)
	/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/golang.org/x/net/http2/frame.go:237 +0x88
github.com/openshift/origin/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc003737340, 0xc003568600, 0x0, 0x0, 0x0)
	/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/golang.org/x/net/http2/frame.go:492 +0xa1
github.com/openshift/origin/vendor/golang.org/x/net/http2.(*clientConnReadLoop).run(0xc00009afb8, 0x5afa398, 0xc00077a7b8)
	/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/golang.org/x/net/http2/transport.go:1679 +0x8d
github.com/openshift/origin/vendor/golang.org/x/net/http2.(*ClientConn).readLoop(0xc002542c00)
	/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/golang.org/x/net/http2/transport.go:1607 +0x76
created by github.com/openshift/origin/vendor/golang.org/x/net/http2.(*Transport).newClientConn
	/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/golang.org/x/net/http2/transport.go:670 +0x637

goroutine 217 [IO wait]:
internal/poll.runtime_pollWait(0x7f9357436cc0, 0x72, 0xffffffffffffffff)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc003175578, 0x72, 0x4301, 0x431d, 0xffffffffffffffff)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc003175560, 0xc003febae3, 0x431d, 0x431d, 0x0, 0x0, 0x0)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/internal/poll/fd_unix.go:169 +0x19b
os.(*File).read(...)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/os/file_unix.go:263
os.(*File).Read(0xc004117168, 0xc003febae3, 0x431d, 0x431d, 0x13e, 0x0, 0x0)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/os/file.go:108 +0x70
bytes.(*Buffer).ReadFrom(0xc0032af020, 0x63a4ea0, 0xc004117168, 0x7f935739a600, 0xc0032af020, 0x6484b01)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/bytes/buffer.go:207 +0xbd
io.copyBuffer(0x639ec60, 0xc0032af020, 0x63a4ea0, 0xc004117168, 0x0, 0x0, 0x0, 0x0, 0x0, 0x58404e7)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/io/io.go:388 +0x2fc
io.Copy(...)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/io/io.go:364
os/exec.(*Cmd).writerDescriptor.func1(0x0, 0x462da1)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/os/exec/exec.go:288 +0x63
os/exec.(*Cmd).Start.func1(0xc0024c11e0, 0xc0032b23c0)
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/os/exec/exec.go:409 +0x27
created by os/exec.(*Cmd).Start
	/opt/rh/go-toolset-1.12/root/usr/lib/go-toolset-1.12-golang/src/os/exec/exec.go:408 +0x58f

goroutine 205 [chan receive]:
github.com/openshift/origin/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).registerForHardInterrupts(0xc002315b80)
	/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:244 +0xc0
created by github.com/openshift/origin/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).registerForInterrupts
	/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:223 +0x104

rax    0xfffffffffffffffc
rbx    0x3b9a7529
rcx    0xffffffffffffffff
rdx    0x0
rdi    0xa6b9d00
rsi    0x80
rbp    0xc00077e6e8
rsp    0xc00077e6a0
r8     0x0
r9     0x0
r10    0xc00077e6d8
r11    0x202
r12    0xc00297a600
r13    0xc00298a310
r14    0x0
r15    0x200
rip    0x464bf3
rflags 0x202
cs     0x33
fs     0x0
gs     0x0
				
				Click to see stdout/stderrfrom junit_e2e_20191105-124433.xml

Filter through log files

operator Run template e2e-metal - e2e-metal container test 1h33m

go run hack/e2e.go -v -test --test_args='--ginkgo.focus=operator\sRun\stemplate\se2e\-metal\s\-\se2e\-metal\scontainer\stest$'
oauth-server-headers-pllrm/test-oauth-svc: endpoints "test-oauth-svc" is forbidden: unable to create new content in namespace e2e-test-oauth-server-headers-pllrm because it is being terminated (4 times)
Nov 05 12:09:35.435 W endpoints/test-oauth-svc Failed to create endpoint for service e2e-test-oauth-server-headers-pllrm/test-oauth-svc: endpoints "test-oauth-svc" is forbidden: unable to create new content in namespace e2e-test-oauth-server-headers-pllrm because it is being terminated (5 times)
Nov 05 12:10:10.272 I ns/default pod/recycler-for-nfs-2ml5q Pod was active on the node longer than the specified deadline
Nov 05 12:10:10.341 I persistentvolume/nfs-2ml5q Recycler pod: Pod was active on the node longer than the specified deadline
Nov 05 12:10:10.475 I ns/default pod/recycler-for-nfs-2ml5q Stopping container pv-recycler
Nov 05 12:10:10.543 I persistentvolume/nfs-2ml5q Recycler pod: Stopping container pv-recycler
Nov 05 12:10:11.480 W ns/default pod/recycler-for-nfs-2ml5q node/worker-0.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com container=pv-recycler container stopped being ready
Nov 05 12:10:11.682 W ns/default pod/recycler-for-nfs-2ml5q node/worker-0.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com graceful deletion within 0s
Nov 05 12:10:11.883 W ns/default pod/recycler-for-nfs-2ml5q node/worker-0.ci-op-247ct78f-5e7ab.origin-ci-int-aws.dev.rhcloud.com deleted
Nov 05 12:25:17.092 I test="[Feature:Prometheus][Conformance] Prometheus when installed on the cluster should report less than two alerts in firing or pending state [Suite:openshift/conformance/parallel/minimal]" failed

Flaky tests:

[cli] oc adm must-gather runs successfully [Suite:openshift/conformance/parallel]

Failing tests:

[Feature:Prometheus][Conformance] Prometheus when installed on the cluster should report less than two alerts in firing or pending state [Suite:openshift/conformance/parallel/minimal]

Writing JUnit report to /tmp/artifacts/junit/junit_e2e_20191105-124433.xml

error: 2 fail, 841 pass, 1301 skip (1h17m31s)

				from junit_operator.xml

Filter through log files

Show 845 Passed Tests