Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[7.11] [Task Manager] adds more granular polling results to monitoring stats (#87494) #87540

Merged
merged 1 commit into from
Jan 6, 2021

Conversation

gmmorris
Copy link
Contributor

@gmmorris gmmorris commented Jan 6, 2021

Backports the following commits to 7.11:

…elastic#87494)

Added the following values to the Polling stats:

- **NoAvailableWorkers**: This tells us when a polling cycle resulted in no tasks being claimed due to there being no available workers 
- **RunningAtCapacity**: This tells us when a polling cycle resulted in tasks being claimed at 100% capacity of the available workers
- **Failed**: This tells us when the poller failed to claim
@kibanamachine
Copy link
Contributor

💛 Build succeeded, but was flaky


Test Failures

X-Pack API Integration Tests.x-pack/test/api_integration/apis/lens/existing_fields·ts.apis Lens existing_fields apis existence should find which fields exist in the sample documents

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 6 times on tracked branches: https://github.com/elastic/kibana/issues/77567

[00:00:00]       │
[00:00:00]         └-: apis
[00:00:00]           └-> "before all" hook
[00:07:04]           └-: Lens
[00:07:04]             └-> "before all" hook
[00:07:04]             └-: existing_fields apis
[00:07:04]               └-> "before all" hook
[00:07:04]               └-> "before all" hook
[00:07:04]                 │ info [logstash_functional] Loading "mappings.json"
[00:07:04]                 │ info [logstash_functional] Loading "data.json.gz"
[00:07:04]                 │ info [logstash_functional] Skipped restore for existing index "logstash-2015.09.22"
[00:07:04]                 │ info [logstash_functional] Skipped restore for existing index "logstash-2015.09.20"
[00:07:04]                 │ info [logstash_functional] Skipped restore for existing index "logstash-2015.09.21"
[00:07:05]                 │ info [visualize/default] Loading "mappings.json"
[00:07:05]                 │ info [visualize/default] Loading "data.json"
[00:07:05]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] [.kibana_1/fssITfEtTH-2z9roRM9kyQ] deleting index
[00:07:05]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] [.kibana_2/UiVDNu7hT_eo8_fz4IXi8g] deleting index
[00:07:05]                 │ info [visualize/default] Deleted existing index [".kibana_2",".kibana_1"]
[00:07:05]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] [.kibana] creating index, cause [auto(bulk api)], templates [], shards [1]/[1]
[00:07:05]                 │ info [visualize/default] Skipped restore for existing index ".kibana"
[00:07:05]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] [metricbeat-7] creating index, cause [auto(bulk api)], templates [], shards [1]/[1]
[00:07:05]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] [.kibana/S8WhhBYcTUO31sUmMU-CpQ] create_mapping [_doc]
[00:07:06]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] [metricbeat-7/AJvhvrWzQrqLnTzWlyXG7w] create_mapping [_doc]
[00:07:06]                 │ info [visualize/default] Indexed 1 docs into "metricbeat-7"
[00:07:06]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] [.kibana/S8WhhBYcTUO31sUmMU-CpQ] update_mapping [_doc]
[00:07:06]                 │ debg Migrating saved objects
[00:07:06]                 │ proc [kibana]   log   [19:02:43.284] [info][savedobjects-service] Creating index .kibana_2.
[00:07:06]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1]
[00:07:06]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] updating number_of_replicas to [0] for indices [.kibana_2]
[00:07:06]                 │ proc [kibana]   log   [19:02:43.345] [info][savedobjects-service] Reindexing .kibana to .kibana_1
[00:07:06]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1]
[00:07:06]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] updating number_of_replicas to [0] for indices [.kibana_1]
[00:07:06]                 │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] 55239 finished with response BulkByScrollResponse[took=12.4ms,timed_out=false,sliceId=null,updated=0,created=1,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:07:06]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] [.kibana/S8WhhBYcTUO31sUmMU-CpQ] deleting index
[00:07:06]                 │ proc [kibana]   log   [19:02:43.680] [info][savedobjects-service] Migrating .kibana_1 saved objects to .kibana_2
[00:07:06]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1609956378581505873] [.kibana_2/rvDUYaAmRQCTW62a995A7A] update_mapping [_doc]
[00:07:06]                 │ proc [kibana]   log   [19:02:43.759] [info][savedobjects-service] Pointing alias .kibana to .kibana_2.
[00:07:06]                 │ proc [kibana]   log   [19:02:43.793] [info][savedobjects-service] Finished in 511ms.
[00:07:06]               └-: existence
[00:07:06]                 └-> "before all" hook
[00:07:06]                 └-> should find which fields exist in the sample documents
[00:07:06]                   └-> "before each" hook: global before each
[00:07:06]                   │ proc [kibana]   log   [19:02:43.839] [info][lens][plugins] Field existence check failed: Saved object [index-pattern/logstash-*] not found
[00:07:06]                   └- ✖ fail: apis Lens existing_fields apis existence should find which fields exist in the sample documents
[00:07:06]                   │      Error: expected 200 "OK", got 404 "Not Found"
[00:07:06]                   │       at Test._assertStatus (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:268:12)
[00:07:06]                   │       at Test._assertFunction (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:283:11)
[00:07:06]                   │       at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:173:18)
[00:07:06]                   │       at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
[00:07:06]                   │       at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
[00:07:06]                   │       at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:718:3)
[00:07:06]                   │       at /dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:906:18
[00:07:06]                   │       at IncomingMessage.<anonymous> (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/parsers/json.js:19:7)
[00:07:06]                   │       at endReadableNT (internal/streams/readable.js:1327:12)
[00:07:06]                   │       at processTicksAndRejections (internal/process/task_queues.js:80:21)
[00:07:06]                   │ 
[00:07:06]                   │ 

Stack Trace

Error: expected 200 "OK", got 404 "Not Found"
    at Test._assertStatus (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:268:12)
    at Test._assertFunction (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:283:11)
    at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:173:18)
    at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
    at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
    at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:718:3)
    at /dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:906:18
    at IncomingMessage.<anonymous> (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/parsers/json.js:19:7)
    at endReadableNT (internal/streams/readable.js:1327:12)
    at processTicksAndRejections (internal/process/task_queues.js:80:21)

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
triggersActionsUi 1.5MB 1.5MB -26.9KB

Distributable file count

id before after diff
default 47636 48399 +763

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
triggersActionsUi 162.0KB 162.1KB +102.0B
Unknown metric groups

async chunk count

id before after diff
triggersActionsUi 31 32 +1

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@gmmorris gmmorris merged commit 48f2cac into elastic:7.11 Jan 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants