fix: use maintenance branches instead of tags #374

mdelapenya · 2020-10-19T10:21:26Z

What does this PR do?

It replaces the 7.9.2 fixed version with the 7.9-SNAPSHOT aliases.

For those places where we download a configuration file (metricbeat and elastic-agent stand-alone mode) we willl use the branch instead of the tag.

Why is it important?

It will allow us to not bump the code with every patch release, using the aliases.

Checklist

My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have made corresponding change to the default configuration files
I have added tests that prove my fix is effective or that my feature works
I have run the Unit tests for the CLI, and they are passing locally
I have run the End-2-End tests for the suite I'm working on, and they are passing locally
I have noticed new Go dependencies (run make notice in the proper directory)

Author's checklist

Docker images for the 7.9-SNAPSHOT alias for the stack and the beats were found
Released binaries for the elastic-agent where found (https://artifacts-api.elastic.co/v1/search/7.9-SNAPSHOT/elastic-agent)

How to test this PR locally

metricbeat

$ SUITE=metricbeat DEVELOPER_MODE=true TAGS="metricbeat" LOG_LEVEL=TRACE make -C e2e functional-test

Ingest Manager stand-alone

$ SUITE=ingest-manager DEVELOPER_MODE=true TAGS="stand_alone_mode" LOG_LEVEL=TRACE make -C e2e functional-test

Related issues

Relates Use snapshots URL instead of fixed versions in maintenance branches #355

Follow-ups

As Beats' 7.9 branch is broken since August, we do not see validd binaries/docker images for the Elastic Agent base version, that's why it's sill kept with the 7.9.2 fixed version (see services.go)

elasticmachine · 2020-10-19T10:40:48Z

🐛 Flaky test report

❕ There are not known flaky tests.

Test stats 🧪

Test	Results
Failed	1
Passed	71
Skipped	10
Total	82

elasticmachine · 2020-10-19T10:40:50Z

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: [Pull request #374 updated]
Start Time: 2020-10-19T16:06:58.476+0000
Duration: 25 min 25 sec

Test stats 🧪

Test	Results
Failed	1
Passed	71
Skipped	10
Total	82

Test errors

Expand to view the tests failures

Name: Initializing / End-To-End Tests / ingest-manager_agent_endpoint_integration / Changing an Agent policy is reflected in the Security App – Agent Endpoint Integration
- Age: 2
- Duration: 203.73184
- Error Details: Step the policy will reflect the change in the Security App: No endpoint-security events where found for the agent in the d25459e0-1227-11eb-b4d3-c9fa04cbf5da configuration

Steps errors

Expand to view the steps failures

Name: Run functional tests for ingest-manager:agent_endpoint_integration
- Description:
- Duration: 13 min 29 sec
- Start Time: 2020-10-19T16:18:50.439+0000
- log
Name: Error signal
- Description:
- Duration: 0 min 0 sec
- Start Time: 2020-10-19T16:32:19.090+0000
- log
Name: General Build Step
- Description: [2020-10-19T16:32:20.043Z] Archiving artifacts
  hudson.AbortException: script returned exit code 1
- Duration: 0 min 0 sec
- Start Time: 2020-10-19T16:32:20.038+0000
- log

Log output

Expand to view the last 100 lines of log output

[2020-10-19T16:31:52.683Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:36.845Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'retryable block: operation-fetch operation-verify' for filebeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:36.846Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"filebeat.7.9.2 already exists in /var/lib/elastic-agent/downloads/filebeat-7.9.2-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:36.846Z","log.origin":{"file.name":"operation/operation_retryable.go","file.line":83},"message":"running operation 'operation-verify' of the block 'retryable block: operation-fetch operation-verify'","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:36.938Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'operation-install' for filebeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:38.330Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'operation-start' for filebeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:38.817Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2020-10-19T16:31:38Z: type: 'STATE': sub_type: 'STARTING' message: Application: filebeat--7.9.2[9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd]: State changed to STARTING: Starting","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:38.834Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'operation-config' for filebeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:38.835Z","log.origin":{"file.name":"operation/operator.go","file.line":250},"message":"operator is looking for metricbeat--7.9.2 in app collection: map[filebeat--7.9.2:0xc00066c480]","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:38.836Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.7.9.2 already exists in /var/lib/elastic-agent/downloads/metricbeat-7.9.2-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:38.836Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'retryable block: operation-fetch operation-verify' for metricbeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:38.836Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.7.9.2 already exists in /var/lib/elastic-agent/downloads/metricbeat-7.9.2-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:38.836Z","log.origin":{"file.name":"operation/operation_retryable.go","file.line":83},"message":"running operation 'operation-verify' of the block 'retryable block: operation-fetch operation-verify'","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:39.013Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'operation-install' for metricbeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.683Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:40.078Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2020-10-19T16:31:40Z: type: 'STATE': sub_type: 'RUNNING' message: Application: filebeat--7.9.2[9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd]: State changed to RUNNING: Running","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:40.533Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'operation-start' for metricbeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:40.684Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2020-10-19T16:31:40Z: type: 'STATE': sub_type: 'STARTING' message: Application: metricbeat--7.9.2[9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd]: State changed to STARTING: Starting","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:40.685Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'operation-config' for metricbeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:40.686Z","log.origin":{"file.name":"operation/monitoring.go","file.line":256},"message":"monitoring configuration generated for filebeat: map[filebeat:map[inputs:[map[index:logs-elastic.agent-default json:map[keys_under_root:true message_key:message overwrite_keys:true] paths:[/var/lib/elastic-agent/logs/elastic-agent-json.log] processors:[map[add_fields:map[fields:map[dataset:elastic.agent namespace:default type:logs] target:data_stream]] map[add_fields:map[fields:map[dataset:elastic.agent] target:event]]] type:log] map[index:logs-elastic.agent.filebeat-default json:map[keys_under_root:true message_key:message overwrite_keys:true] paths:[/var/lib/elastic-agent/logs/default/filebeat-json.log] processors:[map[add_fields:map[fields:map[dataset:elastic.agent.filebeat namespace:default type:logs] target:data_stream]] map[add_fields:map[fields:map[dataset:elastic.agent.filebeat] target:event]]] type:log] map[index:logs-elastic.agent.metricbeat-default json:map[keys_under_root:true message_key:message overwrite_keys:true] paths:[/var/lib/elastic-agent/logs/default/metricbeat-json.log] processors:[map[add_fields:map[fields:map[dataset:elastic.agent.metricbeat namespace:default type:logs] target:data_stream]] map[add_fields:map[fields:map[dataset:elastic.agent.metricbeat] target:event]]] type:log]]] output:map[elasticsearch:map[api_key:QvOzQXUBhZ7x6wZcqZvE:n2R0o30zSiulbT37H228XA hosts:[http://elasticsearch:9200] type:elasticsearch]]]","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:40.687Z","log.origin":{"file.name":"operation/monitoring.go","file.line":305},"message":"monitoring configuration generated for metricbeat: map[metricbeat:map[modules:[map[hosts:[http+unix:///tmp/elastic-agent/default/filebeat/filebeat.sock] index:metrics-elastic.agent.filebeat-default metricsets:[stats state] module:beat period:10s processors:[map[add_fields:map[fields:map[dataset:elastic.agent.filebeat namespace:default type:metrics] target:data_stream]] map[add_fields:map[fields:map[dataset:elastic.agent.filebeat] target:event]]]] map[hosts:[http+unix:///tmp/elastic-agent/default/metricbeat/metricbeat.sock] index:metrics-elastic.agent.metricbeat-default metricsets:[stats state] module:beat period:10s processors:[map[add_fields:map[fields:map[dataset:elastic.agent.metricbeat namespace:default type:metrics] target:data_stream]] map[add_fields:map[fields:map[dataset:elastic.agent.metricbeat] target:event]]]]]] output:map[elasticsearch:map[api_key:QvOzQXUBhZ7x6wZcqZvE:n2R0o30zSiulbT37H228XA hosts:[http://elasticsearch:9200] type:elasticsearch]]]","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:40.687Z","log.origin":{"file.name":"operation/operator.go","file.line":250},"message":"operator is looking for filebeat--7.9.2--36643631373035623733363936343635 in app collection: map[filebeat--7.9.2:0xc00066c480 metricbeat--7.9.2:0xc000662900]","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:40.687Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"filebeat.7.9.2 already exists in /var/lib/elastic-agent/downloads/filebeat-7.9.2-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:40.687Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'retryable block: operation-fetch operation-verify' for filebeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:40.687Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"filebeat.7.9.2 already exists in /var/lib/elastic-agent/downloads/filebeat-7.9.2-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:40.687Z","log.origin":{"file.name":"operation/operation_retryable.go","file.line":83},"message":"running operation 'operation-verify' of the block 'retryable block: operation-fetch operation-verify'","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:40.846Z","log.origin":{"file.name":"operation/operator.go","file.line":226},"message":"operation 'operation-install' skipped for filebeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:40.846Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'operation-start' for filebeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:41.117Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2020-10-19T16:31:41Z: type: 'STATE': sub_type: 'STARTING' message: Application: filebeat--7.9.2--36643631373035623733363936343635[9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd]: State changed to STARTING: Starting","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:41.143Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'operation-config' for filebeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:41.145Z","log.origin":{"file.name":"operation/operator.go","file.line":250},"message":"operator is looking for metricbeat--7.9.2--36643631373035623733363936343635 in app collection: map[filebeat--7.9.2:0xc00066c480 filebeat--7.9.2--36643631373035623733363936343635:0xc0002b0120 metricbeat--7.9.2:0xc000662900]","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:41.145Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.7.9.2 already exists in /var/lib/elastic-agent/downloads/metricbeat-7.9.2-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:41.146Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'retryable block: operation-fetch operation-verify' for metricbeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:41.146Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.7.9.2 already exists in /var/lib/elastic-agent/downloads/metricbeat-7.9.2-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:41.146Z","log.origin":{"file.name":"operation/operation_retryable.go","file.line":83},"message":"running operation 'operation-verify' of the block 'retryable block: operation-fetch operation-verify'","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:41.374Z","log.origin":{"file.name":"operation/operator.go","file.line":226},"message":"operation 'operation-install' skipped for metricbeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.684Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:41.374Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'operation-start' for metricbeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:41.680Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2020-10-19T16:31:41Z: type: 'STATE': sub_type: 'STARTING' message: Application: metricbeat--7.9.2--36643631373035623733363936343635[9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd]: State changed to STARTING: Starting","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:41.681Z","log.origin":{"file.name":"operation/operator.go","file.line":230},"message":"running operation 'operation-config' for metricbeat.7.9.2","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:41.681Z","log.origin":{"file.name":"stateresolver/stateresolver.go","file.line":61},"message":"Updating internal state","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:41.686Z","log.origin":{"file.name":"application/action_store.go","file.line":109},"message":"save on disk action policy change: action_id: 2301318e-4382-42e4-aaeb-9f4b5a46990d, type: CONFIG_CHANGE","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:41.687Z","log.origin":{"file.name":"application/action_dispatcher.go","file.line":96},"message":"Successfully dispatched action: 'action_id: 2301318e-4382-42e4-aaeb-9f4b5a46990d, type: CONFIG_CHANGE'","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:41.687Z","log.origin":{"file.name":"kibana/client.go","file.line":170},"message":"Request method: POST, path: /api/ingest_manager/fleet/agents/9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd/acks","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:41.910Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2020-10-19T16:31:41Z: type: 'STATE': sub_type: 'RUNNING' message: Application: metricbeat--7.9.2[9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd]: State changed to RUNNING: Running","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:42.340Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2020-10-19T16:31:42Z: type: 'STATE': sub_type: 'RUNNING' message: Application: filebeat--7.9.2--36643631373035623733363936343635[9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd]: State changed to RUNNING: Running","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"info","@timestamp":"2020-10-19T16:31:42.942Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2020-10-19T16:31:42Z: type: 'STATE': sub_type: 'RUNNING' message: Application: metricbeat--7.9.2--36643631373035623733363936343635[9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd]: State changed to RUNNING: Running","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:43.913Z","log.origin":{"file.name":"application/fleet_gateway.go","file.line":162},"message":"FleetGateway is sleeping, next update in 1s","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:45.262Z","log.origin":{"file.name":"application/fleet_gateway.go","file.line":142},"message":"FleetGateway calling Checkin API","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] {"log.level":"debug","@timestamp":"2020-10-19T16:31:45.264Z","log.origin":{"file.name":"kibana/client.go","file.line":170},"message":"Request method: POST, path: /api/ingest_manager/fleet/agents/9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd/checkin","ecs.version":"1.5.0"}
[2020-10-19T16:31:52.685Z] time="2020-10-19T16:31:52Z" level=debug msg="Docker compose executed." cmd="[exec -T centos-systemd cat /var/lib/elastic-agent/logs/elastic-agent-json.log]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-374/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-374/.op/compose/services/centos-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.2-x86_64.rpm980333890 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9-SNAPSHOT-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_elastic-agent_1 centos_systemdTag:latest kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-374/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9-SNAPSHOT]" profile=ingest-manager
[2020-10-19T16:31:52.685Z] time="2020-10-19T16:31:52Z" level=debug msg="Un-enrolling agent in Fleet" agentID=9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd hostname=a4228fc1f636
[2020-10-19T16:31:53.260Z] time="2020-10-19T16:31:53Z" level=debug msg="Fleet agent was unenrolled" agentID=9cd7aec2-249d-4b8d-bbe6-9a1cd7c446cd
[2020-10-19T16:31:53.833Z] Stopping ingest-manager_centos-systemd_elastic-agent_1 ... 
[2020-10-19T16:32:06.085Z] 
Stopping ingest-manager_centos-systemd_elastic-agent_1 ... done
Removing ingest-manager_centos-systemd_elastic-agent_1 ... 
[2020-10-19T16:32:06.085Z] 
Removing ingest-manager_centos-systemd_elastic-agent_1 ... done
Going to remove ingest-manager_centos-systemd_elastic-agent_1
[2020-10-19T16:32:06.085Z] time="2020-10-19T16:32:05Z" level=debug msg="Docker compose executed." cmd="[rm -fvs centos-systemd]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-374/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-374/.op/compose/services/centos-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.2-x86_64.rpm980333890 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9-SNAPSHOT-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_elastic-agent_1 centos_systemdTag:latest kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-374/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9-SNAPSHOT]" profile=ingest-manager
[2020-10-19T16:32:06.085Z] time="2020-10-19T16:32:05Z" level=debug msg="Service removed from compose" profile=ingest-manager service=centos-systemd
[2020-10-19T16:32:06.347Z] time="2020-10-19T16:32:06Z" level=debug msg="The token was deleted" tokenID=ac44e5a2-5b7b-4cb9-86ea-fee3dfe9af94
[2020-10-19T16:32:06.347Z] time="2020-10-19T16:32:06Z" level=info msg="Integration deleted from the configuration" configurationID=83e755e0-1228-11eb-b4d3-c9fa04cbf5da integration=endpoint packageConfigId=955e5030-1228-11eb-b4d3-c9fa04cbf5da version=0.13.1
[2020-10-19T16:32:12.942Z] time="2020-10-19T16:32:12Z" level=debug msg="The configuration was deleted" configurationID=83e755e0-1228-11eb-b4d3-c9fa04cbf5da
[2020-10-19T16:32:12.942Z] time="2020-10-19T16:32:12Z" level=debug msg="Destroying ingest-manager runtime dependencies"
[2020-10-19T16:32:13.203Z] Stopping ingest-manager_kibana_1           ... 
[2020-10-19T16:32:13.203Z] Stopping ingest-manager_package-registry_1 ... 
[2020-10-19T16:32:13.203Z] Stopping ingest-manager_elasticsearch_1    ... 
[2020-10-19T16:32:18.776Z] 
Stopping ingest-manager_kibana_1           ... done

Stopping ingest-manager_package-registry_1 ... done

Stopping ingest-manager_elasticsearch_1    ... done
Removing ingest-manager_kibana_1           ... 
[2020-10-19T16:32:18.777Z] Removing ingest-manager_package-registry_1 ... 
[2020-10-19T16:32:18.777Z] Removing ingest-manager_elasticsearch_1    ... 
[2020-10-19T16:32:18.777Z] 
Removing ingest-manager_package-registry_1 ... done

Removing ingest-manager_kibana_1           ... done

Removing ingest-manager_elasticsearch_1    ... done
Removing network ingest-manager_default
[2020-10-19T16:32:19.039Z] time="2020-10-19T16:32:18Z" level=debug msg="Docker compose executed." cmd="[down]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-374/.op/compose/profiles/ingest-manager/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.2-x86_64.rpm980333890 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9-SNAPSHOT-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_elastic-agent_1 centos_systemdTag:latest kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-374/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9-SNAPSHOT]" profile=ingest-manager
[2020-10-19T16:32:19.039Z] time="2020-10-19T16:32:18Z" level=debug msg="Elastic Agent binary was removed." installer=debian-systemd path=/tmp/elastic-agent-7.9.2-amd64.deb731421113
[2020-10-19T16:32:19.039Z] time="2020-10-19T16:32:18Z" level=debug msg="Elastic Agent binary was removed." installer=centos-systemd path=/tmp/elastic-agent-7.9.2-x86_64.rpm980333890
[2020-10-19T16:32:19.039Z] <?xml version="1.0" encoding="UTF-8"?>
[2020-10-19T16:32:19.039Z] <testsuites name="main" tests="5" skipped="0" failures="1" errors="0" time="768.971092636">
[2020-10-19T16:32:19.039Z]   <testsuite name="Agent Endpoint Integration" tests="5" skipped="0" failures="1" errors="0" time="548.334425645">
[2020-10-19T16:32:19.039Z]     <testcase name="Adding the Endpoint Integration to an Agent makes the host to show in Security App" status="passed" time="74.690739488"></testcase>
[2020-10-19T16:32:19.039Z]     <testcase name="Deploying an Endpoint makes policies to appear in the Security App" status="passed" time="60.477484842"></testcase>
[2020-10-19T16:32:19.039Z]     <testcase name="Changing an Agent policy is reflected in the Security App" status="failed" time="203.731836223">
[2020-10-19T16:32:19.039Z]       <failure message="Step the policy will reflect the change in the Security App: No endpoint-security events where found for the agent in the d25459e0-1227-11eb-b4d3-c9fa04cbf5da configuration"></failure>
[2020-10-19T16:32:19.039Z]     </testcase>
[2020-10-19T16:32:19.039Z]     <testcase name="Un-enrolling Elastic Agent stops Elastic Endpoint" status="passed" time="64.920375191"></testcase>
[2020-10-19T16:32:19.039Z]     <testcase name="Removing Endpoint from Agent configuration stops the connected Endpoint" status="passed" time="28.842950194"></testcase>
[2020-10-19T16:32:19.039Z]   </testsuite>
[2020-10-19T16:32:19.039Z] </testsuites>make: *** [functional-test] Error 1
[2020-10-19T16:32:19.039Z] Makefile:45: recipe for target 'functional-test' failed
[2020-10-19T16:32:19.039Z] + echo 'ERROR: functional-test failed'
[2020-10-19T16:32:19.039Z] ERROR: functional-test failed
[2020-10-19T16:32:19.039Z] + exit_status=1
[2020-10-19T16:32:19.039Z] + sed -e 's/^[ \t]*//; s#>.*failed$#>#g' outputs/TEST-ingest-manager-agent_endpoint_integration
[2020-10-19T16:32:19.039Z] + grep -E '^<.*>$'
[2020-10-19T16:32:19.039Z] + exit 1
[2020-10-19T16:32:19.100Z] Recording test results
[2020-10-19T16:32:20.043Z] Archiving artifacts
[2020-10-19T16:32:20.197Z] Failed in branch ingest-manager_agent_endpoint_integration
[2020-10-19T16:32:21.277Z] Stage "Release" skipped due to earlier failure(s)
[2020-10-19T16:32:22.348Z] Running on worker-395930 in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-374
[2020-10-19T16:32:22.391Z] [INFO] getVaultSecret: Getting secrets
[2020-10-19T16:32:22.448Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-10-19T16:32:24.383Z] + chmod 755 generate-build-data.sh
[2020-10-19T16:32:24.384Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-374/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-374/runs/2 FAILURE 1524506
[2020-10-19T16:32:24.384Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-374/runs/2/steps/?limit=10000 -o steps-info.json
[2020-10-19T16:32:29.135Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-374/runs/2/tests/?status=FAILED -o tests-errors.json
[2020-10-19T16:32:29.838Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-374/runs/2/log/ -o pipeline-log.txt

EricDavisX · 2020-10-20T13:50:48Z

cli/config/compose/services/kibana/docker-compose.yml

@@ -5,6 +5,6 @@ services:
      - ELASTICSEARCH_HOSTS=http://elasticsearch:9200
      - ELASTIC_USERNAME=elastic
      - ELASTIC_PASSWORD=changeme
-    image: "docker.elastic.co/observability-ci/kibana:${kibanaTag}"


@mdelapenya can you discuss the differences in build times and availability of images between the observability-ci and main elastic docker images? Will this change prevent us from 'getting' a fix into the test environment faster, presuming the main docker image is built only once or twice a day, and the obs-ci is presumably built much more often?

I was also thinking in a separate issue we should dry this up and up put the version portion of the semVar in a constant.

The observability-ci namespace is refreshed with every merge to master in beats, and for the stack they are updated automatically.

mdelapenya added 3 commits October 19, 2020 11:25

chore: use maintenance version aliases for docker images and binaries

ec1310c

fix: use proper metricbeat base version

a0bf2bd

fix: use branches instead of tags

581ffd5

mdelapenya self-assigned this Oct 19, 2020

mdelapenya requested a review from a team October 19, 2020 10:21

v1v approved these changes Oct 19, 2020

View reviewed changes

mdelapenya mentioned this pull request Oct 19, 2020

feat: package aliases for snapshots elastic/beats#21960

Merged

9 tasks

mdelapenya marked this pull request as ready for review October 19, 2020 16:01

chore: do not use obseravbility-ci for maintenance branches

ab16cde

cachedout approved these changes Oct 20, 2020

View reviewed changes

mdelapenya merged commit 8190561 into elastic:7.9.x Oct 20, 2020

mdelapenya deleted the 355-maintenance-branches branch October 20, 2020 07:44

EricDavisX reviewed Oct 20, 2020

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

fix: use maintenance branches instead of tags #374

fix: use maintenance branches instead of tags #374

mdelapenya commented Oct 19, 2020 •

edited

Loading

elasticmachine commented Oct 19, 2020

elasticmachine commented Oct 19, 2020 •

edited

Loading

Build stats

Test stats 🧪

EricDavisX Oct 20, 2020

mdelapenya Oct 20, 2020 •

edited

Loading

fix: use maintenance branches instead of tags #374

fix: use maintenance branches instead of tags #374

Conversation

mdelapenya commented Oct 19, 2020 • edited Loading

What does this PR do?

Why is it important?

Checklist

Author's checklist

How to test this PR locally

Related issues

Follow-ups

elasticmachine commented Oct 19, 2020

🐛 Flaky test report

Test stats 🧪

elasticmachine commented Oct 19, 2020 • edited Loading

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

Steps errors

Log output

EricDavisX Oct 20, 2020

Choose a reason for hiding this comment

mdelapenya Oct 20, 2020 • edited Loading

Choose a reason for hiding this comment

mdelapenya commented Oct 19, 2020 •

edited

Loading

elasticmachine commented Oct 19, 2020 •

edited

Loading

mdelapenya Oct 20, 2020 •

edited

Loading