Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

OpenStack Image creation failing #15

Open
ghost opened this issue Apr 21, 2021 · 0 comments
Open

OpenStack Image creation failing #15

ghost opened this issue Apr 21, 2021 · 0 comments
Labels
bug builder/openstack community-supported plugin question stage/waiting-reply

Comments

@ghost
Copy link

ghost commented Apr 21, 2021

This issue was originally opened by @parjun8840 as hashicorp/packer#9977. It was migrated here as a result of the Packer plugin split. The original body of the issue is below.

When filing a bug, please include the following headings if possible. Any
example text in this template can be deleted.

Overview of the Issue

While creating Image it fails- openstack: Error waiting for server (6c6b5ff7-cc58-451e-b69b-c04a3a1eba26) to become ready: unexpected state 'ERROR', wanted target '[ACTIVE]' .

tail -200 /var/log/nova/nova-api.log | grep -B 5 -A 5 57a44b05-fcd4-49ac-a592-34a993fd18c3
2020-09-22 06:27:45.766 20945 INFO nova.osapi_compute.wsgi.server [req-8fcfa6b3-41f6-4bee-9883-17c69e69766c d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/servers/1691a1cf-c220-468d-b6b1-5ed1e5c6b1e4 HTTP/1.1" status: 404 len: 527 time: 0.0342519
2020-09-22 06:28:06.395 20951 INFO nova.osapi_compute.wsgi.server [req-84abb9a0-3882-418f-8eed-5af23812465e d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/os-floating-ips HTTP/1.1" status: 200 len: 413 time: 0.1900549
2020-09-22 06:28:07.099 20949 INFO nova.osapi_compute.wsgi.server [req-d7a06e53-09c4-4c4e-bef8-4caa1b4bb010 d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/servers/detail HTTP/1.1" status: 200 len: 3462 time: 0.6158741
2020-09-22 06:28:44.924 20942 INFO nova.osapi_compute.wsgi.server [req-7841b93e-7154-4e83-9eb9-cdd0a2995ca6 d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/flavors/e4b38f05-ba89-4e81-87b8-30d3cfa2a0ea HTTP/1.1" status: 200 len: 860 time: 0.1292100
2020-09-22 06:28:45.516 20946 INFO nova.osapi_compute.wsgi.server [req-e19eb307-5cc0-4c2b-a98b-6982c365e71d d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "POST /v2.1/servers HTTP/1.1" status: 202 len: 860 time: 0.3597310
2020-09-22 06:28:45.643 20943 INFO nova.osapi_compute.wsgi.server [req-a64f321a-10cf-4fdf-bc8f-87573664349e d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/servers/57a44b05-fcd4-49ac-a592-34a993fd18c3 HTTP/1.1" status: 200 len: 1750 time: 0.0371089
2020-09-22 06:28:47.825 20942 INFO nova.osapi_compute.wsgi.server [req-b0cfe954-e886-44c3-8158-d28d68a8d902 d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/servers/57a44b05-fcd4-49ac-a592-34a993fd18c3 HTTP/1.1" status: 200 len: 1885 time: 0.0919571
2020-09-22 06:28:47.857 20946 INFO nova.api.openstack.compute.server_external_events [req-1e77e11a-661f-4337-90cb-75d3be73bde5 c80304baa13340868e03176f8e0220dd 40f0cae4d9e844a1abcc139e827ccb4c - default default] Creating event network-changed:abbf7ffc-6ce4-4cbc-b1bc-c03dd4b59902 for instance 57a44b05-fcd4-49ac-a592-34a993fd18c3 on buffalo-new
2020-09-22 06:28:47.859 20946 INFO nova.osapi_compute.wsgi.server [req-1e77e11a-661f-4337-90cb-75d3be73bde5 c80304baa13340868e03176f8e0220dd 40f0cae4d9e844a1abcc139e827ccb4c - default default] 10.102.0.34 "POST /v2.1/os-server-external-events HTTP/1.1" status: 200 len: 578 time: 0.1586082
2020-09-22 06:28:48.911 20951 INFO nova.api.openstack.wsgi [req-bf115b42-5b1c-4abf-bd47-e8a861750d64 c80304baa13340868e03176f8e0220dd 40f0cae4d9e844a1abcc139e827ccb4c - default default] HTTP exception thrown: No instances found for any event
2020-09-22 06:28:48.912 20951 INFO nova.osapi_compute.wsgi.server [req-bf115b42-5b1c-4abf-bd47-e8a861750d64 c80304baa13340868e03176f8e0220dd 40f0cae4d9e844a1abcc139e827ccb4c - default default] 10.102.0.34 "POST /v2.1/os-server-external-events HTTP/1.1" status: 404 len: 498 time: 0.1021891
2020-09-22 06:28:49.999 20943 INFO nova.osapi_compute.wsgi.server [req-9576b418-7260-4df5-903e-b15288d16e3f d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/servers/57a44b05-fcd4-49ac-a592-34a993fd18c3 HTTP/1.1" status: 200 len: 2524 time: 0.0842030
2020-09-22 06:28:50.182 20950 WARNING nova.compute.api [req-87f55e72-9926-429d-a85f-add754ef2b9f d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] [instance: 57a44b05-fcd4-49ac-a592-34a993fd18c3] instance's host None is down, deleting from database
2020-09-22 06:28:50.428 20950 INFO nova.osapi_compute.wsgi.server [req-87f55e72-9926-429d-a85f-add754ef2b9f d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "DELETE /v2.1/servers/57a44b05-fcd4-49ac-a592-34a993fd18c3 HTTP/1.1" status: 204 len: 400 time: 0.3393259
2020-09-22 06:28:50.572 20946 INFO nova.api.openstack.wsgi [req-6d6f7ff4-3ef1-46f5-9b19-5ecc7b652a5f d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] HTTP exception thrown: Instance 57a44b05-fcd4-49ac-a592-34a993fd18c3 could not be found.
2020-09-22 06:28:50.575 20946 INFO nova.osapi_compute.wsgi.server [req-6d6f7ff4-3ef1-46f5-9b19-5ecc7b652a5f d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/servers/57a44b05-fcd4-49ac-a592-34a993fd18c3 HTTP/1.1" status: 404 len: 527 time: 0.0552299
2020-09-22 06:29:06.353 20946 INFO nova.osapi_compute.wsgi.server [req-61e331de-ac30-433d-8909-cc831d596901 d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/os-floating-ips HTTP/1.1" status: 200 len: 413 time: 0.1523890
2020-09-22 06:29:06.747 20946 INFO nova.osapi_compute.wsgi.server [req-6fc66a0b-d5d6-473d-9786-308e3e96ffa7 d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/servers/detail HTTP/1.1" status: 200 len: 3462 time: 0.3006909
2020-09-22 06:30:06.495 20941 INFO nova.osapi_compute.wsgi.server [req-acc8cffe-368d-4059-8317-443efe04d6a4 d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/os-floating-ips HTTP/1.1" status: 200 len: 413 time: 0.2963970
2020-09-22 06:30:06.863 20944 INFO nova.osapi_compute.wsgi.server [req-70192faf-2f40-4248-9c58-04c57f8d2dbd d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/servers/detail HTTP/1.1" status: 200 len: 3462 time: 0.2758498
2020-09-22 06:31:06.799 20941 INFO nova.osapi_compute.wsgi.server [req-d9579aad-a1cc-42db-aeea-8e5c5631def0 d7306399300a41378120b6a8887178e7 ef8b4874092945e2985cf60e8a9dadf8 - default default] 10.3.252.171 "GET /v2.1/os-floating-ips HTTP/1.1" status: 200 len: 413 time: 0.6033480

Reproduction Steps

PACKER_LOG=1 packer build os.json

Packer version

1.6.2

Simplified Packer Buildfile

{
  "builders": [{
      "type": "openstack",
      "image_name": "custom-solr-image01",
      "source_image": "364daa7d-4de8-4ef7-a8b9-ab407fe42622",
      "flavor": "e4b38f05-ba89-4e81-87b8-30d3cfa2a0ea",
      "floating_ip_pool": "Public",
      "security_groups": ["default"],
      "ssh_username": "root",
      "ssh_password": "password123",
      "networks": "afd08831-7dec-4885-8f19-0ca54aaef033",
      "volume_name": "custom-solr-image01",
      "volume_size": 35
    }
  ],
  "provisioners": [{
    "type": "shell",
    "inline": [
      "sleep 30",
      "yum install httpd -y",
      "systemctl start httpd",
      "systemctl enable httpd",
      "echo 'Hi' > /var/www/index.html"

    ]
  }]
}

Operating system and Environment details

nova-manage --version
20.4.0
openstack --version
openstack 4.0.1
openstack versions show
+-------------+---------------+---------+------------+--------------------------------+------------------+------------------+
| Region Name | Service Type  | Version | Status     | Endpoint                       | Min Microversion | Max Microversion |
+-------------+---------------+---------+------------+--------------------------------+------------------+------------------+
| RegionOne   | block-storage | 2.0     | DEPRECATED | http://XXXX:8776/v2/   | None             | None             |
| RegionOne   | block-storage | 3.0     | CURRENT    | http://XXXX:8776/v3/   | 3.0              | 3.59             |
| RegionOne   | placement     | 1.0     | CURRENT    | http://XXXX:8778/      | 1.0              | 1.36             |
| RegionOne   | network       | 2.0     | CURRENT    | http://XXXX:9696/v2.0/ | None             | None             |
| RegionOne   | image         | 2.0     | SUPPORTED  | http://XXXX:9292/v2/   | None             | None             |
| RegionOne   | image         | 2.1     | SUPPORTED  | http://XXXX:9292/v2/   | None             | None             |
| RegionOne   | image         | 2.2     | SUPPORTED  | http://XXXX:9292/v2/   | None             | None             |
| RegionOne   | image         | 2.3     | SUPPORTED  | http://XXXX:9292/v2/   | None             | None             |
| RegionOne   | image         | 2.4     | SUPPORTED  | http://XXXX:9292/v2/   | None             | None             |
| RegionOne   | image         | 2.5     | SUPPORTED  | http://XXXX:9292/v2/   | None             | None             |
| RegionOne   | image         | 2.6     | SUPPORTED  | http://XXXX:9292/v2/   | None             | None             |
| RegionOne   | image         | 2.7     | SUPPORTED  | http://XXXX:9292/v2/   | None             | None             |
| RegionOne   | image         | 2.9     | CURRENT    | http://XXXX:9292/v2/   | None             | None             |
| RegionOne   | compute       | 2.0     | SUPPORTED  | http://XXXX:8774/v2/   | None             | None             |
| RegionOne   | compute       | 2.1     | CURRENT    | http://XXXX:8774/v2.1/ | 2.1              | 2.79             |
| RegionOne   | identity      | 3.13    | CURRENT    | http://XXXX:5000/v3/   | None             | None             |
+-------------+---------------+---------+------------+--------------------------------+------------------+------------------+

Log Fragments and crash.log files

PACKER_LOG=1 packer build os.json 
2020/09/22 06:37:44 [INFO] Packer version: 1.6.2 [go1.13.15 linux amd64]
2020/09/22 06:37:44 Checking 'PACKER_CONFIG' for a config file path
2020/09/22 06:37:44 'PACKER_CONFIG' not set; checking the default config file path
2020/09/22 06:37:44 Attempting to open config file: /root/.packerconfig
2020/09/22 06:37:44 [WARN] Config file doesn't exist: /root/.packerconfig
2020/09/22 06:37:44 Setting cache directory: /opt/image-create/packer_cache
2020/09/22 06:37:44 Creating plugin client for path: /usr/sbin/cracklib-packer
2020/09/22 06:37:44 Starting plugin: /usr/sbin/cracklib-packer []string{"/usr/sbin/cracklib-packer", "plugin", "packer-builder-openstack"}
2020/09/22 06:37:44 Waiting for RPC address for: /usr/sbin/cracklib-packer
2020/09/22 06:37:44 cracklib-packer plugin: [INFO] Packer version: 1.6.2 [go1.13.15 linux amd64]
2020/09/22 06:37:44 cracklib-packer plugin: Checking 'PACKER_CONFIG' for a config file path
2020/09/22 06:37:44 cracklib-packer plugin: 'PACKER_CONFIG' not set; checking the default config file path
2020/09/22 06:37:44 cracklib-packer plugin: Attempting to open config file: /root/.packerconfig
2020/09/22 06:37:44 cracklib-packer plugin: [WARN] Config file doesn't exist: /root/.packerconfig
2020/09/22 06:37:44 cracklib-packer plugin: Setting cache directory: /opt/image-create/packer_cache
2020/09/22 06:37:44 cracklib-packer plugin: args: []string{"packer-builder-openstack"}
2020/09/22 06:37:44 Received unix RPC address for /usr/sbin/cracklib-packer: addr is /tmp/packer-plugin275366570
2020/09/22 06:37:44 cracklib-packer plugin: Plugin address: unix /tmp/packer-plugin275366570
2020/09/22 06:37:44 cracklib-packer plugin: Waiting for connection...
2020/09/22 06:37:44 cracklib-packer plugin: Serving a plugin connection...
2020/09/22 06:37:44 Creating plugin client for path: /usr/sbin/cracklib-packer
2020/09/22 06:37:44 Starting plugin: /usr/sbin/cracklib-packer []string{"/usr/sbin/cracklib-packer", "plugin", "packer-provisioner-shell"}
2020/09/22 06:37:44 Waiting for RPC address for: /usr/sbin/cracklib-packer
2020/09/22 06:37:45 cracklib-packer plugin: [INFO] Packer version: 1.6.2 [go1.13.15 linux amd64]
2020/09/22 06:37:45 cracklib-packer plugin: Checking 'PACKER_CONFIG' for a config file path
2020/09/22 06:37:45 cracklib-packer plugin: 'PACKER_CONFIG' not set; checking the default config file path
2020/09/22 06:37:45 cracklib-packer plugin: Attempting to open config file: /root/.packerconfig
2020/09/22 06:37:45 cracklib-packer plugin: [WARN] Config file doesn't exist: /root/.packerconfig
2020/09/22 06:37:45 cracklib-packer plugin: Setting cache directory: /opt/image-create/packer_cache
2020/09/22 06:37:45 cracklib-packer plugin: args: []string{"packer-provisioner-shell"}
2020/09/22 06:37:45 Received unix RPC address for /usr/sbin/cracklib-packer: addr is /tmp/packer-plugin817340970
2020/09/22 06:37:45 cracklib-packer plugin: Plugin address: unix /tmp/packer-plugin817340970
2020/09/22 06:37:45 cracklib-packer plugin: Waiting for connection...
2020/09/22 06:37:45 cracklib-packer plugin: Serving a plugin connection...
2020/09/22 06:37:45 Preparing build: openstack
openstack: output will be in this color.

2020/09/22 06:37:45 Build debug mode: false
2020/09/22 06:37:45 Force build: false
2020/09/22 06:37:45 On error: 
2020/09/22 06:37:45 Waiting on builds to complete...
2020/09/22 06:37:45 Starting build run: openstack
2020/09/22 06:37:45 Running builder: openstack
2020/09/22 06:37:45 [INFO] (telemetry) Starting builder openstack
==> openstack: Loading flavor: e4b38f05-ba89-4e81-87b8-30d3cfa2a0ea
2020/09/22 06:37:45 cracklib-packer plugin: [INFO] Loading flavor by ID: e4b38f05-ba89-4e81-87b8-30d3cfa2a0ea
    openstack: Verified flavor. ID: e4b38f05-ba89-4e81-87b8-30d3cfa2a0ea
==> openstack: Not using temporary keypair
==> openstack: Launching server...
==> openstack: Launching server...
    openstack: Server ID: 6c6b5ff7-cc58-451e-b69b-c04a3a1eba26
2020/09/22 06:37:46 cracklib-packer plugin: server id: 6c6b5ff7-cc58-451e-b69b-c04a3a1eba26
==> openstack: Waiting for server to become ready...
2020/09/22 06:37:46 cracklib-packer plugin: Waiting for state to become: [ACTIVE]
2020/09/22 06:37:47 cracklib-packer plugin: Waiting for state to become: [ACTIVE] currently BUILD (0%)
2020/09/22 06:37:49 cracklib-packer plugin: Waiting for state to become: [ACTIVE] currently BUILD (0%)
==> openstack: Error waiting for server (6c6b5ff7-cc58-451e-b69b-c04a3a1eba26) to become ready: unexpected state 'ERROR', wanted target '[ACTIVE]'
==> openstack: Terminating the source server: 6c6b5ff7-cc58-451e-b69b-c04a3a1eba26 ...
2020/09/22 06:37:51 cracklib-packer plugin: Waiting for state to become: [DELETED]
2020/09/22 06:37:52 cracklib-packer plugin: [INFO] 404 on ServerStateRefresh, returning DELETED
2020/09/22 06:37:52 [INFO] (telemetry) ending openstack
==> Wait completed after 6 seconds 663 milliseconds
2020/09/22 06:37:52 machine readable: error-count []string{"1"}
==> Some builds didn't complete successfully and had errors:
2020/09/22 06:37:52 machine readable: openstack,error []string{"Error waiting for server (6c6b5ff7-cc58-451e-b69b-c04a3a1eba26) to become ready: unexpected state 'ERROR', wanted target '[ACTIVE]'"}
==> Builds finished but no artifacts were created.
2020/09/22 06:37:52 [INFO] (telemetry) Finalizing.
Build 'openstack' errored after 6 seconds 663 milliseconds: Error waiting for server (6c6b5ff7-cc58-451e-b69b-c04a3a1eba26) to become ready: unexpected state 'ERROR', wanted target '[ACTIVE]'

==> Wait completed after 6 seconds 663 milliseconds

==> Some builds didn't complete successfully and had errors:
--> openstack: Error waiting for server (6c6b5ff7-cc58-451e-b69b-c04a3a1eba26) to become ready: unexpected state 'ERROR', wanted target '[ACTIVE]'

==> Builds finished but no artifacts were created.
2020/09/22 06:37:52 waiting for all plugin processes to complete...
2020/09/22 06:37:52 /usr/sbin/cracklib-packer: plugin process exited
2020/09/22 06:37:52 /usr/sbin/cracklib-packer: plugin process exited
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug builder/openstack community-supported plugin question stage/waiting-reply
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
0 participants