Docker container rabbitmq:3-management boot failed #629

goiaciprian · 2023-04-19T10:20:46Z

goiaciprian
Apr 19, 2023

Hello,

I have encountered the below error when I was trying to start a rabbitmq container, nothing of what I have tried didn't worked so I've decided to post here.

2023-04-19 13:11:36 2023-04-19 10:11:36.756960+00:00 [notice] <0.147.0> Protocol 'inet_tcp': register/listen error: econnrefused
2023-04-19 13:11:36 2023-04-19 10:11:36.756960+00:00 [notice] <0.147.0> 
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>     supervisor: {local,net_sup}
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>     errorContext: start_error
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>     reason: {'EXIT',nodistribution}
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>     offender: [{pid,undefined},
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                {id,net_kernel},
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                {mfargs,{net_kernel,start_link,
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                                    [#{clean_halt => false,
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                                       name => rabbit_prelaunch_20@localhost,
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                                       name_domain => shortnames,
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                                       net_tickintensity => 4,
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                                       net_ticktime => 60,
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                                       supervisor => net_sup_dynamic}]}},
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                {restart_type,permanent},
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                {significant,false},
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                {shutdown,2000},
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0>                {child_type,worker}]
2023-04-19 13:11:36 2023-04-19 10:11:36.769434+00:00 [error] <0.144.0> 
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>   crasher:
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     initial call: net_kernel:init/1
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     pid: <0.147.0>
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     registered_name: []
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     exception exit: {error,badarg}
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>       in function  gen_server:init_it/6 (gen_server.erl, line 835)
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     ancestors: [net_sup,kernel_sup,<0.47.0>]
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     message_queue_len: 0
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     messages: []
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     links: [#Port<0.8>,<0.144.0>]
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     dictionary: [{longnames,false}]
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     trap_exit: true
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     status: running
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     heap_size: 987
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     stack_size: 28
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>     reductions: 3387
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0>   neighbours:
2023-04-19 13:11:36 2023-04-19 10:11:36.769696+00:00 [error] <0.147.0> 
2023-04-19 13:11:36 
2023-04-19 13:11:36 BOOT FAILED
2023-04-19 13:11:36 ===========
2023-04-19 13:11:36 Exception during startup:
2023-04-19 13:11:36 
2023-04-19 13:11:36 error:{badmatch,{error,{{shutdown,{failed_to_start_child,net_kernel,{'EXIT',nodistribution}}},{child,undefined,net_sup_dynamic,{erl_distribution,start_link,[#{clean_halt => false,name => rabbit_prelaunch_20@localhost,name_domain => shortnames,net_tickintensity => 4,net_ticktime => 60,supervisor => net_sup_dynamic}]},permanent,false,1000,supervisor,[erl_distribution]}}}}
2023-04-19 13:11:36 
2023-04-19 13:11:36     rabbit_prelaunch_dist:duplicate_node_check/1, line 80
2023-04-19 13:11:36     rabbit_prelaunch_dist:setup/1, line 23
2023-04-19 13:11:36     rabbit_prelaunch:do_run/0, line 115
2023-04-19 13:11:36     rabbit_prelaunch:run_prelaunch_first_phase/0, line 32
2023-04-19 13:11:36     supervisor:do_start_child_i/3, line 414
2023-04-19 13:11:36     supervisor:do_start_child/2, line 400
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0> 
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0> BOOT FAILED
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0> ===========
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0> Exception during startup:
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0> 
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0> error:{badmatch,{error,{{shutdown,{failed_to_start_child,net_kernel,{'EXIT',nodistribution}}},{child,undefined,net_sup_dynamic,{erl_distribution,start_link,[#{clean_halt => false,name => rabbit_prelaunch_20@localhost,name_domain => shortnames,net_tickintensity => 4,net_ticktime => 60,supervisor => net_sup_dynamic}]},permanent,false,1000,supervisor,[erl_distribution]}}}}
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0> 
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0>     rabbit_prelaunch_dist:duplicate_node_check/1, line 80
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0>     rabbit_prelaunch_dist:setup/1, line 23
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0>     rabbit_prelaunch:do_run/0, line 115
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0>     rabbit_prelaunch:run_prelaunch_first_phase/0, line 32
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0>     supervisor:do_start_child_i/3, line 414
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0>     supervisor:do_start_child/2, line 400
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0>     supervisor:-start_children/2-fun-0-/3, line 384
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0>     supervisor:children_map/4, line 1250
2023-04-19 13:11:36 2023-04-19 10:11:36.784178+00:00 [error] <0.132.0> 
2023-04-19 13:11:36     supervisor:-start_children/2-fun-0-/3, line 384
2023-04-19 13:11:36     supervisor:children_map/4, line 1250
2023-04-19 13:11:36 
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>     supervisor: {local,rabbit_prelaunch_sup}
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>     errorContext: start_error
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>     reason: {badmatch,
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                 {error,
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                     {{shutdown,
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                          {failed_to_start_child,net_kernel,
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                              {'EXIT',nodistribution}}},
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                      {child,undefined,net_sup_dynamic,
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                          {erl_distribution,start_link,
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                              [#{clean_halt => false,
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                                 name => rabbit_prelaunch_20@localhost,
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                                 name_domain => shortnames,
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                                 net_tickintensity => 4,net_ticktime => 60,
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                                 supervisor => net_sup_dynamic}]},
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                          permanent,false,1000,supervisor,
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                          [erl_distribution]}}}}
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>     offender: [{pid,undefined},
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                {id,prelaunch},
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                {mfargs,{rabbit_prelaunch,run_prelaunch_first_phase,[]}},
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                {restart_type,transient},
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                {significant,false},
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                {shutdown,5000},
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0>                {child_type,worker}]
2023-04-19 13:11:37 2023-04-19 10:11:37.794569+00:00 [error] <0.132.0> 
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>   crasher:
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     initial call: application_master:init/4
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     pid: <0.130.0>
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     registered_name: []
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     exception exit: {{shutdown,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                       {failed_to_start_child,prelaunch,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                        {badmatch,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                         {error,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                          {{shutdown,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                            {failed_to_start_child,net_kernel,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                             {'EXIT',nodistribution}}},
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                           {child,undefined,net_sup_dynamic,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                            {erl_distribution,start_link,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                             [#{clean_halt => false,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                                name => rabbit_prelaunch_20@localhost,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                                name_domain => shortnames,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                                net_tickintensity => 4,net_ticktime => 60,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                                supervisor => net_sup_dynamic}]},
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                            permanent,false,1000,supervisor,
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                            [erl_distribution]}}}}}},
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>                      {rabbit_prelaunch_app,start,[normal,[]]}}
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>       in function  application_master:init/4 (application_master.erl, line 142)
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     ancestors: [<0.129.0>]
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     message_queue_len: 1
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     messages: [{'EXIT',<0.131.0>,normal}]
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     links: [<0.129.0>,<0.44.0>]
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     dictionary: []
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     trap_exit: true
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     status: running
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     heap_size: 376
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     stack_size: 28
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>     reductions: 165
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0>   neighbours:
2023-04-19 13:11:37 2023-04-19 10:11:37.794957+00:00 [error] <0.130.0> 
2023-04-19 13:11:37 2023-04-19 10:11:37.795755+00:00 [notice] <0.44.0> Application rabbitmq_prelaunch exited with reason: {{shutdown,{failed_to_start_child,prelaunch,{badmatch,{error,{{shutdown,{failed_to_start_child,net_kernel,{'EXIT',nodistribution}}},{child,undefined,net_sup_dynamic,{erl_distribution,start_link,[#{clean_halt => false,name => rabbit_prelaunch_20@localhost,name_domain => shortnames,net_tickintensity => 4,net_ticktime => 60,supervisor => net_sup_dynamic}]},permanent,false,1000,supervisor,[erl_distribution]}}}}}},{rabbit_prelaunch_app,start,[normal,[]]}}
2023-04-19 13:11:39 Kernel pid terminated (application_controller) ({application_start_failure,rabbitmq_prelaunch,{{shutdown,{failed_to_start_child,prelaunch,{badmatch,{error,{{shutdown,{failed_to_start_child,net_kernel,{'EXIT',nodistribution}}},{child,undefined,net_sup_dynamic,{erl_distribution,start_link,[#{clean_halt => false,name => rabbit_prelaunch_20@localhost,name_domain => shortnames,net_tickintensity => 4,net_ticktime => 60,supervisor => net_sup_dynamic}]},permanent,false,1000,supervisor,[erl_distribution]}}}}}},{rabbit_prelaunch_app,start,[normal,[]]}}})
2023-04-19 13:11:39 
2023-04-19 13:11:39 {"Kernel pid terminated",application_controller,"{application_start_failure,rabbitmq_prelaunch,{{shutdown,{failed_to_start_child,prelaunch,{badmatch,{error,{{shutdown,{failed_to_start_child,net_kernel,{'EXIT',nodistribution}}},{child,undefined,net_sup_dynamic,{erl_distribution,start_link,[#{clean_halt => false,name => rabbit_prelaunch_20@localhost,name_domain => shortnames,net_tickintensity => 4,net_ticktime => 60,supervisor => net_sup_dynamic}]},permanent,false,1000,supervisor,[erl_distribution]}}}}}},{rabbit_prelaunch_app,start,[normal,[]]}}}"}

SudoCerb · 2023-04-19T11:28:37Z

SudoCerb
Apr 19, 2023

I have encountered this exact same issue.

The only solution I have found thus far is to uninstall Docker for Windows and re-install it.

My machine specs are:

Edition Windows 11 Enterprise
Version 22H2
Installed on ‎2022/‎11/‎02
OS build 22621.1555
Experience Windows Feature Experience Pack 1000.22640.1000.0
Processor Intel(R) Core(TM) i7-8665U CPU @ 1.90GHz 2.11 GHz
Installed RAM 32.0 GB (31.8 GB usable)
System type 64-bit operating system, x64-based processor

Unfortunately I cannot confirm causes this error.

I have tried clearing all build caches and re-pulling the image - same error, I've tried manually installing Erlang on the image...this was a bad idea.

All that I know is that I reinstalled docker two days ago to solve this same problem, which then re-occurred.

0 replies

lukebakken · 2023-04-19T12:58:20Z

lukebakken
Apr 19, 2023
Collaborator

I converted the GitHub Issue to a Discussion because there is no evidence of a bug in the docker container for RabbitMQ at this time.

@goiaciprian please provide your environment specs the same way that @SudoCerb did.

@SudoCerb - are you using the Hyper-V or WSL backend?

I just ran docker run --pull always rabbitmq:3-management on my linux workstation and RabbitMQ booted just fine. This is my environment:

$ docker --version
Docker version 23.0.3, build 3e7cbfdee1

I do not have access to Docker Desktop for Windows, because it requires a paid subscription - https://docs.docker.com/desktop/install/windows-install/

0 replies

SudoCerb · 2023-04-19T15:20:56Z

SudoCerb
Apr 19, 2023

Hi @lukebakken, I am using WSL2 for my backend.

After a fresh install of Docker for Windows the image boots perfectly well. I will monitor my system for changes and report back if the issue reappears.

Strange - it seems my version of docker is old:

PS > docker --version                                                                                                                        
Docker version 20.10.24, build 297e128

This is my version of Docker Desktop:
Docker Desktop 4.18.0 (104112)

0 replies

michaelklishin · 2023-04-19T17:16:04Z

michaelklishin
Apr 19, 2023
Collaborator

nodistribution usually means the node failed to connect to epmd, possibly due to various environment restrictions (e.g. a firewall of some kind).

There can be other reasons why the node fails to initialize its distribution (infrastructure used for CLI and node-to-node communication).

0 replies

SudoCerb · 2023-04-20T05:13:51Z

SudoCerb
Apr 20, 2023

@michaelklishin indeed that is what I've found so far 😅

But surely empd should be accessible if Erlang is itself installed in the same docker image?

1 reply

michaelklishin Apr 20, 2023
Collaborator

epmd is a part of Erlang/OTP, yes, but with certain Docker configurations access to such ports potentially can be restricted. See various OS logs for clues.

goiaciprian · 2023-04-20T15:03:41Z

goiaciprian
Apr 20, 2023
Author

@lukebakken
I'm using WSL 2 backed for docker with version Docker version 20.10.24, build 297e128, Windows 11

I will try to reinstall docker

0 replies

Docker container rabbitmq:3-management boot failed #629

Uh oh!

Uh oh!

goiaciprian Apr 19, 2023

Replies: 6 comments · 1 reply

Uh oh!

Uh oh!

SudoCerb Apr 19, 2023

Uh oh!

Uh oh!

lukebakken Apr 19, 2023 Collaborator

Uh oh!

SudoCerb Apr 19, 2023

Uh oh!

michaelklishin Apr 19, 2023 Collaborator

Uh oh!

SudoCerb Apr 20, 2023

Uh oh!

michaelklishin Apr 20, 2023 Collaborator

Uh oh!

Uh oh!

goiaciprian Apr 20, 2023 Author

goiaciprian
Apr 19, 2023

Replies: 6 comments 1 reply

SudoCerb
Apr 19, 2023

lukebakken
Apr 19, 2023
Collaborator

SudoCerb
Apr 19, 2023

michaelklishin
Apr 19, 2023
Collaborator

SudoCerb
Apr 20, 2023

michaelklishin Apr 20, 2023
Collaborator

goiaciprian
Apr 20, 2023
Author