Hanging on "Connecting to the server" after launched crawling

[Entretoize]

It used to work but now when I click on "Crawl now" it just write "Connecting to the server, please wait..." and never change, the crawling never happen.

[StJudeWasHere]

Can you provide more details? URL, crawler options or any error printed out.

[renatop7]

@StJudeWasHere I'm having the same problem while running the docker image.

Trying to crawl this URL with default options:
https://www.centralsuldeleiloes.com.br

When opening the console on Chrome I can see this error:
WebSocket connection to 'ws://localhost:3001/crawl/ws?pid=1' failed:

[Entretoize]

For me, I have that error in the console:

Mixed Content: The page at 'https://seonaut.mydomain.fr/crawl/live?pid=4' was loaded over HTTPS, but attempted to connect to the insecure WebSocket endpoint 'ws://seonaut.mydomain.fr/crawl/ws?pid=4'. This request has been blocked; this endpoint must be available over WSS.

And I'm not sure, but maybe the crawling is done, but it give no update about that...

[StJudeWasHere]

Mixed Content: The page at 'https://seonaut.mydomain.fr/crawl/live?pid=4' was loaded over HTTPS, but attempted to connect to the insecure WebSocket endpoint 'ws://seonaut.mydomain.fr/crawl/ws?pid=4'. This request has been blocked; this endpoint must be available over WSS.

If you're using https, make sure to update the server url in the config file as well. Otherwise it could cause this kind of error.

[Entretoize]

You mean the "config" file ? Should I redo docker-compose up -d --build after that ? Will it erase everything ?

[StJudeWasHere]

Yes, you only need to build the app service docker-compose up -d --build app.

[Entretoize]

Ok, I did that and now I get:

WebSocket connection to 'wss://seonaut.mydomain.fr/crawl/ws?pid=2' failed

I tried that for my apache configuration:

<VirtualHost *:443>
  ServerName seonaut.mydomain.fr

  ProxyPass / http://localhost:9000/  ##tried with https but got error 500
  ProxyPassReverse / http://localhost:9000/

Include /etc/letsencrypt/options-ssl-apache.conf
SSLCertificateFile /etc/letsencrypt/live/mydomain.fr/fullchain.pem
SSLCertificateKeyFile /etc/letsencrypt/live/mydomain.fr/privkey.pem

ProxyPassMatch ^/crawl/ws/(.*)$ wss://localhost:9000/crawl/ws/$1
ProxyPassReverse /crawl/ws/ wss://localhost:9000/crawl/ws/

</VirtualHost>