New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

crawler listening new request url #301

Open

Minyar2004 opened this issue Jul 30, 2018 · 1 comment

Labels

feature

Minyar2004 commented Jul 30, 2018 •

edited

Loading

What is the current behavior?
The crawler is closed when the queue is empty

What is the expected behavior?
Is there a possibility to not to close crawler but to keep it listening new url to crawl?

Please tell us about your environment:

Version: lastest
Platform / OS version: Centos 7.1
Node.js version: v8.4.0

matheuschimelli commented Oct 19, 2018

Remove this line
await crawler.close(); // Close the crawler

kulikalov added the feature label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment