-
I preserve article crawled and don't need to read it again on the next run of the application. Is there a way to have a callback to tell not to add link to the crawl list? |
Beta Was this translation helpful? Give feedback.
Answered by
j-mendez
Dec 21, 2023
Replies: 1 comment
-
@kulak yes. You can use the blacklist configuration to add exact paths to be ignored. Once this PR gets released 06chaynes/http-cache#62 we can use a Cache Option with the “cache” feature flag to handle this by default. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
j-mendez
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
@kulak yes. You can use the blacklist configuration to add exact paths to be ignored.
Once this PR gets released 06chaynes/http-cache#62 we can use a Cache Option with the “cache” feature flag to handle this by default.