Replies: 2 comments
-
I think there should be a node that just saves the data scraped either to a vector store or to a local directory. Sometimes the need for the scraping is not just to generate answers. |
Beta Was this translation helpful? Give feedback.
0 replies
-
There is the rag node |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently, FetchNode uses the AsyncChromiumLoader to load the page and the returned content is used further.
I think it would be good if we invested more effort into getting more structured and detailed webpage content:
I mean getting a dict out of the page that includes
Beta Was this translation helpful? Give feedback.
All reactions