Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use w3lib to generate feed uris. #73

Merged
merged 1 commit into from
Dec 24, 2014
Merged

Use w3lib to generate feed uris. #73

merged 1 commit into from
Dec 24, 2014

Conversation

andrewbaxter
Copy link
Contributor

The file path feed uri generation was producing invalid relative feed:
uris. w3lib has a method for generating qualified feed uris, so I used
that here.

Example:
The feed path "items/1/spider/hash.jl" would be converted to feed uri
"file://items/1/spider/hash.jl", which actually represents path
"/1/spider/hash.jl".

The file path feed uri generation was producing invalid relative feed:
uris.  w3lib has a method for generating qualified feed uris, so I used
that here.

Example:
The feed path "items/1/spider/hash.jl" would be converted to feed uri
"file://items/1/spider/hash.jl", which actually represents path
"/1/spider/hash.jl".
pablohoffman added a commit that referenced this pull request Dec 24, 2014
Use w3lib to generate feed uris.
@pablohoffman pablohoffman merged commit 26cfb94 into scrapy:master Dec 24, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants