v3.0.0: .ignore file, dropped py3.6
Pre-release
Pre-release
Changed
The .urlignore file is no longer supported. It is replaced by an .ignore file, where each line is a regular expression applied to the whole URL (#80).
By contrast, each line of the .urlignore file was a fixed string, and Transformer was looking for it to appear as-is in the domain part only.
Therefore, you should be careful when migrating your .urlignore into .ignore files; a simple copy-and-paste may result in some requests being handled differently.
Thank you @cyberw for this feature request and for contributing the implementation!
Removed
The lowest version of Python supported by Transformer is now 3.7.
Python 3.6 is no longer supported.
Contributors
cyberw