Skip to content
This repository has been archived by the owner on Oct 2, 2023. It is now read-only.

Bump scrapy from 2.10.1 to 2.11.0 #667

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Oct 1, 2023

Bumps scrapy from 2.10.1 to 2.11.0.

Release notes

Sourced from scrapy's releases.

2.11.0

  • Spiders can now modify settings in their from_crawler methods, e.g. based on spider arguments.
  • Periodic logging of stats.
  • Bug fixes.

See the full changelog.

Changelog

Sourced from scrapy's changelog.

Scrapy 2.11.0 (2023-09-18)

Highlights:

  • Spiders can now modify :ref:settings <topics-settings> in their :meth:~scrapy.Spider.from_crawler methods, e.g. based on :ref:spider arguments <spiderargs>.

  • Periodic logging of stats.

Backward-incompatible changes


-   Most of the initialization of :class:`scrapy.crawler.Crawler` instances is
    now done in :meth:`~scrapy.crawler.Crawler.crawl`, so the state of
    instances before that method is called is now different compared to older
    Scrapy versions. We do not recommend using the
    :class:`~scrapy.crawler.Crawler` instances before
    :meth:`~scrapy.crawler.Crawler.crawl` is called. (:issue:`6038`)
  • :meth:scrapy.Spider.from_crawler is now called before the initialization of various components previously initialized in :meth:scrapy.crawler.Crawler.__init__ and before the settings are finalized and frozen. This change was needed to allow changing the settings in :meth:scrapy.Spider.from_crawler. If you want to access the final setting values in the spider code as early as possible you can do this in :meth:~scrapy.Spider.start_requests. (:issue:6038)

  • The :meth:TextResponse.json &lt;scrapy.http.TextResponse.json&gt; method now requires the response to be in a valid JSON encoding (UTF-8, UTF-16, or UTF-32). If you need to deal with JSON documents in an invalid encoding, use json.loads(response.text) instead. (:issue:6016)

Deprecation removals


-   Removed the binary export mode of
    :class:`~scrapy.exporters.PythonItemExporter`, deprecated in Scrapy 1.1.0.
    (:issue:`6006`, :issue:`6007`)
.. note:: If you are using this Scrapy version on Scrapy Cloud with a stack
          that includes an older Scrapy version and get a &amp;quot;TypeError:
          Unexpected options: binary&amp;quot; error, you may need to add
          ``scrapinghub-entrypoint-scrapy &amp;gt;= 0.14.1`` to your project
          requirements or switch to a stack that includes Scrapy 2.11.
  • Removed the CrawlerRunner.spiders attribute, deprecated in Scrapy
    1.0.0, use :attr:`CrawlerRunner.spider_loader
    &lt;/tr&gt;&lt;/table&gt;
    </code></pre>
    </blockquote>
    <p>... (truncated)</p>
    </details>
    <details>
    <summary>Commits</summary>

<ul>
<li><a href="https://github.com/scrapy/scrapy/commit/f2fb4760d2e98cc92ab00a84bcf20cd8a6de3799&quot;&gt;&lt;code&gt;f2fb476&lt;/code&gt;&lt;/a> Bump version: 2.10.1 → 2.11.0</li>
<li><a href="https://github.com/scrapy/scrapy/commit/efc594b53f4d950066012951f709bcc3dde8114b&quot;&gt;&lt;code&gt;efc594b&lt;/code&gt;&lt;/a> Merge pull request <a href="https://redirect.github.com/scrapy/scrapy/issues/6048&quot;&gt;#6048&lt;/a> from wRAR/relnotes-2.11</li>
<li><a href="https://github.com/scrapy/scrapy/commit/528911da85f871fd0f7546d4d16bbea556793d4b&quot;&gt;&lt;code&gt;528911d&lt;/code&gt;&lt;/a> Fix/reword the release notes.</li>
<li><a href="https://github.com/scrapy/scrapy/commit/2fa768399a27aca615bccfc7c466758a968f10fe&quot;&gt;&lt;code&gt;2fa7683&lt;/code&gt;&lt;/a> Replace the VERSION vars.</li>
<li><a href="https://github.com/scrapy/scrapy/commit/c2346b4a95e51ec1d3a255e19b49042b4598a02d&quot;&gt;&lt;code&gt;c2346b4&lt;/code&gt;&lt;/a> Update the release notes up to current master.</li>
<li><a href="https://github.com/scrapy/scrapy/commit/3f34a5b151b747f353817f2db2dc2f1a5db32c77&quot;&gt;&lt;code&gt;3f34a5b&lt;/code&gt;&lt;/a> Merge pull request <a href="https://redirect.github.com/scrapy/scrapy/issues/6050&quot;&gt;#6050&lt;/a> from wRAR/retrymw-fix</li>
<li><a href="https://github.com/scrapy/scrapy/commit/800c1f112e883070d97aa679b4bae10f618633a9&quot;&gt;&lt;code&gt;800c1f1&lt;/code&gt;&lt;/a> Remove the constant.</li>
<li><a href="https://github.com/scrapy/scrapy/commit/14c27d2215e539407883556f38374d0db198aff7&quot;&gt;&lt;code&gt;14c27d2&lt;/code&gt;&lt;/a> Merge branch 'master' into relnotes-2.11</li>
<li><a href="https://github.com/scrapy/scrapy/commit/922ff5738448205c5b7e5ced533bb8820b168480&quot;&gt;&lt;code&gt;922ff57&lt;/code&gt;&lt;/a> Improve the backwards compatibility for RetryMiddleware.EXCEPTIONS_TO_RETRY.</li>
<li><a href="https://github.com/scrapy/scrapy/commit/dba37674e6eaa6c2030c8eb35ebf8127cd488062&quot;&gt;&lt;code&gt;dba3767&lt;/code&gt;&lt;/a> Merge pull request <a href="https://redirect.github.com/scrapy/scrapy/issues/6038&quot;&gt;#6038&lt;/a> from wRAR/change-init-order</li>
<li>Additional commits viewable in <a href="https://github.com/scrapy/scrapy/compare/2.10.1...2.11.0&quot;&gt;compare view</a></li>
</ul>
</details>

<br />

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [scrapy](https://github.com/scrapy/scrapy) from 2.10.1 to 2.11.0.
- [Release notes](https://github.com/scrapy/scrapy/releases)
- [Changelog](https://github.com/scrapy/scrapy/blob/master/docs/news.rst)
- [Commits](scrapy/scrapy@2.10.1...2.11.0)

---
updated-dependencies:
- dependency-name: scrapy
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot bot added the dependencies Pull requests that update a dependency file label Oct 1, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants