2024-06-17 18:20:37 [scrapy.utils.log] INFO: Scrapy 2.11.0 started (bot: gazette) 2024-06-17 18:20:37 [scrapy.utils.log] INFO: Versions: lxml 4.9.3.0, libxml2 2.10.3, cssselect 1.2.0, parsel 1.8.1, w3lib 2.1.2, Twisted 22.10.0, Python 3.10.7 (main, May 29 2023, 13:51:48) [GCC 12.2.0], pyOpenSSL 23.2.0 (OpenSSL 3.1.3 19 Sep 2023), cryptography 41.0.4, Platform Linux-5.19.0-46-generic-x86_64-with-glibc2.36 2024-06-17 18:20:37 [pr_corbelia] INFO: Collecting data from 2024-05-01 to 2024-05-31. 2024-06-17 18:20:37 [scrapy.addons] INFO: Enabled addons: [] 2024-06-17 18:20:37 [py.warnings] WARNING: /home/marcos/Documentos/querido-diario/venv/lib/python3.10/site-packages/scrapy/utils/request.py:254: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy. See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation. return cls(crawler) 2024-06-17 18:20:37 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.epollreactor.EPollReactor 2024-06-17 18:20:37 [scrapy.extensions.telnet] INFO: Telnet Password: 704292d5e2d4a2be 2024-06-17 18:20:37 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon', 'gazette.extensions.StatsPersist'] 2024-06-17 18:20:37 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'gazette', 'COMMANDS_MODULE': 'gazette.commands', 'DOWNLOAD_TIMEOUT': 360, 'FILES_STORE_S3_ACL': 'public-read', 'LOG_FILE': 'log_pr_corbelia_intervalo_maio_24.txt', 'NEWSPIDER_MODULE': 'gazette.spiders', 'SPIDER_MODULES': ['gazette.spiders'], 'TEMPLATES_DIR': 'templates', 'USER_AGENT': 'Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:108.0) ' 'Gecko/20100101 Firefox/108.0'} 2024-06-17 18:20:37 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy_zyte_smartproxy.ZyteSmartProxyMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2024-06-17 18:20:37 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2024-06-17 18:20:37 [scrapy.middleware] INFO: Enabled item pipelines: ['gazette.pipelines.GazetteDateFilteringPipeline', 'gazette.pipelines.DefaultValuesPipeline', 'gazette.pipelines.QueridoDiarioFilesPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline', 'gazette.pipelines.SQLDatabasePipeline'] 2024-06-17 18:20:37 [scrapy.core.engine] INFO: Spider opened 2024-06-17 18:20:37 [gazette.database.models] INFO: Populating 'querido_diario_spider' table - Please wait! 2024-06-17 18:20:37 [gazette.database.models] INFO: Populating 'querido_diario_spider' table - Done! 2024-06-17 18:20:37 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-06-17 18:20:37 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2024-06-17 18:20:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:38 [tzlocal] DEBUG: /etc/timezone found, contents: America/Sao_Paulo 2024-06-17 18:20:38 [tzlocal] DEBUG: /etc/localtime found 2024-06-17 18:20:38 [tzlocal] DEBUG: 2 found: {'/etc/timezone': 'America/Sao_Paulo', '/etc/localtime is a symlink to': 'America/Sao_Paulo'} 2024-06-17 18:20:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D) 2024-06-17 18:20:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-23', 'edition_number': '2041', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222175%22%2C%22hash%22%3A%2277E8AF176DCB7DC5A27E5D4FC0A764380666BFAC%22%7D&cidade=padrao'], 'files': [{'checksum': 'b05ca049a826333848f4ae99c58f01ad', 'path': '4106308/2024-05-23/c26d6798052782a39c3af542cd6b6ee97621b631.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222175%22%2C%22hash%22%3A%2277E8AF176DCB7DC5A27E5D4FC0A764380666BFAC%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.560402Z', 'territory_id': '4106308'} 2024-06-17 18:20:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-24', 'edition_number': '2043', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222177%22%2C%22hash%22%3A%228EFDC9ADE50B6E66F6FAF856C4F60032470DBE48%22%7D&cidade=padrao'], 'files': [{'checksum': '919102fbb914849cc416a7cd85ca3600', 'path': '4106308/2024-05-24/fe07e6a3cb53a5a29f2f6643f46581dc420ddbe7.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222177%22%2C%22hash%22%3A%228EFDC9ADE50B6E66F6FAF856C4F60032470DBE48%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.556279Z', 'territory_id': '4106308'} 2024-06-17 18:20:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-22', 'edition_number': '2041', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222174%22%2C%22hash%22%3A%22CD58FFDF3539D91C33981796759697425C5C88A1%22%7D&cidade=padrao'], 'files': [{'checksum': '55d678b6fa5e582df247778ed58f8d4b', 'path': '4106308/2024-05-22/8d268059f6d53bc66295e13b718b7f2bad437c29.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222174%22%2C%22hash%22%3A%22CD58FFDF3539D91C33981796759697425C5C88A1%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.562461Z', 'territory_id': '4106308'} 2024-06-17 18:20:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-23', 'edition_number': '2042', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222176%22%2C%22hash%22%3A%220A2FF12FFE71D7013DF4436D7FB5A87DD4D45614%22%7D&cidade=padrao'], 'files': [{'checksum': 'ce23a21195d2edd7c1d661878e49aa95', 'path': '4106308/2024-05-23/15c5ac390c57ad203548ad89f14863204d10d239.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222176%22%2C%22hash%22%3A%220A2FF12FFE71D7013DF4436D7FB5A87DD4D45614%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.558328Z', 'territory_id': '4106308'} 2024-06-17 18:20:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-17', 'edition_number': '2038', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222171%22%2C%22hash%22%3A%224FEE57368D7B91A721EC9D7D5EB14E9642433431%22%7D&cidade=padrao'], 'files': [{'checksum': '1f9dc0017a08570d574e37a21c9ffeb2', 'path': '4106308/2024-05-17/2b382fe1ca185665fddbd2e4ba17c2ee22b3580a.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222171%22%2C%22hash%22%3A%224FEE57368D7B91A721EC9D7D5EB14E9642433431%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.567047Z', 'territory_id': '4106308'} 2024-06-17 18:20:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-29', 'edition_number': '2046', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222180%22%2C%22hash%22%3A%22F588B65A59CCB3FAD2988EE3E998893611C2D6D6%22%7D&cidade=padrao'], 'files': [{'checksum': '783f8f6cc44012c000bcaeaab4c99c3e', 'path': '4106308/2024-05-29/7e1838396a08da92f67f0157c5c8e0587c502443.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222180%22%2C%22hash%22%3A%22F588B65A59CCB3FAD2988EE3E998893611C2D6D6%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.143623Z', 'territory_id': '4106308'} 2024-06-17 18:20:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-21', 'edition_number': '2040', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222173%22%2C%22hash%22%3A%221A7E7F0124168ED7BE17BEB794B64BCCB2EA69CD%22%7D&cidade=padrao'], 'files': [{'checksum': 'd0aa11b55cdcf8926b9b92a1e261623e', 'path': '4106308/2024-05-21/06b23693e1d7f635f156112a480f08ae98e0d719.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222173%22%2C%22hash%22%3A%221A7E7F0124168ED7BE17BEB794B64BCCB2EA69CD%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.564165Z', 'territory_id': '4106308'} 2024-06-17 18:20:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-27', 'edition_number': '2044', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222178%22%2C%22hash%22%3A%22ABCFC5F4ADF075B2D9E48D7ECD5FCD32A88279B7%22%7D&cidade=padrao'], 'files': [{'checksum': '140cebbc5b26ec6d8a5982c2038092a4', 'path': '4106308/2024-05-27/a9b670a88fdfb842dd296860acccbd1282668eda.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222178%22%2C%22hash%22%3A%22ABCFC5F4ADF075B2D9E48D7ECD5FCD32A88279B7%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.553074Z', 'territory_id': '4106308'} 2024-06-17 18:20:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-13', 'edition_number': '2033', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222166%22%2C%22hash%22%3A%2270957ABFFF1450F1211E5EAA5ED335D7222DFBFD%22%7D&cidade=padrao'], 'files': [{'checksum': '774904794273253d35ce2f3143f42615', 'path': '4106308/2024-05-13/a0c19516c67261aad655817623f475bd83fb5be5.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222166%22%2C%22hash%22%3A%2270957ABFFF1450F1211E5EAA5ED335D7222DFBFD%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.573258Z', 'territory_id': '4106308'} 2024-06-17 18:20:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D) 2024-06-17 18:20:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-16', 'edition_number': '2037', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222170%22%2C%22hash%22%3A%22C90DB45434F60645D4473D49D0AF41EBD56FB275%22%7D&cidade=padrao'], 'files': [{'checksum': '195ff75f2d2f446d6312806a91dcdc12', 'path': '4106308/2024-05-16/ebb1729bd8ae8235c3d10953140ff0c8c04f1701.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222170%22%2C%22hash%22%3A%22C90DB45434F60645D4473D49D0AF41EBD56FB275%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.568163Z', 'territory_id': '4106308'} 2024-06-17 18:20:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-08', 'edition_number': '2031', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222163%22%2C%22hash%22%3A%2298FFD7E0E03A2BCCCF35F486B3D6AFD8EFF3AA86%22%7D&cidade=padrao'], 'files': [{'checksum': '57fc149fe1404f81799b4577a2e7bf66', 'path': '4106308/2024-05-08/307e89798d3589a16ff073f3e190dfcdfaff312c.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222163%22%2C%22hash%22%3A%2298FFD7E0E03A2BCCCF35F486B3D6AFD8EFF3AA86%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:50.189405Z', 'territory_id': '4106308'} 2024-06-17 18:20:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-15', 'edition_number': '2036', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222169%22%2C%22hash%22%3A%227EE06A38EC79EAFAEF24504339C57438B8AF734F%22%7D&cidade=padrao'], 'files': [{'checksum': 'c9204475026dac1d4e32fe781e8e4c7d', 'path': '4106308/2024-05-15/4f5c340491f267c160c5ed2eb3acb27c5e490a90.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222169%22%2C%22hash%22%3A%227EE06A38EC79EAFAEF24504339C57438B8AF734F%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.569283Z', 'territory_id': '4106308'} 2024-06-17 18:20:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-08', 'edition_number': '2030', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222162%22%2C%22hash%22%3A%222E025F32EDEB505AC8D4919A7A037B6E4B0AABB5%22%7D&cidade=padrao'], 'files': [{'checksum': 'abf67931833fcfc75d101e8bcd919b88', 'path': '4106308/2024-05-08/f4557c4f82a38e28beaa6ca10d4c4bdf3be80f24.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222162%22%2C%22hash%22%3A%222E025F32EDEB505AC8D4919A7A037B6E4B0AABB5%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:50.191364Z', 'territory_id': '4106308'} 2024-06-17 18:20:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-07', 'edition_number': '2029', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222160%22%2C%22hash%22%3A%22099B5B6A2D6B5963E58D02041315711918DA82DE%22%7D&cidade=padrao'], 'files': [{'checksum': '8bb18d532b25d5d173f48e0735627fdb', 'path': '4106308/2024-05-07/13459d37e1a2b362efaa4892408384148bd9b618.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222160%22%2C%22hash%22%3A%22099B5B6A2D6B5963E58D02041315711918DA82DE%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:50.193946Z', 'territory_id': '4106308'} 2024-06-17 18:20:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-13', 'edition_number': '2034', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222167%22%2C%22hash%22%3A%2212D703D21C88F05C4D57FBDECA56E3619D6F7755%22%7D&cidade=padrao'], 'files': [{'checksum': '435418be4ce72877a4a6302133f08b6d', 'path': '4106308/2024-05-13/49352b564c88db72456f45881edef51d5c77f42a.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222167%22%2C%22hash%22%3A%2212D703D21C88F05C4D57FBDECA56E3619D6F7755%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.571893Z', 'territory_id': '4106308'} 2024-06-17 18:20:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-20', 'edition_number': '2039', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222172%22%2C%22hash%22%3A%22C8158BBC04F066DB349DECD5CE7B215599765784%22%7D&cidade=padrao'], 'files': [{'checksum': 'dc2a89e188bc087db0df6d8cf33b022a', 'path': '4106308/2024-05-20/57dd7319296d0b97f51b9299811652fb5b7c2384.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222172%22%2C%22hash%22%3A%22C8158BBC04F066DB349DECD5CE7B215599765784%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.565946Z', 'territory_id': '4106308'} 2024-06-17 18:20:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-03', 'edition_number': '2027', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222157%22%2C%22hash%22%3A%2266589CCD91E3FD41B48FFA8CF7C95833B99D5B22%22%7D&cidade=padrao'], 'files': [{'checksum': 'b2e80c0a4f2728fe81a841b8d155356c', 'path': '4106308/2024-05-03/166d0f958c7e1474246cf36a6f6c6b66c4346352.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222157%22%2C%22hash%22%3A%2266589CCD91E3FD41B48FFA8CF7C95833B99D5B22%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:50.226803Z', 'territory_id': '4106308'} 2024-06-17 18:20:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:20:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:20:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-14', 'edition_number': '2035', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222168%22%2C%22hash%22%3A%22EBCA85729B5A4ECD5AD742656B62B2D67094418C%22%7D&cidade=padrao'], 'files': [{'checksum': 'f2900b9fe0ec6f845666c04e1a4c0e0c', 'path': '4106308/2024-05-14/9d88325d1d717947c8ca7fb0d4da8783bc500873.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222168%22%2C%22hash%22%3A%22EBCA85729B5A4ECD5AD742656B62B2D67094418C%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.570645Z', 'territory_id': '4106308'} 2024-06-17 18:21:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:21:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:21:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-03', 'edition_number': '2028', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222158%22%2C%22hash%22%3A%2268F3D02D455CB20BC3895993493C25ACE04F01C0%22%7D&cidade=padrao'], 'files': [{'checksum': '522532e8abc9aa0f5c66cf6552148d0f', 'path': '4106308/2024-05-03/3e18be68e78f0b6312043f806108c60b8c320bb3.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222158%22%2C%22hash%22%3A%2268F3D02D455CB20BC3895993493C25ACE04F01C0%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:50.196181Z', 'territory_id': '4106308'} 2024-06-17 18:21:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:21:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:21:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-10', 'edition_number': '2033', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222165%22%2C%22hash%22%3A%226CC58EF85E5995933346789EB7D2B5C624ED8B23%22%7D&cidade=padrao'], 'files': [{'checksum': '5100946d1926e996c8a5df1852db4790', 'path': '4106308/2024-05-10/b48d45909d047760731c9aa2d53993dfe26bb453.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222165%22%2C%22hash%22%3A%226CC58EF85E5995933346789EB7D2B5C624ED8B23%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.574473Z', 'territory_id': '4106308'} 2024-06-17 18:21:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:21:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:21:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-02', 'edition_number': '2026', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222156%22%2C%22hash%22%3A%22FEE423B398C8A6A0CE368499736AF093FCC6B852%22%7D&cidade=padrao'], 'files': [{'checksum': 'da2a91b1bc1f5d621fc6a694af064ffd', 'path': '4106308/2024-05-02/b206a0f9bf992d88c97b93f395bb898a16b9afed.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222156%22%2C%22hash%22%3A%22FEE423B398C8A6A0CE368499736AF093FCC6B852%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:50.227984Z', 'territory_id': '4106308'} 2024-06-17 18:21:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:21:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:21:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:21:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:21:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-06', 'edition_number': '2029', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222159%22%2C%22hash%22%3A%2211B482AA355674D8F62F613AF0AD99B3531C5AFB%22%7D&cidade=padrao'], 'files': [{'checksum': '7a229191054c0590cef07e9e571f4308', 'path': '4106308/2024-05-06/18c2822caf0199f615e6fe4afe0c2943266cce42.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222159%22%2C%22hash%22%3A%2211B482AA355674D8F62F613AF0AD99B3531C5AFB%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:50.195135Z', 'territory_id': '4106308'} 2024-06-17 18:21:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-28', 'edition_number': '2045', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222179%22%2C%22hash%22%3A%22E582B673FB596037569BB4B03807743823F274F8%22%7D&cidade=padrao'], 'files': [{'checksum': '7ab1c5b643d5b7222ab44f2c1026e2e9', 'path': '4106308/2024-05-28/bd35d9cea691cc8ad79490f40cc1520a9d2f0604.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222179%22%2C%22hash%22%3A%22E582B673FB596037569BB4B03807743823F274F8%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:38.546444Z', 'territory_id': '4106308'} 2024-06-17 18:21:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:21:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:21:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-09', 'edition_number': '2032', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222164%22%2C%22hash%22%3A%2270544B7F4B5811CC0DC92480C37811C50C48B358%22%7D&cidade=padrao'], 'files': [{'checksum': 'ff161d6f1cc669deec03a72a0cbd48f2', 'path': '4106308/2024-05-09/a800ec8450a9a28a942d1a6fc1e7c28fec570a69.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222164%22%2C%22hash%22%3A%2270544B7F4B5811CC0DC92480C37811C50C48B358%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:50.181741Z', 'territory_id': '4106308'} 2024-06-17 18:21:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:21:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:21:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://corbelia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-07', 'edition_number': '2030', 'file_urls': ['https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222161%22%2C%22hash%22%3A%2253B97B442441CE07C613093D683415F912F25D1C%22%7D&cidade=padrao'], 'files': [{'checksum': 'bb428d6eef3a3feab877e115bd414df6', 'path': '4106308/2024-05-07/c4d0627af24519ae7fb8bb9d04cbef40924f659f.pdf', 'status': 'downloaded', 'url': 'https://corbelia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%222161%22%2C%22hash%22%3A%2253B97B442441CE07C613093D683415F912F25D1C%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:20:50.192745Z', 'territory_id': '4106308'} 2024-06-17 18:21:06 [scrapy.core.engine] INFO: Closing spider (finished) 2024-06-17 18:21:06 [scrapy.extensions.feedexport] INFO: Stored csv feed (25 items) in: pr_corbelia_intervalo_maio_24.csv 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] ------------------------------ MONITORS ------------------------------ 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] Comparison Between Executions/Days without gazettes... OK 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] Requests/Items Ratio/Ratio of requests over items scraped count... OK 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] Error Count Monitor/test_stat_monitor... SKIPPED (Unable to find 'log_count/ERROR' in job stats.) 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... OK 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.) 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] 5 monitors in 0.003s 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] OK (skipped=2) 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] -------------------------- FINISHED ACTIONS -------------------------- 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] 0 actions in 0.000s 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] OK 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] --------------------------- PASSED ACTIONS --------------------------- 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] 0 actions in 0.000s 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] OK 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] --------------------------- FAILED ACTIONS --------------------------- 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] 1 action in 0.000s 2024-06-17 18:21:06 [pr_corbelia] INFO: [Spidermon] OK (skipped=1) 2024-06-17 18:21:06 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/request_bytes': 14124, 'downloader/request_count': 28, 'downloader/request_method_count/GET': 28, 'downloader/response_bytes': 154269509, 'downloader/response_count': 28, 'downloader/response_status_count/200': 28, 'elapsed_time_seconds': 29.076679, 'feedexport/success_count/FileFeedStorage': 1, 'file_count': 25, 'file_status_count/downloaded': 25, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2024, 6, 17, 21, 21, 6, 766014, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 71051, 'httpcompression/response_count': 3, 'item_scraped_count': 25, 'log_count/DEBUG': 82, 'log_count/INFO': 34, 'log_count/WARNING': 1, 'memusage/max': 123203584, 'memusage/startup': 123203584, 'request_depth_max': 2, 'response_received_count': 28, 'scheduler/dequeued': 3, 'scheduler/dequeued/memory': 3, 'scheduler/enqueued': 3, 'scheduler/enqueued/memory': 3, 'spidermon/validation/fields': 200, 'spidermon/validation/items': 25, 'spidermon/validation/validators': 1, 'spidermon/validation/validators/item/jsonschema': True, 'start_time': datetime.datetime(2024, 6, 17, 21, 20, 37, 689335, tzinfo=datetime.timezone.utc)} 2024-06-17 18:21:06 [scrapy.core.engine] INFO: Spider closed (finished)