Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Big site downloading: finished after a few minutes - expected to run for a few days #415

Closed
vitaly-zdanevich opened this issue Oct 18, 2024 · 2 comments
Closed

Big site downloading: finished after a few minutes - expected to run for a few days #415

vitaly-zdanevich opened this issue Oct 18, 2024 · 2 comments
Assignees
@benoit74

Comments

@vitaly-zdanevich
Copy link

docker run -v .:/output --name crawlme --rm ghcr.io/openzim/zimit:latest zimit --url "https://flibusta.is" --name flibusta-is-2024-10 --depth 1 --scopeType custom --include ".*" --workers 30 --diskUtilization 0

Exit code 0, fails folder empty, last few screens of logs:

{"timestamp":"2024-10-18T15:29:37.853Z","logLevel":"info","context":"behavior","message":"Behaviors finished","details":{"finished":1,"page":"https://flibusta.is/b/753380","workerid":21}}
{"timestamp":"2024-10-18T15:29:38.417Z","logLevel":"info","context":"behavior","message":"Running behaviors","details":{"frames":1,"frameUrls":["https://openid.net/"],"page":"http://openid.net/","workerid":9}}
{"timestamp":"2024-10-18T15:29:38.417Z","logLevel":"info","context":"behavior","message":"Run Script Started","details":{"frameUrl":"https://openid.net/","page":"http://openid.net/","workerid":9}}
{"timestamp":"2024-10-18T15:29:38.856Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"https://z-lib.org/","workerid":0}}
{"timestamp":"2024-10-18T15:29:38.857Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"https://flibusta.is/b/753380","workerid":21}}
{"timestamp":"2024-10-18T15:29:38.920Z","logLevel":"info","context":"behavior","message":"Running behaviors","details":{"frames":1,"frameUrls":["https://flibusta.is/b/800518"],"page":"https://flibusta.is/b/800518","workerid":1}}
{"timestamp":"2024-10-18T15:29:38.920Z","logLevel":"info","context":"behavior","message":"Run Script Started","details":{"frameUrl":"https://flibusta.is/b/800518","page":"https://flibusta.is/b/800518","workerid":1}}
{"timestamp":"2024-10-18T15:29:38.920Z","logLevel":"info","context":"behavior","message":"Running behaviors","details":{"frames":1,"frameUrls":["https://flibusta.is/b/407643"],"page":"https://flibusta.is/b/407643","workerid":5}}
{"timestamp":"2024-10-18T15:29:38.920Z","logLevel":"info","context":"behavior","message":"Run Script Started","details":{"frameUrl":"https://flibusta.is/b/407643","page":"https://flibusta.is/b/407643","workerid":5}}
{"timestamp":"2024-10-18T15:29:38.928Z","logLevel":"info","context":"behavior","message":"Run Script Finished","details":{"frameUrl":"https://openid.net/","page":"http://openid.net/","workerid":9}}
{"timestamp":"2024-10-18T15:29:38.928Z","logLevel":"info","context":"behavior","message":"Behaviors finished","details":{"finished":1,"page":"http://openid.net/","workerid":9}}
{"timestamp":"2024-10-18T15:29:39.423Z","logLevel":"info","context":"behavior","message":"Run Script Finished","details":{"frameUrl":"https://flibusta.is/b/800518","page":"https://flibusta.is/b/800518","workerid":1}}
{"timestamp":"2024-10-18T15:29:39.423Z","logLevel":"info","context":"behavior","message":"Behaviors finished","details":{"finished":1,"page":"https://flibusta.is/b/800518","workerid":1}}
{"timestamp":"2024-10-18T15:29:39.425Z","logLevel":"info","context":"behavior","message":"Run Script Finished","details":{"frameUrl":"https://flibusta.is/b/407643","page":"https://flibusta.is/b/407643","workerid":5}}
{"timestamp":"2024-10-18T15:29:39.425Z","logLevel":"info","context":"behavior","message":"Behaviors finished","details":{"finished":1,"page":"https://flibusta.is/b/407643","workerid":5}}
{"timestamp":"2024-10-18T15:29:39.473Z","logLevel":"info","context":"behavior","message":"Running behaviors","details":{"frames":1,"frameUrls":["https://flibusta.is/b/743865"],"page":"https://flibusta.is/b/743865","workerid":12}}
{"timestamp":"2024-10-18T15:29:39.473Z","logLevel":"info","context":"behavior","message":"Run Script Started","details":{"frameUrl":"https://flibusta.is/b/743865","page":"https://flibusta.is/b/743865","workerid":12}}
{"timestamp":"2024-10-18T15:29:39.933Z","logLevel":"warn","context":"pageStatus","message":"Page date missing, setting to now","details":{"url":"http://openid.net/","ts":"2024-10-18T15:29:39.933Z"}}
{"timestamp":"2024-10-18T15:29:39.933Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"http://openid.net/","workerid":9}}
{"timestamp":"2024-10-18T15:29:39.977Z","logLevel":"info","context":"behavior","message":"Run Script Finished","details":{"frameUrl":"https://flibusta.is/b/743865","page":"https://flibusta.is/b/743865","workerid":12}}
{"timestamp":"2024-10-18T15:29:39.977Z","logLevel":"info","context":"behavior","message":"Behaviors finished","details":{"finished":1,"page":"https://flibusta.is/b/743865","workerid":12}}
{"timestamp":"2024-10-18T15:29:40.157Z","logLevel":"info","context":"behavior","message":"Running behaviors","details":{"frames":1,"frameUrls":["https://flibusta.is/b/778397"],"page":"https://flibusta.is/b/778397","workerid":10}}
{"timestamp":"2024-10-18T15:29:40.157Z","logLevel":"info","context":"behavior","message":"Run Script Started","details":{"frameUrl":"https://flibusta.is/b/778397","page":"https://flibusta.is/b/778397","workerid":10}}
{"timestamp":"2024-10-18T15:29:40.427Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"https://flibusta.is/b/800518","workerid":1}}
{"timestamp":"2024-10-18T15:29:40.427Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"https://flibusta.is/b/407643","workerid":5}}
{"timestamp":"2024-10-18T15:29:40.660Z","logLevel":"info","context":"behavior","message":"Run Script Finished","details":{"frameUrl":"https://flibusta.is/b/778397","page":"https://flibusta.is/b/778397","workerid":10}}
{"timestamp":"2024-10-18T15:29:40.660Z","logLevel":"info","context":"behavior","message":"Behaviors finished","details":{"finished":1,"page":"https://flibusta.is/b/778397","workerid":10}}
{"timestamp":"2024-10-18T15:29:40.980Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"https://flibusta.is/b/743865","workerid":12}}
{"timestamp":"2024-10-18T15:29:41.666Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"https://flibusta.is/b/778397","workerid":10}}
{"timestamp":"2024-10-18T15:29:51.129Z","logLevel":"warn","context":"recorder","message":"Large payload written to WARC, but not returned to browser (would require rereading into memory)","details":{"url":"https://flibusta.is/catalog/catalog.zip","actualSize":24757021,"maxSize":5000000}}
{"timestamp":"2024-10-18T15:29:51.129Z","logLevel":"info","context":"fetch","message":"Direct fetch successful","details":{"url":"https://flibusta.is/catalog/catalog.zip","mime":"application/zip","page":"https://flibusta.is/catalog/catalog.zip","workerid":7}}
{"timestamp":"2024-10-18T15:29:51.129Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":2,"page":"https://flibusta.is/catalog/catalog.zip","workerid":7}}
{"timestamp":"2024-10-18T15:30:01.368Z","logLevel":"warn","context":"recorder","message":"Large payload written to WARC, but not returned to browser (would require rereading into memory)","details":{"url":"https://rr2---sn-npa3oxu-c0nz.googlevideo.com/videoplayback?expire=1729286922&ei=qn4SZ5z0GtyUsvQPm_qn4Ak&ip=188.169.244.17&id=o-AEC6mk36sBO4-WBjvW3K-hYQEiqrWhW40XU5KSwOKbzb&itag=18&source=youtube&requiressl=yes&xpc=EgVo2aDSNQ%3D%3D&met=1729265322%2C&mh=-s&mm=31%2C29&mn=sn-npa3oxu-c0nz%2Csn-nv47lnsy&ms=au%2Crdu&mv=m&mvi=2&pcm2cms=yes&pl=24&rms=au%2Cau&initcwndbps=1435000&bui=AXLXGFToVh9_MqSaYyy8xHEIYJ4nMy-F7iyWVic6K1aDTRb0ek_UddIaL3uSj6BzCsFuZMtm1w7ZlMVd&spc=54MbxRKwJbCM9Wjg1HItNY-rgjaVLISq1V7dfYVKTwaq4L2SN9YE-Lw&vprv=1&svpuc=1&mime=video%2Fmp4&ns=XLTPxQ4LnM5L2jsxuWRTfAAQ&rqh=1&cnr=14&ratebypass=yes&dur=202.199&lmt=1707326521215631&mt=1729264623&fvip=2&fexp=51312688&c=WEB_EMBEDDED_PLAYER&sefc=1&txp=5318224&n=8BTD7cchQa5JDA&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cxpc%2Cbui%2Cspc%2Cvprv%2Csvpuc%2Cmime%2Cns%2Crqh%2Ccnr%2Cratebypass%2Cdur%2Clmt&lsparams=met%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpcm2cms%2Cpl%2Crms%2Cinitcwndbps&lsig=ACJ0pHgwRAIgC2bcxONzpdAs9dNoQ9Ym7cHPxm4_l33XbiVGesSUSIYCIFLSV_l15MKGRL5594Q7IEppcuwbWOvoY-ERs9JaJQ-3&sig=AJfQdSswRgIhALU_BbWsE_wA_MdDOYknkOltxPWltf1ElVCpCda2FowhAiEA_FlRi8IHf_G47f4wYOsR7FwCblfWZNyCEs5lLox_WBg%3D&cpn=KeFCTTPGbGjgJ_99&cver=1.20241015.01.00.efe&ptk=youtube_multi&oid=BtscXOksyqSTYfLFAiFZaw.YEw2Dq2F9ZIBjvlyzSt1sw&pltype=contentugc","actualSize":14866100,"maxSize":5000000}}
{"timestamp":"2024-10-18T15:30:06.354Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"https://flibusta.is/node/536146","workerid":15}}
{"timestamp":"2024-10-18T15:30:08.670Z","logLevel":"warn","context":"general","message":"Page load timed out, loading but slowly, skipping behaviors","details":{"msg":"Navigation timeout of 90000 ms exceeded","page":"https://flibusta.is/node/135142","workerid":24}}
{"timestamp":"2024-10-18T15:30:10.396Z","logLevel":"warn","context":"general","message":"Page load timed out, loading but slowly, skipping behaviors","details":{"msg":"Navigation timeout of 90000 ms exceeded","page":"https://flibusta.is/node/180481","workerid":6}}
{"timestamp":"2024-10-18T15:30:11.185Z","logLevel":"info","context":"behavior","message":"Skipping behaviors for slow page","details":{"page":"https://flibusta.is/node/135142","workerid":24}}
{"timestamp":"2024-10-18T15:30:11.185Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":3,"page":"https://flibusta.is/node/135142","workerid":24}}
{"timestamp":"2024-10-18T15:30:12.908Z","logLevel":"info","context":"behavior","message":"Skipping behaviors for slow page","details":{"page":"https://flibusta.is/node/180481","workerid":6}}
{"timestamp":"2024-10-18T15:30:12.908Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":3,"page":"https://flibusta.is/node/180481","workerid":6}}
{"timestamp":"2024-10-18T15:30:12.946Z","logLevel":"warn","context":"general","message":"Page load timed out, loading but slowly, skipping behaviors","details":{"msg":"Navigation timeout of 90000 ms exceeded","page":"http://fbsearch.ru/","workerid":20}}
{"timestamp":"2024-10-18T15:30:15.458Z","logLevel":"info","context":"behavior","message":"Skipping behaviors for slow page","details":{"page":"http://fbsearch.ru/","workerid":20}}
{"timestamp":"2024-10-18T15:30:15.458Z","logLevel":"warn","context":"pageStatus","message":"Page date missing, setting to now","details":{"url":"http://fbsearch.ru/","ts":"2024-10-18T15:30:15.458Z"}}
{"timestamp":"2024-10-18T15:30:15.458Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":3,"page":"http://fbsearch.ru/","workerid":20}}
{"timestamp":"2024-10-18T15:30:18.454Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"https://flibusta.is/node?page=3","workerid":29}}
{"timestamp":"2024-10-18T15:30:23.705Z","logLevel":"warn","context":"recorder","message":"Large payload written to WARC, but not returned to browser (would require rereading into memory)","details":{"url":"https://rr2---sn-npa3oxu-c0nz.googlevideo.com/videoplayback?expire=1729286921&ei=qX4SZ5WWBtOEi9oP-8ydUA&ip=188.169.244.17&id=o-AHf8858FtfPgoyU5cDRIsEvZTTAH4RzmNrBuvW4JAATw&itag=18&source=youtube&requiressl=yes&xpc=EgVo2aDSNQ%3D%3D&met=1729265321%2C&mh=gJ&mm=31%2C29&mn=sn-npa3oxu-c0nz%2Csn-nv47znee&ms=au%2Crdu&mv=m&mvi=2&pl=24&rms=au%2Cau&initcwndbps=1341250&bui=AXLXGFSOE46C5yYLcwlJQH6mCX483ezsRQXz5C7v0gErssGi6D8ssqpEUwKcHm5JJxnyr7dsR5AnA2iI&spc=54MbxTcaAHlFYWpa0Z6Z8BIlgAlpc9AQDl4VFciuuQgNZC81NJOxCZ4&vprv=1&svpuc=1&mime=video%2Fmp4&ns=k6CB-mRr50FKtYurI_ZuttkQ&rqh=1&cnr=14&ratebypass=yes&dur=4819.696&lmt=1728894765843981&mt=1729265105&fvip=2&fexp=51312688&c=WEB_EMBEDDED_PLAYER&sefc=1&txp=5438434&n=PzG_viUhKypn5g&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cxpc%2Cbui%2Cspc%2Cvprv%2Csvpuc%2Cmime%2Cns%2Crqh%2Ccnr%2Cratebypass%2Cdur%2Clmt&lsparams=met%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Crms%2Cinitcwndbps&lsig=ACJ0pHgwRQIhAKkWWhr4hJw3R1WeNpsA7zuNWQMmwK6ivoexKS07ssRNAiAw-ZGt5o-A9Si-boKVZsdieF1cPi-_bemWiw__L3SWsQ%3D%3D&sig=AJfQdSswRQIhAIbqsSWBL13fZMl_6oSBOa8OkUxaKdG1gVm_Q_b47KuIAiBFTQawRrdPHPVo8j2HXuwgToh0Q1Zz7bQlQyfJK6BxYA%3D%3D&cpn=8ENcJ548sbGOxsZf&cver=1.20241015.01.00.efe&ptk=youtube_single&oid=HuIsQ2g2ZOb4CKJFWDukvA&pltype=contentugc","actualSize":134890005,"maxSize":5000000}}
{"timestamp":"2024-10-18T15:30:41.663Z","logLevel":"warn","context":"recorder","message":"Large payload written to WARC, but not returned to browser (would require rereading into memory)","details":{"url":"https://rr2---sn-nv47znee.googlevideo.com/videoplayback?expire=1729286921&ei=qH4SZ8eoPNXSi9oP1LPW8A0&ip=188.169.244.17&id=o-AIPBR2Qb0MVuPZwzcSzdKwJSQ1_Smr5s6v_KYY6NXiKR&itag=18&source=youtube&requiressl=yes&xpc=EgVo2aDSNQ%3D%3D&bui=AXLXGFRurABmKaTsxFJ7WM3uzsqEOb6mVysvPM0yTDuufBMfz6emra75aCkxUPQOzLCb8AeRIvHNxOfh&spc=54MbxUAE3Eg5cYhcfskb-yGqNHUrx0KvzaeDUCQ60Qw9VGfBg-DSAtg&vprv=1&svpuc=1&mime=video%2Fmp4&ns=99kDS_R15uX5BE4pSBs0OYEQ&rqh=1&cnr=14&ratebypass=yes&dur=4819.696&lmt=1728894765843981&fexp=24350595,24350655,24350675,24350705,51312688&c=WEB_EMBEDDED_PLAYER&sefc=1&txp=5438434&n=NqmBWu8iiGI4yQ&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cxpc%2Cbui%2Cspc%2Cvprv%2Csvpuc%2Cmime%2Cns%2Crqh%2Ccnr%2Cratebypass%2Cdur%2Clmt&sig=AJfQdSswRAIgC2psmT_iujHsMyIek0R545_Wha8dyl3hvkbNIVinbYYCIFFSVicn4GlyDTudLyubxZJKxtdsYeq3WCMJ4gwv1KTd&cpn=05ADJEU4VnKuASAe&cver=1.20241015.01.00.efe&ptk=youtube_single&oid=HuIsQ2g2ZOb4CKJFWDukvA&pltype=contentugc&redirect_counter=1&cm2rm=sn-npa3oxu-c0nz7l&rrc=80&req_id=f7094ee3186b36e2&cms_redirect=yes&cmsv=e&met=1729265321,&mh=gJ&mm=29&mn=sn-nv47znee&ms=rdu&mt=1729265101&mv=m&mvi=2&pl=24&rms=rdu,au&lsparams=met,mh,mm,mn,ms,mv,mvi,pl,rms&lsig=ACJ0pHgwRAIgNdPnBfGfrV81Jcfk-6LshA6kBaYEOebKl-hqT8Tz46cCIAmAYO2Qa5AZ7k9EdlTFOODnJY0x_OLkJfr8vCFUyAVM","actualSize":134890005,"maxSize":5000000}}
{"timestamp":"2024-10-18T15:31:48.275Z","logLevel":"warn","context":"worker","message":"Page Worker Timeout","details":{"seconds":190,"page":"https://flibusta.is/node/677688","workerid":28}}
{"timestamp":"2024-10-18T15:31:48.275Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"https://flibusta.is/node/677688","workerid":28}}
{"timestamp":"2024-10-18T15:31:52.445Z","logLevel":"warn","context":"worker","message":"Page Worker Timeout","details":{"seconds":190,"page":"https://flibusta.is/node?page=7","workerid":23}}
{"timestamp":"2024-10-18T15:31:52.446Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"https://flibusta.is/node?page=7","workerid":23}}
{"timestamp":"2024-10-18T15:32:13.890Z","logLevel":"warn","context":"worker","message":"Page Worker Timeout","details":{"seconds":190,"page":"https://flibusta.is/comment/3565668","workerid":22}}
{"timestamp":"2024-10-18T15:32:13.890Z","logLevel":"info","context":"pageStatus","message":"Page Finished","details":{"loadState":4,"page":"https://flibusta.is/comment/3565668","workerid":22}}
{"timestamp":"2024-10-18T15:32:13.892Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":22}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":2}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":11}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":16}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":13}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":19}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":3}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":14}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":25}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":26}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":17}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":4}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":27}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":18}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":0}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":21}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":8}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":5}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":1}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":9}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":12}}
{"timestamp":"2024-10-18T15:32:14.017Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":7}}
{"timestamp":"2024-10-18T15:32:14.018Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":15}}
{"timestamp":"2024-10-18T15:32:14.018Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":6}}
{"timestamp":"2024-10-18T15:32:14.018Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":29}}
{"timestamp":"2024-10-18T15:32:14.018Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":20}}
{"timestamp":"2024-10-18T15:32:14.050Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":23}}
{"timestamp":"2024-10-18T15:32:14.273Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":24}}
{"timestamp":"2024-10-18T15:32:14.273Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":10}}
{"timestamp":"2024-10-18T15:32:14.383Z","logLevel":"info","context":"worker","message":"Worker done, all tasks complete","details":{"workerid":28}}
{"timestamp":"2024-10-18T15:32:14.684Z","logLevel":"info","context":"crawlStatus","message":"Crawl statistics","details":{"crawled":166,"total":166,"pending":0,"failed":7,"limit":{"max":0,"hit":false},"pendingPages":[]}}
{"timestamp":"2024-10-18T15:32:14.684Z","logLevel":"info","context":"general","message":"Crawling done","details":{}}
{"timestamp":"2024-10-18T15:32:14.684Z","logLevel":"info","context":"general","message":"Exiting, Crawl status: done","details":{}}
[zimit::2024-10-18 15:32:14,711] INFO:
[zimit::2024-10-18 15:32:14,711] INFO:----------
[zimit::2024-10-18 15:32:14,711] INFO:Processing WARC files in/at /output/.tmpt6vsv5k0/collections/crawl-20241018152825708/archive
[zimit::2024-10-18 15:32:14,711] INFO:Calling warc2zim with these args: ['--name', 'flibusta-is-2024-10', '--scraper-suffix', 'zimit 2.1.4', '--output', '/output', '--url', 'https://flibusta.is', '/output/.tmpt6vsv5k0/collections/crawl-20241018152825708/archive']
[warc2zim::2024-10-18 15:32:15,743] INFO:Expecting 1244 ZIM entries to files
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of firepic.org/images/2013-09/14/c5ajwr3lysi3.png is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/76n9t0dwzkcj.png is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/ul5xzpc2l6bx.png is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/mv7lv2krjb94.png is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/63yo9lq4ea2y.jpg is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/vfd1hqtcp5xh.png is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/frgek2pfofur.png is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/c64km1dpebn3.jpg is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/do98xkie9069.jpg is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/7s2qtsmbdnup.jpg is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/3ctesuxrf4il.jpg is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/suaslyloiq73.jpg is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/lqy207w3ub17.jpg is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection target of 3.firepic.org/3/images/2013-09/14/0vf1gsimpklf.jpg is missing (firepic.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection loop found for slon.ru/images3/6/1000000/632/1088431.jpg, corresponding ZIMPaths will be ignored.
[warc2zim::2024-10-18 15:32:15,743] WARNING:  - slon.ru/images3/6/1000000/632/1088431.jpg redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,743] WARNING:  - republic.ru/ redirects to redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/&
[warc2zim::2024-10-18 15:32:15,743] WARNING:  - redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/& redirects to republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/
[warc2zim::2024-10-18 15:32:15,743] WARNING:  - republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/ redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection loop found for republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiJlMjEwMzFkMi1kYmZlLTQ1MDYtOGQ5MC03ZjVmYzljMDRiYTEiLCJpYXQiOjE3MjkyNjUzMjgsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.coV87kJShKlibIy8EhKu9SRz_cv-XAVYOpjyh-qGDA0&originalUrl=/, corresponding ZIMPaths will be ignored.
[warc2zim::2024-10-18 15:32:15,743] WARNING:  - republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiJlMjEwMzFkMi1kYmZlLTQ1MDYtOGQ5MC03ZjVmYzljMDRiYTEiLCJpYXQiOjE3MjkyNjUzMjgsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.coV87kJShKlibIy8EhKu9SRz_cv-XAVYOpjyh-qGDA0&originalUrl=/ redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,743] WARNING:  - republic.ru/ redirects to redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/&
[warc2zim::2024-10-18 15:32:15,743] WARNING:  - redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/& redirects to republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/
[warc2zim::2024-10-18 15:32:15,743] WARNING:  - republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/ redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,743] WARNING:Redirection loop found for republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiJhY2Y2ZGZiMS1kN2FhLTQxYjMtYWUzMy1mOTM3YTIzNDE4MmEiLCJpYXQiOjE3MjkyNjUzMjksInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.lzjBci_gJL16-GRGDkjAMDYquQEe3jrm5S46lC7ohJk&originalUrl=/, corresponding ZIMPaths will be ignored.
[warc2zim::2024-10-18 15:32:15,743] WARNING:  - republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiJhY2Y2ZGZiMS1kN2FhLTQxYjMtYWUzMy1mOTM3YTIzNDE4MmEiLCJpYXQiOjE3MjkyNjUzMjksInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.lzjBci_gJL16-GRGDkjAMDYquQEe3jrm5S46lC7ohJk&originalUrl=/ redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,743] WARNING:  - republic.ru/ redirects to redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/&
[warc2zim::2024-10-18 15:32:15,743] WARNING:  - redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/& redirects to republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/ redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,744] WARNING:Redirection loop found for republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiI1YTcyYmJhNy0yZjI0LTQwNDYtOTVkMS03MDRhZjg0MzQ2MWMiLCJpYXQiOjE3MjkyNjUzMjksInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.MP3y0dG3VWSEmXMRI__X3Ken2knNs9XtAaITziE2sZQ&originalUrl=/, corresponding ZIMPaths will be ignored.
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiI1YTcyYmJhNy0yZjI0LTQwNDYtOTVkMS03MDRhZjg0MzQ2MWMiLCJpYXQiOjE3MjkyNjUzMjksInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.MP3y0dG3VWSEmXMRI__X3Ken2knNs9XtAaITziE2sZQ&originalUrl=/ redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - republic.ru/ redirects to redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/&
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/& redirects to republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/ redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,744] WARNING:Redirection loop found for republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiI5NzM3MTkzNi01MTMxLTRmZDctODg1YS0zNzQ0MWI4OTcwZjMiLCJpYXQiOjE3MjkyNjUzMzAsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.ZNqWuVKTQnwElYkoEKMbN49Ogqc_5shOPZ3KH5SoLgI&originalUrl=/, corresponding ZIMPaths will be ignored.
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiI5NzM3MTkzNi01MTMxLTRmZDctODg1YS0zNzQ0MWI4OTcwZjMiLCJpYXQiOjE3MjkyNjUzMzAsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.ZNqWuVKTQnwElYkoEKMbN49Ogqc_5shOPZ3KH5SoLgI&originalUrl=/ redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - republic.ru/ redirects to redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/&
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/& redirects to republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/ redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,744] WARNING:Redirection loop found for republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiJmZDNlNWE4YS0yOWE5LTRlMDMtYTJlMS1iZjQ2YWM5YWJkNWQiLCJpYXQiOjE3MjkyNjUzMzAsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0._OhC3wYGLayJxyjrOlA4CvtkSi97QIDdV7mcDhUJmaE&originalUrl=/, corresponding ZIMPaths will be ignored.
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiJmZDNlNWE4YS0yOWE5LTRlMDMtYTJlMS1iZjQ2YWM5YWJkNWQiLCJpYXQiOjE3MjkyNjUzMzAsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0._OhC3wYGLayJxyjrOlA4CvtkSi97QIDdV7mcDhUJmaE&originalUrl=/ redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - republic.ru/ redirects to redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/&
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - redefine.media/api/share-cookie?redirectTo=https:/republic.ru/share-cookie&originalUrl=/& redirects to republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/
[warc2zim::2024-10-18 15:32:15,744] WARNING:  - republic.ru/share-cookie?cookie=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzZXNzaW9uSWQiOiIzN2I0OGM0OS1hMDQ0LTQ3ODEtOTA5OC0xMTBiNzVkMjA3MjkiLCJpYXQiOjE3MjkyNjUzMjcsInN1YiI6ImF1dGhlbnRpY2F0aW9uIn0.HGt-6P_xtsTaqn6MLOAcK5ysTzStnp2pUggdbQD1B9Q&originalUrl=/ redirects to republic.ru/
[warc2zim::2024-10-18 15:32:15,744] WARNING:Redirection target of www.zimaletta.com.ua/ufiles/hotels/17070/conrad_maldives_rangali_island77.jpg is missing (zimaletta.com.ua/ufiles/hotels/17070/conrad_maldives_rangali_island77.jpg is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,744] WARNING:Redirection target of www.austria-forum.org/wbtmaster/kindle/ip/Anonymous_tigra.png is missing (austria-forum.org/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,744] WARNING:Redirection target of showpic.ru/upload/030915/55e7f17a94ab1.jpg is missing (showpic.ru/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,744] WARNING:Redirection target of showpic.ru/upload/030915/55e7fd9c38967.jpg is missing (showpic.ru/ is not expected in the ZIM)
[warc2zim::2024-10-18 15:32:15,744] INFO:Expecting 1261 ZIM entries including redirects
[warc2zim::2024-10-18 15:32:16,412] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,460] WARNING:Rewrite mode has changed in 2.0.1 for z-lib.org/favicon.ico record: was html, now is None (mimetype: text/html, resourcetype: other)
[warc2zim::2024-10-18 15:32:16,547] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,596] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,597] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,597] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,598] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,599] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,599] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,600] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,600] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,601] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,601] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,602] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,603] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,603] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,604] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,604] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,605] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,605] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,606] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,607] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,607] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,608] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,608] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,609] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,610] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,610] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,611] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,611] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,612] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,612] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,613] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,613] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,614] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,615] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,615] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,616] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,616] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,616] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,617] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,617] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,618] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,618] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,619] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,619] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,619] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,620] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,621] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,621] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,622] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,622] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,623] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,955] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,956] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,956] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,957] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,958] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,958] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,958] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,959] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,959] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,960] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,960] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,961] WARNING:Css transformation fails. Fallback to regex rewriter.
@vitaly-zdanevich
Copy link
Author

...logs second part:

Content is `size`
[warc2zim::2024-10-18 15:32:16,961] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,962] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,962] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:16,963] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,237] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,238] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,239] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,239] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,240] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,241] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,241] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,242] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,242] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,243] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,243] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,244] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,245] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,245] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,246] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,246] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,247] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,248] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,248] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,249] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,249] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,250] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,250] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,251] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,251] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,252] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,252] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,253] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,253] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,254] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,254] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,255] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,255] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,256] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,256] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,257] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,257] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,258] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,258] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,259] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,259] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,260] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,260] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,261] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,261] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,262] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,262] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,263] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,263] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,264] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,264] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,265] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,265] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,266] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,266] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,267] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,267] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,268] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,268] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,269] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,269] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,270] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,270] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,271] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,271] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,272] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,272] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,273] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,273] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,274] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,274] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,275] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,275] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,276] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,276] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,277] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,277] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,278] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,278] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,279] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,279] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,280] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,280] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,281] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,281] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,282] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,282] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,283] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,283] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,284] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,284] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,285] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,285] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,286] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,286] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,287] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,287] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,288] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,288] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,289] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,289] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,290] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,290] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,291] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,291] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,292] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,292] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,293] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,293] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,294] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,294] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,295] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,295] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,296] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,296] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,297] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,297] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,298] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,298] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,299] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,299] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,300] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,300] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,301] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,301] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,302] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,302] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,303] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,303] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,304] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,304] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,305] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,305] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,306] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,306] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,307] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,307] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,308] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,308] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,309] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,309] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,310] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,310] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,311] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:17,312] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:18,638] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,467] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,467] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,468] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,469] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,470] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,470] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,471] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,471] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,472] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,473] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,473] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,474] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,475] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,475] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,476] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,477] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,477] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,478] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,479] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,479] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,480] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,481] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,481] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,482] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,483] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,483] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:19,484] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:21,603] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:21,604] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:21,604] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:21,605] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:21,606] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:21,606] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:21,927] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:22,140] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:23,848] WARNING:Rewrite mode has changed in 2.0.1 for x.com/manifest.json record: was None, now is json (mimetype: application/manifest+json, resourcetype: manifest)
[warc2zim::2024-10-18 15:32:23,937] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,221] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,222] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,222] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,223] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,224] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,224] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,225] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,226] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,226] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,227] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,228] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,228] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:24,721] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
Warning, www.rba.ru/conference/2016/css/fonts/fontawesome-webfont.woff2?v=4.3.0 have empty mimetype.
[warc2zim::2024-10-18 15:32:25,400] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,446] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,785] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,785] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,786] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,786] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,787] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,787] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,788] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,788] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,789] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,789] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,790] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,790] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,791] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,791] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,792] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,792] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,793] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,793] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,794] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,794] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,795] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,795] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,796] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,796] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,797] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,797] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,798] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,798] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,799] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,799] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,800] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,800] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,801] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,801] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,802] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,802] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,803] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,803] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,804] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,804] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,805] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,805] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,806] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,806] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,807] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,807] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,808] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,808] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,809] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,810] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,810] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,811] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,811] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,812] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,812] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,813] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,813] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,814] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,814] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,815] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,815] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,816] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,816] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,817] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,817] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,818] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:25,818] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,721] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,741] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,943] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,943] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,944] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,944] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,945] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,945] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,946] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,947] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,947] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,947] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,948] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,949] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,949] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,950] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,950] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,950] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,951] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,952] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,952] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,953] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,953] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,954] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,955] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,955] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,956] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,956] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,957] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,957] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,958] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,958] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,959] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,960] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,960] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,961] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,961] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,961] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,962] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,962] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,962] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,963] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,963] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,964] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,964] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,965] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,965] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,966] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,967] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,967] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,968] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:26,968] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:27,098] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
[warc2zim::2024-10-18 15:32:27,688] WARNING:Css transformation fails. Fallback to regex rewriter.
Content is `size`
Resolve redirect
set index
[zimit::2024-10-18 15:32:28,432] INFO:
[zimit::2024-10-18 15:32:28,432] INFO:----------
[zimit::2024-10-18 15:32:28,432] INFO:Cleanup, removing temp dir: /output/.tmpt6vsv5k0

@vitaly-zdanevich vitaly-zdanevich changed the title Big size downloading: finished after a few minutes - expected to run for a few days Big site downloading: finished after a few minutes - expected to run for a few days Oct 18, 2024
@benoit74
Copy link
Collaborator

Logs are clear: all pages are finishing with Navigation timeout of 90000 ms exceeded. You've probably been banned by this website protections. And this is somehow well deserved, --workers 30 is causing significant load on servers (imagine 30 persons browsing the website continuously without any interruption, going to all dark corners of the website). This is why we strongly recommend to not exceed more than 4 workers.

@benoit74 benoit74 closed this as not planned Won't fix, can't repro, duplicate, stale Oct 21, 2024
@vitaly-zdanevich vitaly-zdanevich mentioned this issue Oct 21, 2024
Open
@benoit74 benoit74 self-assigned this Feb 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@benoit74 benoit74

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@vitaly-zdanevich @benoit74