Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[REGRESSION] wt2html: Exceeded max resource use: listItem #710

Closed
kelson42 opened this issue Apr 30, 2019 · 3 comments · Fixed by #713
Closed

[REGRESSION] wt2html: Exceeded max resource use: listItem #710

kelson42 opened this issue Apr 30, 2019 · 3 comments · Fixed by #713
Assignees
Labels
Milestone

Comments

@kelson42
Copy link
Collaborator

Impossible to scrape ar.wikisource.org because of this:

mwoffliner --mwUrl=https://ar.wikisource.org --adminEmail=contact@kiwix.org --format=nopic --format=novid --useCache --redis=redis://redis --outputDirectory=/output

gives

{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"لسان_الميزان/الجزء_الثاني","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:24.533Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"لسان_الميزان/الجزء_الثاني","oldId":86277,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 3506.4487240314484ms","longMsg":"completed wt2html in 3506.4487240314484ms","levelPath":"info","time":"2019-04-29T20:54:28.037Z","v":0}
[log] [2019-04-29T20:54:30.924Z] Processing batch of [11] article ids
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"التاج في أخلاق الملوك/باب في المنادمة/في حضرة الملك","oldId":150940,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 150940 for html","longMsg":"redirecting to revision\n150940\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:31.174Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"غَزَالٌ لا أَزالُ بِهِ أَهيمُ","oldId":173356,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 173356 for html","longMsg":"redirecting to revision\n173356\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:31.177Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أنا روضة وجه الأمير محمد","oldId":164429,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 164429 for html","longMsg":"redirecting to revision\n164429\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:31.178Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"التاج_في_أخلاق_الملوك/باب_في_المنادمة/في_حضرة_الملك","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:31.185Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"غَزَالٌ_لا_أَزالُ_بِهِ_أَهيمُ","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:31.191Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أنا_روضة_وجه_الأمير_محمد","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:31.195Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجموع الفتاوى/المجلد الثالث/فصل من أصول أهل السنة والجماعة أنهم يصلون الجمع والأعياد والجماعات","oldId":47045,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 47045 for html","longMsg":"redirecting to revision\n47045\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:31.207Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجموع_الفتاوى/المجلد_الثالث/فصل_من_أصول_أهل_السنة_والجماعة_أنهم_يصلون_الجمع_والأعياد_والجماعات","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:31.212Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أساس البلاغة","oldId":231639,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 231639 for html","longMsg":"redirecting to revision\n231639\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:31.214Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أساس_البلاغة","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:31.218Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجموع_الفتاوى/المجلد_الثالث/فصل_من_أصول_أهل_السنة_والجماعة_أنهم_يصلون_الجمع_والأعياد_والجماعات","oldId":47045,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 496.4481819868088ms","longMsg":"completed wt2html in 496.4481819868088ms","levelPath":"info","time":"2019-04-29T20:54:31.707Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"الدر المنثور/سورة الإسراء","oldId":107876,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 107876 for html","longMsg":"redirecting to revision\n107876\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:31.742Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"الدر_المنثور/سورة_الإسراء","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:31.750Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"التاج_في_أخلاق_الملوك/باب_في_المنادمة/في_حضرة_الملك","oldId":150940,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 650.2903970479965ms","longMsg":"completed wt2html in 650.2903970479965ms","levelPath":"info","time":"2019-04-29T20:54:31.833Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"غَزَالٌ_لا_أَزالُ_بِهِ_أَهيمُ","oldId":173356,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 671.5466170310974ms","longMsg":"completed wt2html in 671.5466170310974ms","levelPath":"info","time":"2019-04-29T20:54:31.861Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أنا_روضة_وجه_الأمير_محمد","oldId":164429,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 667.190309047699ms","longMsg":"completed wt2html in 667.190309047699ms","levelPath":"info","time":"2019-04-29T20:54:31.861Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أساس_البلاغة","oldId":231639,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 904.952418923378ms","longMsg":"completed wt2html in 904.952418923378ms","levelPath":"info","time":"2019-04-29T20:54:32.122Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"صحا القلب من سلمى","oldId":54954,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 54954 for html","longMsg":"redirecting to revision\n54954\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:32.399Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"صحا_القلب_من_سلمى","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:32.404Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"القرآن الكريم/سورة مريم","oldId":131952,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 131952 for html","longMsg":"redirecting to revision\n131952\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:32.498Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"القرآن_الكريم/سورة_مريم","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:32.508Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"المزهر/النوع الثاني عشر","oldId":109923,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 109923 for html","longMsg":"redirecting to revision\n109923\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:32.565Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"المزهر/النوع_الثاني_عشر","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:32.570Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة الرسالة/العدد 895/الاتحاد البرلماني العربي","oldId":214308,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 214308 for html","longMsg":"redirecting to revision\n214308\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:32.671Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_895/الاتحاد_البرلماني_العربي","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:32.676Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"صحا_القلب_من_سلمى","oldId":54954,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 711.4831720590591ms","longMsg":"completed wt2html in 711.4831720590591ms","levelPath":"info","time":"2019-04-29T20:54:33.114Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"الدر_المنثور/سورة_الإسراء","oldId":107876,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 1862.6392360925674ms","longMsg":"completed wt2html in 1862.6392360925674ms","levelPath":"info","time":"2019-04-29T20:54:33.611Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"القرآن_الكريم/سورة_مريم","oldId":131952,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 1154.9387760162354ms","longMsg":"completed wt2html in 1154.9387760162354ms","levelPath":"info","time":"2019-04-29T20:54:33.662Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"المزهر/النوع_الثاني_عشر","oldId":109923,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 1184.4977560043335ms","longMsg":"completed wt2html in 1184.4977560043335ms","levelPath":"info","time":"2019-04-29T20:54:33.753Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_895/الاتحاد_البرلماني_العربي","oldId":214308,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 1344.757686972618ms","longMsg":"completed wt2html in 1344.757686972618ms","levelPath":"info","time":"2019-04-29T20:54:34.020Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"طـربُ الـقـلــوب إلــى الـحـسَــن","oldId":192682,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 192682 for html","longMsg":"redirecting to revision\n192682\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:35.222Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"طـربُ_الـقـلــوب_إلــى_الـحـسَــن","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:35.228Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"طـربُ_الـقـلــوب_إلــى_الـحـسَــن","oldId":192682,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 589.2275129556656ms","longMsg":"completed wt2html in 589.2275129556656ms","levelPath":"info","time":"2019-04-29T20:54:35.815Z","v":0}
[log] [2019-04-29T20:54:36.082Z] Progress downloading articles [46402/80905] [57.4%]
[log] [2019-04-29T20:54:36.083Z] Processing batch of [10] article ids
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"يا من هجر المحب من غيرِ سببْ","oldId":176549,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 176549 for html","longMsg":"redirecting to revision\n176549\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:36.319Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"يا_من_هجر_المحب_من_غيرِ_سببْ","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:36.325Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة الرسالة/العدد 291/صوت الآنسة أم كلثوم","oldId":206219,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 206219 for html","longMsg":"redirecting to revision\n206219\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:36.327Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_291/صوت_الآنسة_أم_كلثوم","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:36.332Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"صبا من بعد سلوته فؤادي","oldId":154618,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 154618 for html","longMsg":"redirecting to revision\n154618\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:36.333Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"صبا_من_بعد_سلوته_فؤادي","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:36.338Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة الرسالة/العدد 124/الكتب","oldId":203117,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 203117 for html","longMsg":"redirecting to revision\n203117\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:36.372Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_124/الكتب","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:36.382Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة الرسالة/العدد 542/جامع أحمد ابن طولون","oldId":209736,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 209736 for html","longMsg":"redirecting to revision\n209736\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:36.385Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_542/جامع_أحمد_ابن_طولون","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:36.390Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_291/صوت_الآنسة_أم_كلثوم","oldId":206219,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 444.0658440589905ms","longMsg":"completed wt2html in 444.0658440589905ms","levelPath":"info","time":"2019-04-29T20:54:36.774Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"يا_من_هجر_المحب_من_غيرِ_سببْ","oldId":176549,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 516.5023820400238ms","longMsg":"completed wt2html in 516.5023820400238ms","levelPath":"info","time":"2019-04-29T20:54:36.839Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"صبا_من_بعد_سلوته_فؤادي","oldId":154618,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 537.7102060317993ms","longMsg":"completed wt2html in 537.7102060317993ms","levelPath":"info","time":"2019-04-29T20:54:36.874Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_542/جامع_أحمد_ابن_طولون","oldId":209736,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 499.61877501010895ms","longMsg":"completed wt2html in 499.61877501010895ms","levelPath":"info","time":"2019-04-29T20:54:36.888Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_124/الكتب","oldId":203117,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 539.4650950431824ms","longMsg":"completed wt2html in 539.4650950431824ms","levelPath":"info","time":"2019-04-29T20:54:36.916Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة الرسالة/العدد 664/كافور الإخشيدي","oldId":211190,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 211190 for html","longMsg":"redirecting to revision\n211190\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:37.380Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_664/كافور_الإخشيدي","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:37.392Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"وَراضي القَلبِ غَضبانِ اللِسانِ","oldId":188406,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 188406 for html","longMsg":"redirecting to revision\n188406\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:37.401Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"وَراضي_القَلبِ_غَضبانِ_اللِسانِ","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:37.405Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"كأنَّ امرأً لم يَلْقَ عيشاً بِنَعْمَة ٍ","oldId":158293,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 158293 for html","longMsg":"redirecting to revision\n158293\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:37.406Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"كأنَّ_امرأً_لم_يَلْقَ_عيشاً_بِنَعْمَة_ٍ","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:37.411Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة الرسالة/العدد 588/أمية المتعلمين","oldId":210215,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 210215 for html","longMsg":"redirecting to revision\n210215\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:37.464Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_588/أمية_المتعلمين","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:37.468Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أبلغ ضبيعة كهلها ووليدها","oldId":154629,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 154629 for html","longMsg":"redirecting to revision\n154629\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:37.470Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أبلغ_ضبيعة_كهلها_ووليدها","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:37.474Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"وَراضي_القَلبِ_غَضبانِ_اللِسانِ","oldId":188406,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 487.4602299928665ms","longMsg":"completed wt2html in 487.4602299928665ms","levelPath":"info","time":"2019-04-29T20:54:37.891Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_664/كافور_الإخشيدي","oldId":211190,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 534.7439889907837ms","longMsg":"completed wt2html in 534.7439889907837ms","levelPath":"info","time":"2019-04-29T20:54:37.924Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_588/أمية_المتعلمين","oldId":210215,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 478.65088498592377ms","longMsg":"completed wt2html in 478.65088498592377ms","levelPath":"info","time":"2019-04-29T20:54:37.945Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"كأنَّ_امرأً_لم_يَلْقَ_عيشاً_بِنَعْمَة_ٍ","oldId":158293,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 548.5135769844055ms","longMsg":"completed wt2html in 548.5135769844055ms","levelPath":"info","time":"2019-04-29T20:54:37.958Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أبلغ_ضبيعة_كهلها_ووليدها","oldId":154629,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 519.545480966568ms","longMsg":"completed wt2html in 519.545480966568ms","levelPath":"info","time":"2019-04-29T20:54:37.992Z","v":0}
[log] [2019-04-29T20:54:38.278Z] Processing batch of [10] article ids
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة الرسالة/العدد 382/موعد الشروق","oldId":207892,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 207892 for html","longMsg":"redirecting to revision\n207892\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:38.504Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_382/موعد_الشروق","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:38.509Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"ما أحسن العلمَ لمن يعمل","oldId":186579,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 186579 for html","longMsg":"redirecting to revision\n186579\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:38.533Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"ما_أحسن_العلمَ_لمن_يعمل","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:38.541Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"كتاب الأم/باب السلف والمراد به السلم/باب بيع الحيوان والسلف فيه","oldId":55683,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 55683 for html","longMsg":"redirecting to revision\n55683\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:38.544Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"كتاب_الأم/باب_السلف_والمراد_به_السلم/باب_بيع_الحيوان_والسلف_فيه","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:38.549Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة الرسالة/العدد 157/الجانب الصوفي في الفلسفة الإسلامية","oldId":203730,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 203730 for html","longMsg":"redirecting to revision\n203730\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:38.592Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_157/الجانب_الصوفي_في_الفلسفة_الإسلامية","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:38.597Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مشروع ربط خريجي الجامعة الاردنية مع ويكي مصدر 2","oldId":257330,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 257330 for html","longMsg":"redirecting to revision\n257330\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:38.875Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مشروع_ربط_خريجي_الجامعة_الاردنية_مع_ويكي_مصدر_2","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:38.881Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_382/موعد_الشروق","oldId":207892,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 438.7447509765625ms","longMsg":"completed wt2html in 438.7447509765625ms","levelPath":"info","time":"2019-04-29T20:54:38.946Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"كتاب_الأم/باب_السلف_والمراد_به_السلم/باب_بيع_الحيوان_والسلف_فيه","oldId":55683,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 499.34927701950073ms","longMsg":"completed wt2html in 499.34927701950073ms","levelPath":"info","time":"2019-04-29T20:54:39.047Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"ما_أحسن_العلمَ_لمن_يعمل","oldId":186579,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 558.5253710746765ms","longMsg":"completed wt2html in 558.5253710746765ms","levelPath":"info","time":"2019-04-29T20:54:39.097Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"مجلة_الرسالة/العدد_157/الجانب_الصوفي_في_الفلسفة_الإسلامية","oldId":203730,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 534.0689280033112ms","longMsg":"completed wt2html in 534.0689280033112ms","levelPath":"info","time":"2019-04-29T20:54:39.130Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أوميض برق بالأبيرق لاحا","oldId":191485,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 191485 for html","longMsg":"redirecting to revision\n191485\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:39.472Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أوميض_برق_بالأبيرق_لاحا","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:39.479Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"يا بالغ الستين من عمره","oldId":185499,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 185499 for html","longMsg":"redirecting to revision\n185499\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:39.608Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"يا_بالغ_الستين_من_عمره","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:39.613Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"بأبي وإن عظمَ الفداءُ فتى ً","oldId":173850,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 173850 for html","longMsg":"redirecting to revision\n173850\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:39.650Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"بأبي_وإن_عظمَ_الفداءُ_فتى_ً","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:39.655Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"كتاب الأم/الدعوى والبينات/باب رد اليمين","oldId":78444,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 78444 for html","longMsg":"redirecting to revision\n78444\nfor\nhtml","levelPath":"info","time":"2019-04-29T20:54:39.688Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"كتاب_الأم/الدعوى_والبينات/باب_رد_اليمين","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-04-29T20:54:39.693Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"يا_بالغ_الستين_من_عمره","oldId":185499,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 813.9160249233246ms","longMsg":"completed wt2html in 813.9160249233246ms","levelPath":"info","time":"2019-04-29T20:54:40.425Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"كتاب_الأم/الدعوى_والبينات/باب_رد_اليمين","oldId":78444,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 787.5330669879913ms","longMsg":"completed wt2html in 787.5330669879913ms","levelPath":"info","time":"2019-04-29T20:54:40.479Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"بأبي_وإن_عظمَ_الفداءُ_فتى_ً","oldId":173850,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 884.4353840351105ms","longMsg":"completed wt2html in 884.4353840351105ms","levelPath":"info","time":"2019-04-29T20:54:40.538Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"أوميض_برق_بالأبيرق_لاحا","oldId":191485,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 1173.5668209791183ms","longMsg":"completed wt2html in 1173.5668209791183ms","levelPath":"info","time":"2019-04-29T20:54:40.649Z","v":0}
{"name":"mwoffliner","hostname":"753e291a5786","pid":1,"level":60,"logType":"fatal","wiki":"wiki$0","title":"مشروع_ربط_خريجي_الجامعة_الاردنية_مع_ويكي_مصدر_2","oldId":257330,"reqId":null,"userAgent":"service-mobileapp-node","msg":"wt2html: Exceeded max resource use: listItem. Aborting!","stack":"","httpStatus":413,"longMsg":"wt2html: Exceeded max resource use: listItem. Aborting!","levelPath":"fatal","time":"2019-04-29T20:54:45.843Z","v":0}
[log] [2019-04-29T20:54:45.947Z] Exiting with code [1]
[log] [2019-04-29T20:54:45.947Z] Deleting tmp dump dir [/tmp/mwo-dump-1556557514204]
[log] [2019-04-29T20:54:45.951Z] Clearing Cache Directory
[log] [2019-04-29T20:54:45.952Z] Flushing Redis DBs
@kelson42 kelson42 added the bug label Apr 30, 2019
@kelson42 kelson42 added this to the 1.8.6 milestone Apr 30, 2019
@ISNIT0
Copy link
Contributor

ISNIT0 commented Apr 30, 2019

Hmm, I've already doubled the default

ISNIT0 added a commit that referenced this issue Apr 30, 2019
ISNIT0 added a commit that referenced this issue Apr 30, 2019
🔧 Increased wt2html limits #710
@kelson42
Copy link
Collaborator Author

kelson42 commented May 5, 2019

@ISNIT0 This is still a problem with 1.8.6 and Wikisource in Arabis. See https://farm.openzim.org/tasks/5ccdad1c91ae220020fc85b4. Please make a run to test the the fix works.

@kelson42 kelson42 reopened this May 5, 2019
@kelson42 kelson42 modified the milestones: 1.8.6, 1.9 May 5, 2019
@ISNIT0
Copy link
Contributor

ISNIT0 commented May 7, 2019

@kelson42 I believe this is related to #722
and the republishing of the docker image

@ISNIT0 ISNIT0 closed this as completed May 7, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants