Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enciclopedia Banrepcultural #1162

Open
Popolechien opened this issue Sep 18, 2024 · 7 comments
Open

Enciclopedia Banrepcultural #1162

Popolechien opened this issue Sep 18, 2024 · 7 comments
Assignees
Labels
Bug Something isn't working General Information Encyclopedia-like Sponsored Upstream For tickets which are waiting for an upstream modification (typically scrapper or target website) Zimit

Comments

@Popolechien
Copy link
Collaborator

We have been contacted by the National Bank of Colombia to try and look into making a zim version of their encyclopedia
https://enciclopedia.banrepcultural.org/

Recipe has been created here
https://farm.openzim.org/recipes/banrepcultural_es_all

@benoit74
Copy link
Contributor

This website is a mediawiki, see https://enciclopedia.banrepcultural.org/index.php?title=Especial:Versi%C3%B3n

I cancelled the recipe, we need to discuss the way forward but by default Zimit is not appropriate for Mediawikis because it is typically grabbing all special pages with versions, edit forms, ... e.g. all pages on https://enciclopedia.banrepcultural.org/index.php?title=Plantilla:RelacionesBanrepcultural&action=history (and same for all other articles)

@Popolechien
Copy link
Collaborator Author

Popolechien commented Sep 19, 2024

Thanks. I've changed the recipe to mwoffliner's dev version. Let's see.

Edit: Ah well it failed 😞

@benoit74
Copy link
Contributor

mwoffliner cannot work on this website as far as I can tell. It has only RestApi (no VisualEditor, no ActionParse) among possible API endpoints. And unfortunately it looks like calls to the RestAPI endpoint at https://enciclopedia.banrepcultural.org/rest.php do not work (only this URL work, but I failed to make any other request work, e.g. https://enciclopedia.banrepcultural.org/rest.php/v1/search/page?q=earth&limit=1 just fails with something which make it looks like it has been misinterpreted by the server).

Not mwoffliner fault this time ^^

I created again a zimit recipe at https://farm.openzim.org/recipes/banrepcultural.org_es_enciclopedia with some exclusion rule, it probably needs more but at least we will have something to analyze for required exclude rules.

@benoit74
Copy link
Contributor

I'm tweaking a bit the exclude parameter, but it looks we are close to have "something" with zimit (no idea about the quality, but I expect it would be quite good)

@benoit74 benoit74 added Bug Something isn't working Upstream For tickets which are waiting for an upstream modification (typically scrapper or target website) labels Sep 26, 2024
@benoit74
Copy link
Contributor

ZIM is available at https://dev.library.kiwix.org/#lang=&q=enciclopedia+banrepcultural

Can you please review it? There is one "significant" issue on images which mostly don't display when you are not on a mobile device (a tablet might be ok as well), see e.g. https://dev.library.kiwix.org/content/banrepcultural.org_es_enciclopedia_2024-09/enciclopedia.banrepcultural.org/index.php%3Ftitle%3DDelcy_Morelos_Sandoval

I will open an issue upstream, it seems pretty easy (and very interesting) to solve.

@benoit74
Copy link
Contributor

Upstream issue: openzim/warc2zim#403

Note that a custom CSS will obviously also be needed to hide non-working stuff (search bar, button for feedback, ...).

@Popolechien
Copy link
Collaborator Author

Popolechien commented Sep 27, 2024

Looks good overall, though there are lots of external links that can be clicked by mistake - clearly not the best UX.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working General Information Encyclopedia-like Sponsored Upstream For tickets which are waiting for an upstream modification (typically scrapper or target website) Zimit
Projects
None yet
Development

No branches or pull requests

2 participants